BSides London 2021 BSides London 2021

Saturday, November 13, 2021

Making Big Datasets Searchable

This talk covers the process of making Rapid7's Project Sonar dataset searchable. Starting with the initial naive approach taken to achieving this goal, and then moving onto the next iteration which took a more sophisticated approach in order to achieve microsecond lookup times for entries in a 180GB dataset with O(1) time complexity.