Numberly: Joining Billions of Rows in Seconds - Replacing MongoDB and Hive
Many organizations struggle to balance traditional big data infrastructure with NoSQL databases. Other organizations do the smart thing and consolidate the two. This presentation explores Numberly’s experience migrating an intensive and join hungry production workload from MongoDB and Hive to Scylla. Using Scylla, we were able to accommodate a join of billions of rows in seconds, while also dramatically reducing operational and development complexity by using a single database for our hybrid analytical use case. As a bonus, we’ll cover benchmarks for Dask (a flexible parallel computing library for analytic computing) and Spark, highlighting their differences and lessons learned along the way.
-----
Learn more about Scylla Open Source: https://www.scylladb.com/open-source/
Test drive Scylla Enterprise: https://www.scylladb.com/test-drive/
Find out about Scylla Cloud: https://www.scylladb.com/product/scyl...
