Javier Ramirez - Ingesting over 4 million rows a second on a single instance

Опубликовано: 20 Июнь 2023
на канале: Plain Schwarz
260
7

How would you build a database to support sustained ingestion of several hundreds of thousands rows per second while running near real-time queries on top?

In this session I will go over some of the technical decisions and trade-offs we applied when building QuestDB, an open source time-series database developed mainly in JAVA, and how we can achieve over four million row writes per second on a single instance without blocking or slowing down the reads. There will be code and demos, of course.

We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.

Speaker: Javier Ramirez

More: https://2023.berlinbuzzwords.de/sessi...

Web: https://2023.berlinbuzzwords.de/
Fediverse: https://floss.social/@berlinbuzzwords
Linkedin:   / 13978964  
Twitter:   / berlinbuzzwords