Algebird : algebra for efficient big data processing

Опубликовано: 10 Май 2025
на канале: Parleys
442
5

Algebird is an abstract algebra library for Scala, developed at Twitter and released under the ASL 2.0 license. It has support for algebraic structures such as semigroups, monoids, groups, rings and fields as well as the standard functional things like monads. More interestingly though are the probabilistic data structures and the accompanying monoids that come out of the box. Basically it's a toolbox to speed up big data analytics processing. In this talk II'll talk a bit about Algebird in general and how it integrates with other tools like Map Reduce, Spark, Storm to building large scale analytics systems with Map Reduce systems or in a stream processing context.


Author:
Sam Bessalah
I am a freealance software engineer based in France and the Netherlands. I work on big data, data engineering, distributed computing and machine learning related projects. I co-origanize the Paris Datageek Meetup, and regularly speak on big data projects, and

Blog: https://plus.google.com/1069130908201...