.Net Core Streaming with Kafka - Part 1

Опубликовано: 13 Октябрь 2024
на канале: DotNet Core Central

33,618

246

This post is the first part of the .Net Core streaming series. In the series I will be creating a streaming application in .Net Core. And I will be using Apache Kafka as the streaming platform.

Apache Kafka is a distributed streaming platform. And it provides the following three key capabilities:

1. Publish and subscribe to streams of records
2. Store streams of record in a fault-tolerant way
3. Let’s application process streams of records as they appear

Kafka runs as a cluster on one or more servers. And in Kafka, records are stored in categories called topics, where each record has a key, a value, and a timestamp.

There are two main broad categories of applications where Kafka can be used.

1. Building real-time fault-tolerant streaming data pipeline.
2. Building real-time fault-tolerant streaming applications.

Kafka has four core API’s, Producer, Consumer, Streams, and Connector. For this post, I will be focusing only on Producer and Consumer. I will be using built-in Producer and create .Net Core Consumer. In my next post, I will be creating a .Net Core Producer.

Detail of this video is available in my Blog: http://bit.ly/36ysHvC