Spark Structured Streaming as a Batch Job? File based data ingestion benefits from pseudo streaming?

Опубликовано: 28 Октябрь 2024
на канале: Tech Island
1,955
29

How to use Spark Structured Streaming Job as a Batch Job? How File based data ingestion gets benefit from pseudo streaming job?

Using Trigger ONCE functionality in streaming

In this lecture, we are going to see the importance of Trigger Once option in streaming and how we can use this trick in real time file based data ingestion workloads.


Medium Blog link -   / yaj03noq67  

Facebook Page - https://www.facebook.com/Tech-Island-...

Content By - Karthikeyan Siva Baskaran [LinkedIn -   / karthikey.  .]
Editing By - Sivaraman Ravi [LinkedIn -   / sivaraman.  .]

Please SUBSCRIBE to our channel :)

Share your feedback with us.
[email protected]