Advancing Spark - Delta Merging with Structured Streaming Data
Delta's merge functionality is amazingly valuable when dealing with largely varied and changeable datasets, however there is a growing movement towards streaming data as more and more source systems over live event feeds as a method of ingesting data. But how can we take advantage of both/ Using the full delta merge functionality AND spark streaming? At the same time?!?
In this week's video, Simon shows us how to take an existing Delta streaming query, appending data directly from one delta table to another, and update it with full Delta merge capabilities.
As always, stop by the advancing analytics website if you want to know more about our Databricks training, or how we can help you build a next generation spark-based data platform!
www.advancinganalytics.co.uk
