Welcome to the session on ‘Advanced Structured Streaming’.
In the previous session, you learnt the basics of structured streaming comprising of a few coding labs as well.
In the next video, our SME Kautuk will provide an overview of the topics that will be covered in this session.
- To begin with, you will gain an understanding of event and processing times followed by window operations.
- Next, you will understand the difference between sliding and tumbling windows and learn about various terms and their meanings, such as ‘batch interval’ and ‘sliding interval’.
You will also learn about the importance of various output modes such as complete, append and update. - To end this session, you will learn how to handle late-arriving data, what watermarks are, and how to use watermarks to handle late-arriving data.
So, let’s get started!
People you will hear from in this session
Subject Matter Expert
Ajay Shukla
Senior Data Engineer
Kautuk is currently working as a senior data engineer. He has over nine years of experience in the IT industry and has worked in various companies. He has deep knowledge of various tools and technologies that are used today.
Report an error