Welcome to the session on ‘Advanced Structured Streaming’.
In the previous session, you learnt the basics of structured streaming comprising of a few coding labs as well.
In the next video, our SME Ajay will provide an overview of the topics that will be covered in this session.
- To begin with, you will gain an understanding of event and processing time followed by window operations.
- Next, you will understanding the difference between sliding and tumbling windows and learn about various terms and their meanings, such as ‘batch interval’ and ‘sliding interval’.
- You will also learn about the importance of various output modes such as complete, append and update.
- To end this session, you will learn how to handle late-arriving data, what watermarks are, and how to use watermarks to handle late-arriving data.
So, let’s get started!
People you will hear from in this session
Subject Matter Expert
Ajay Shukla
Senior Data Engineer
Ajay is currently working as a senior data engineer. He has over nine years of experience in the ‘IT’ industry and has worked in various companies. He has deep knowledge of various tools and technologies that are used today.
Report an error