Welcome to the third session on ‘Real-World Use Case of Airflow’. Over the last two sessions, you learnt about various features of Airflow. We also provided some simple DAGs, highlighting the use of various operators.
Let’s start this session by watching the upcoming video in which Ajay outlines the concepts that will be covered in this session.
In this session
Now that you have the theoretical knowledge and practical skills with respect to Airflow, let;s work on a real-world problem statement and put these skills to use.
In the process, we will deep dive into some of the advanced concepts of Apache Airflow such as SubDAGs, Xcoms and Trigger rules. (Bonus Optional Content).
Then, you will take a look at some best practices to follow when developing your DAG in production.
Finally, we will discuss some advantages and limitations of Airflow.
Note:
The PPT used in this session is available in the ‘Session Summary’ segment.