Welcome to the first session on ‘Introduction to Apache Airflow’.
Let’s watch the next video, where Amit will outline the concepts that will be covered as a part of this session.
In this session
As Amit discussed in the previous video, we will see what data pipelines are and why their orchestration is needed. Next, we will discuss some possible solutions for data pipeline orchestration and understand why we choose Apache Airflow.
In the following segment, we formally introduce Airflow and discuss some of its prominent features. Then, we discuss some of the essential concepts in Airflow such as DAGs and Tasks.
Finally, we will conclude the session by discussing some important components of Airflow and understanding its internal architecture.
Note:
The PPT used in this session is available in the ‘Session Summary’ segment.