In this segment, we will discuss an important Airflow concept: Operators. You will also learn how to create tasks using these operators and, in turn, lay the foundation for the remainder of this session.
In the upcoming video, Amit will discuss operators in detail. So, in the video, you learnt about operators and also learnt how to define one in Airflow.
Operators describe a single task in a workflow, which can be a Shell script, a Hive query, a Python function, etc.
Different operators have different attributes, but certain arguments are common to all operators, for example, the task_id (name of the task) and dag (name of the dag object the task belongs to) arguments.
So, now that you have finished setting up Airflow in your Ec2 machine and learnt what operators are, from the next segment onwards, you will begin your hands-on with some important operators.
Additional Reading
To know more about operators in Airflow, you can visit the following link: Operators.
Report an error