In this segment, we will explore the Python operator in Airflow.
We recommend that you follow along with the demonstrations in your own EC2 instance.
In the upcoming video, Ajay will introduce you to the Python operator.
So, in the video, you learnt the theory related to the Python operator in Airflow.
The PythonOperator is used to execute Python callables.
Some of the important parameters/arguments for the PythonOperator are listed below:
- python_callable: The function name to be called
- op_args/op_kwargs: To pass additional arguments to a Python callable
Note:
The task_id and dag arguments have to be mentioned for all operators.
In the video, you also learnt how to set dependencies between tasks. You can refer to the
diagram below to recap the same.
In the next video, we will start with the actual demonstration of the Python operator.
You can find the other resources used in the demonstration attached below.
The document below will guide you through the demonstration
In the next segment, you will learn about the Sqoop operator in Airflow.
Additional Reading
To know more about the bash operator, you can visit the following link: PythonOperator.
Report an error