So far, you have learnt about several operators in Airflow. Now, in this segment, we will discuss the Base operator, which is the parent operator from which all the other operators are derived.
In the upcoming video, Ajay will introduce you to the Base operator.
So, in the video, you learnt about the Base operator in Airflow.
The BaseOperator is the abstract base class for all the operators and so, the data members and methods declared in this class are available to all the operators.
It can be used to create custom operators, thus highlighting the extensible nature of Airflow.
Some of the important parameters/arguments for the BaseOperator are listed below:
- task_id, owner, email, email_on_retry, retries, depends_on_past, dag, params, default_args, queue, sla, execution_timeout, on_failure_callback, on_success_callback, on_retry_callback, trigger_rule, run_as_user, task_concurrency, do_xcom_push
Note:
The arguments mentioned above are available to all the operators derived from the BaseOperator (Bash operator, Python operator, Hive operator etc.).
Additional Reading
You can visit the following link for the official documentation of the BaseOperator: BaseOperator.
Report an error