AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |
Back to Blog
Apache airflow interview questions1/14/2024 ![]() Hooks enable Airflow to interface with third-party systems. Operators that can move data from one system to the other.Operators that execute an action or request a different system to execute an action.Operators that can run until specific conditions are fulfilled.In Apache Airflow, you can find three primary types of operators: ![]() These operators are generally used to specify actions that must be executed in Python, Bash, MySQL, and Email. You can find operators for a variety of basic tasks, like: All of the operators are originated from BaseOperator. An operator is much like a class or a template that helps execute a specific task. In Apache Airflow, operators are meant to define the work. They illustrate the work that is completed at every step of the workflow with real work that will be portrayed by being defined by the operators. You can take them up as work units that are showcased by nodes in the DAG. Tasks vary in terms of complexity and they are operators’ instantiations. There could be several DAG runs connected to one DAG running simultaneously. This way, every instantiation of the DAG will establish a DAG run. Let’s assume that you have a DAG scheduled and it should run every hour. DAG Runīasically, when a DAG gets executed, it is known as a DAG run. One thing that you must note here is that a DAG is meant to define how the tasks will be executed and not what specific tasks will be doing.
0 Comments
Read More
Leave a Reply. |