Apr 28, 2017 · I would like to create a conditional task in Airflow as described in the schema below. The expected scenario is the following: Task 1 executes If Task 1 succeed, then …

Feb 12, 2021 · 78 I've just installed Apache Airflow, and I'm launching the webserver for the first time, and it asks me for username and password, I haven't set any username or password. …

Oct 29, 2022 · In my actual DAG, I need to first get a list of IDs and then for each ID run a set of tasks. I have used Dynamic Task Mapping to pass a list to a single task or operator to have it …

Oct 6, 2016 · I'm just getting started with Airbnb's airflow, and I'm still not clear on how/when backfilling is done. Specifically, there are 2 use-cases that confuse me: If I run airflow …

Jul 10, 2023 · I'm using airflow 2.3.4 and primarily interact with airflow through the web UI. Two questions: Is there a way to force a reparse of a DAG definition file in Airflow? How about all …

Aug 23, 2021 · Make sure that the value of AIRFLOW__WEBSERVER__SECRET_KEY in the worker nodes and the webserver (main node) is the same. You can find more details on this …

Mar 30, 2016 · I want to try to use Airflow instead of Cron. But schedule_interval doesn't work as I expected. I wrote the python code like below. And in my understanding, Airflow should have …

Feb 20, 2024 · How to enable test connection button in Airflow in v2.7.1 Asked 1 year, 4 months ago Modified 1 year, 2 months ago Viewed 7k times

Dec 30, 2022 · I have some questions concerning the starting of Airflow. To start Airflow I use 3 differents ways: 1st way: I install airflow with the command pip install apache-airflow I initialize …

Jun 8, 2021 · I am currently working on a DAG that requires monthly looping over a long list of tasks. To achieve this, I create an empty list and then loop over several tasks, changing their …