How can I make a task dependent on another, but also only run at a certain time?

Question

I have two tasks.

T05:30 - I wish for this to run at 05:30 every day.
T08:30 - I wish for this to run at 08:30 every day, but only if T05:30 has succeeded today.

Can this be achieved in Airflow? It appears that dependencies (i.e. run T8:30 only if only if T05:30 has succeeded today) are a task-only concept but schedules (05:30 every day and 08:30 every day) are a DAG-only concept.

I could hack this by checking variables or something external, but I'm hoping that there is an idiomatic solution to this.

airflow.apache.org/docs/apache-airflow/stable/_api/airflow/… — sahasrara62
– sahasrara62, Commented Jan 23 at 19:49

Guilherme Vargas · Accepted Answer · 2025-01-28 12:42:01Z

0

Maybe you could use a sensor https://airflow.apache.org/docs/apache-airflow/stable/howto/operator/time.html

Think in the dependencies defined ( task_1 >> sensor >> task_2) task_1 will run at 5h30, if it sucessed it will run the sensor (it`ll wait until 8h30) and finally running the task_2.

answered Jan 28 at 12:42

Guilherme Vargas

265 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How can I make a task dependent on another, but also only run at a certain time?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related