You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We have a situation where we need to run six tasks which reads form same DB. One of this task is long running and none of other 5 tasks should run while the 1st one is running. Once the 1st task is complete then all 5 other tasks can start.
I see couple of options here.
Use a dag with dependencies
Use steps and when condition.
I was wondering if we could use mutex for implementing a better solution. With current implementation of mutex we can only say here is a mutex that is common for all 6 jobs. But the problem here is the 5 jobs should not stop each other. So, if there is a way to say release 5 jobs once the mutex is released by first job, that would be a more cleaner solution.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
We have a situation where we need to run six tasks which reads form same DB. One of this task is long running and none of other 5 tasks should run while the 1st one is running. Once the 1st task is complete then all 5 other tasks can start.
I see couple of options here.
I was wondering if we could use mutex for implementing a better solution. With current implementation of mutex we can only say
here is a mutex that is common for all 6 jobs
. But the problem here is the 5 jobs should not stop each other. So, if there is a way to say release 5 jobs once the mutex is released by first job, that would be a more cleaner solution.Beta Was this translation helpful? Give feedback.
All reactions