Based on
- rq
- redis
- gevent
Environment variables
PRQ_LOGS- path to file with logs (512Mb data)
Every pipeline part use .wait() to get result, if you want, it not block other task, task run in parallel.
Example to test
- Start worker
python prq.py --url redis://localhost:6379
(export python path before) 2. (a) Start pipeline (2 task)
python examples/pipeline/task_pipeline.py
- (b) Start another task in parallel execution
python examples/tasks/default_task.py