Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a RP worker #13

Open
jhprinz opened this issue Mar 13, 2017 · 0 comments
Open

Create a RP worker #13

jhprinz opened this issue Mar 13, 2017 · 0 comments

Comments

@jhprinz
Copy link
Contributor

jhprinz commented Mar 13, 2017

I think that would be a good addition. Currently you submit tasks to the queue and the stand-alone worker grab jobs to complete.

The RP implementation with a scheduler requires a user to explicitely place jobs in the correct order in the RP queue and they will be executed. I would like to copy the same single-worker mechanism to auto submit jobs to an RP queue.

That means you can just add all RP clusters to the execution as well. Example

# submit some trajectory jobs
project.queue(project.new_trajectory(pdb_file, 100) for f in range(1000))

then you would start a RP job worker that will create a session for some time grab some tasks to be executed.

adaptiverpworker -d {...} --cores=100 --resource=fub.allegro --walltime=02:00:00 project_name

this can run whereever it has access to the cluster and to the DB. Options should be similar to the adativeworker

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant