Skip to content

Commit

Permalink
Merge pull request #513 from ml-evs/ml-evs/jfr-remote-link
Browse files Browse the repository at this point in the history
  • Loading branch information
utf authored Dec 18, 2023
2 parents 0032693 + 2649c38 commit f5cf247
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 1 deletion.
2 changes: 1 addition & 1 deletion paper/paper.md
Original file line number Diff line number Diff line change
Expand Up @@ -183,7 +183,7 @@ One of the major benefits of Jobflow is that it decouples the details related to

When deploying production calculations, workflows often need to be dispatched to large supercomputers through a remote execution engine. Jobflow has an interface with the FireWorks package [@fireworks] via a one-line command to convert a `Flow` and its underlying `Job` objects into the analogous FireWorks `Workflow` and `Firework` objects that enable execution on high-performance computing machines. The logic behind the `Job` and `Flow` objects are not tied to FireWorks in any direct way, such that the two packages are fully decoupled.

Additionally, a remote mode of execution built solely around Jobflow is currently under active development. With this approach, workflows can be executed across multiple "workers" (e.g., a simple computer, a supercomputer, or a cloud-based service) and managed through a modern command-line interface without relying on an external workflow execution engine. The forthcoming Jobflow remote mode of execution has been designed such that no inbound connection from the workers to the database of jobs and results is needed, thus ensuring data and network security for professional usage.
Additionally, a remote mode of execution built solely around Jobflow is currently under active development [@jobflowremote]. With this approach, workflows can be executed across multiple "workers" (e.g., a simple computer, a supercomputer, or a cloud-based service) and managed through a modern command-line interface without relying on an external workflow execution engine. The forthcoming Jobflow remote mode of execution has been designed such that no inbound connection from the workers to the database of jobs and results is needed, thus ensuring data and network security for professional usage.

More generally, it is possible for users to develop custom "adapter" interfaces to their personal workflow execution engine of choice. As a result, Jobflow fills a niche in the broader workflow community and can help make the same workflow definition interoperable across multiple workflow execution engines.

Expand Down
6 changes: 6 additions & 0 deletions paper/refs.bib
Original file line number Diff line number Diff line change
Expand Up @@ -159,3 +159,9 @@ @misc{montydb
year = {2023},
url={https://github.com/davidlatwe/montydb}
}

@misc{jobflowremote,
title={Jobflow Remote},
year={2023},
url={https://github.com/Matgenix/jobflow-remote}
}

0 comments on commit f5cf247

Please sign in to comment.