Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MPI Island class for cluster computing #563

Open
montanaviking opened this issue Dec 19, 2023 · 2 comments
Open

MPI Island class for cluster computing #563

montanaviking opened this issue Dec 19, 2023 · 2 comments

Comments

@montanaviking
Copy link

I'd like to see an MPI Island class for cluster computing whereby islands can run and migrate on several machines to perform one optimization problem. This capability existed in Pagmo1x but does not yet exist in Pagmo2x. It doesn't have to use MPI specifically, but must allow optimization and decision vector migration between machines. I'm thinking of creating a Pagmo::Islandcluster by copying and modifying Pagmo::Island to include the use of sockets and serialization.
At some point, I'd like to contribute a solution, but wondering if there's any documentation for Pagmo::Island internals than the source code? If someone has this documentation, could you kindly let me know?
Thanks,
Phil

@montanaviking
Copy link
Author

Actually, I'd rather not use MPI or OpenMPI but rather retain use of Intel TBB and use socket code + serialization to create the multi-node island class because I think that TBB is faster than other solutions for multiprocessing and has other advantages as well. I'm looking at the Pagmo2 Island class source code but would like input and documentation regarding its internal interface to the parent archipelago for migration, if someone can assist me?
I would use the present pagmo::island class as a starting point and template to create a new pagmo::island_multinode class that would enable migrations across machines via the machines' LAN network interface cards (NICs). This would certainly make Pagmo2 more exciting. Thanks, Phil

@vmarlasco
Copy link

Hello! I'm also interested in the cluster computing enhancement. Any updates on this topic? Is this planned? Thank you very much in advance

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants