This is a Python script to perform a word count of a 10 GB file full of tweets stored on the University of Melbourne's Hybrid cluster system - SPARTAN, using multiple cores and nodes. This program facilitates this process through the functionality of parallel read that MPI-IO provides.
-
Notifications
You must be signed in to change notification settings - Fork 0
This is a Python script to perform a word count of a 10 GB file full of tweets stored on the University of Melbourne's Hybrid cluster system - SPARTAN, using multiple cores and nodes. This program facilitates this process through the functionality of parallel read that MPI-IO provides. The job is submitted onto the cluster using Slurm.
rsdelhi91/MPI-IO-SPARTAN-Cluster
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This is a Python script to perform a word count of a 10 GB file full of tweets stored on the University of Melbourne's Hybrid cluster system - SPARTAN, using multiple cores and nodes. This program facilitates this process through the functionality of parallel read that MPI-IO provides. The job is submitted onto the cluster using Slurm.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published