New episode: Real World problems

[jhidding]

• List some high level libraries:

  • higher-level abstractions for multiprocessing/multithreading:
    - joblib
    - ray
    - each case is different, so have to try out
    • jax: alternative to numba, and also heavily used in machine learning
    • xarray works well together with dask

• domain-specific software often uses the things we discussed in this course (and the above libraries) under the hood. for instance, in geoscience:

  • iris
  • esmvaltool

• Exercises: real world problems, come up with strategy for parallelization without actually implementing