Skip to content
This repository has been archived by the owner on Dec 11, 2020. It is now read-only.

WIP: enable dask-gateway #144

Open
wants to merge 225 commits into
base: master
Choose a base branch
from
Open

WIP: enable dask-gateway #144

wants to merge 225 commits into from

Conversation

bolliger32
Copy link
Member

@bolliger32 bolliger32 commented Sep 10, 2020

Workflow

  • Notebook:worker pairing builds & passes local build, visual inspection & client.map tests
  • Passes travis tests
  • Image deployed on dev branch (see notebook and worker dev tags)
  • Worker passes manual deployment test on compute.rhg
  • Notebook+worker passes test-hub deployment
  • Updates integrated into downstream images

Summary

This PR is designed in concert with RhodiumGroup/helm-chart#14 and RhodiumGroup/rhg_compute_tools#87 and should be available to be tested on the adrastea cluster (which is set up with a dask-gateway server). In the process of incorporating gateway, I shifted some structure around a bit based on updates that had been incorporated in the coastal image workflow. See Features for details

Features

  • incorporated dask-gateway
  • moved environments and other resources shared across worker and notebook images into a shared_resources folder so that they are easily copied into each image's subfolder
  • added a scheduler image which is just a lightweight version of our images that will be used for dask-gateway schedulers
  • added some jupyterlab extensions just for some improved UI. in particular
    • TOC
    • jupyterlab-code-formatter (in-notebook application of black/isort)
    • git
    • An improved CSV tool
    • data explorer (a la RStudio)
    • added some rulers
  • closes Install NBDIME notebook diff plugin #133

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Install NBDIME notebook diff plugin
3 participants