update documentation on dask job queue

pangeo-data · Jun 28, 2024 · c9c5961 · c9c5961
1 parent a5e6e9c
commit c9c5961
Showing 1 changed file with 13 additions and 13 deletions.
diff --git a/docs/pangeo/dask_spider.ipynb b/docs/pangeo/dask_spider.ipynb
@@ -2781,20 +2781,20 @@
    "id": "c27e06ec-f40a-4ed4-b0b0-61db5232e115",
    "metadata": {},
    "source": [
-    "## Scaling your Computation using Dask Gateway.\n",
+    "## Scaling your Computation using Dask jobqueue.\n",
     "\n",
-    "For this workshop, according to the Pangeo EOSC deployment, you will learn how to use Dask Gateway to manage Dask clusters over Kubernetes, allowing to run our data analysis in parallel e.g. distribute tasks across several workers.\n",
+    "For this workshop, according to the Pangeo EOSC deployment, you learned how to use Dask Gateway to manage Dask clusters over Kubernetes, allowing to run our data analysis in parallel e.g. distribute tasks across several workers.\n",
     "\n",
-    "Lets set up your Dask cluster through Dask Gateway.  \n",
-    "As Dask Gateway is configured by default on this ifnrastructure, you just need to execute the following cells."
+    "Lets now try set up your Dask cluster using HPC infrastructure with Dask jobqueue.  \n",
+    "As Dask jobqueue is configured by default on this ifnrastructure thanks to <a href=\"JupyterDaskOnSLURM \">https://github.com/RS-DAT/JupyterDaskOnSLURM/blob/main/user-guide.md#container-wrapper-for-spider-system</a> we just installed in the last section, you just need copy the SLURMCluster configuration cell below and  execute it to connect the Dask jobqueue SLURMCluster.  "
    ]
   },
   {
    "cell_type": "markdown",
    "id": "830b67ad-3a82-4dd7-8ab6-3015d12c3240",
    "metadata": {},
    "source": [
-    "make sure you use the right port (taken from the left panel)"
+    "Make sure you use the right port (taken from the left panel), and click scale, to have several workers.  "
    ]
   },
   {
@@ -13276,6 +13276,14 @@
     "client.close()"
    ]
   },
+  {
+   "cell_type": "markdown",
+   "id": "0684b03e-bfbb-435b-8c4b-aba54da5f1b0",
+   "metadata": {},
+   "source": [
+    "You can also shutdown the cluster by clicking 'ShutDown' in the dask-lab extension's SLURMCluster configuration panel.  "
+   ]
+  },
   {
    "cell_type": "markdown",
    "id": "56304d1c",
@@ -13308,14 +13316,6 @@
    "source": [
     "!squeue -u $USER"
    ]
-  },
-  {
-   "cell_type": "code",
-   "execution_count": null,
-   "id": "74293ba9-d50b-4e48-8c80-131351c7c389",
-   "metadata": {},
-   "outputs": [],
-   "source": []
   }
  ],
  "metadata": {