Skip to content

Commit

Permalink
Deploying to gh-pages from @ dstackai/dstack@c969081 🚀
Browse files Browse the repository at this point in the history
  • Loading branch information
peterschmidt85 committed Jun 6, 2024
1 parent da7b31b commit 617852f
Show file tree
Hide file tree
Showing 35 changed files with 717 additions and 131 deletions.
2 changes: 1 addition & 1 deletion 404.html
Original file line number Diff line number Diff line change
Expand Up @@ -195,7 +195,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
4 changes: 4 additions & 0 deletions assets/images/oci-logo.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
7 changes: 7 additions & 0 deletions assets/images/runpod-logo.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion blog/archive/2024/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -217,7 +217,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion blog/archive/say-goodbye-to-managed-notebooks/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -215,7 +215,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion blog/dstack-research/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -217,7 +217,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion blog/dstack-sky/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -217,7 +217,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion blog/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion changelog/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -215,7 +215,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/concepts/dev-environments/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/concepts/gateways/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/concepts/pools/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
6 changes: 3 additions & 3 deletions docs/concepts/services/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down Expand Up @@ -1987,12 +1987,12 @@ <h2 id="running">Running<a class="headerlink" href="#running" title="Permanent l
</blockquote>
<h2 id="service-endpoint">Service endpoint<a class="headerlink" href="#service-endpoint" title="Permanent link">&para;</a></h2>
<p>One the service is up, its endpoint is accessible at <code>https://&lt;run name&gt;.&lt;gateway domain&gt;</code>.</p>
<p>By default, the service endpoint requires the <code>Authorization</code> header with <code>"Bearer &lt;dstack token&gt;"</code>. </p>
<p>By default, the service endpoint requires the <code>Authorization</code> header with <code>Bearer &lt;dstack token&gt;</code>. </p>
<div class="termy">

<div class="highlight"><pre><span></span><code>$<span class="w"> </span>curl<span class="w"> </span>https://yellow-cat-1.example.com/v1/chat/completions<span class="w"> </span><span class="se">\</span>
<span class="w"> </span>-H<span class="w"> </span><span class="s1">&#39;Content-Type: application/json&#39;</span><span class="w"> </span><span class="se">\</span>
<span class="w"> </span>-H<span class="w"> </span><span class="s1">&#39;Authorization: &quot;Bearer &amp;lt;dstack token&amp;gt;&quot;&#39;</span><span class="w"> </span><span class="se">\</span>
<span class="w"> </span>-H<span class="w"> </span><span class="s1">&#39;Authorization: Bearer &amp;lt;dstack token&amp;gt;&#39;</span><span class="w"> </span><span class="se">\</span>
<span class="w"> </span>-d<span class="w"> </span><span class="s1">&#39;{</span>
<span class="s1"> &quot;model&quot;: &quot;NousResearch/Llama-2-7b-chat-hf&quot;,</span>
<span class="s1"> &quot;messages&quot;: [</span>
Expand Down
2 changes: 1 addition & 1 deletion docs/concepts/tasks/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
4 changes: 2 additions & 2 deletions docs/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down Expand Up @@ -1818,7 +1818,7 @@
<h1 id="what-is-dstack">What is dstack?<a class="headerlink" href="#what-is-dstack" title="Permanent link">&para;</a></h1>
<p><code>dstack</code> is an open-source container orchestration engine designed for running AI workloads across any cloud or data center.</p>
<blockquote>
<p>The supported cloud providers include AWS, GCP, Azure, Lambda, TensorDock, Vast.ai, CUDO, and RunPod.
<p>The supported cloud providers include AWS, GCP, Azure, OCI, Lambda, TensorDock, Vast.ai, RunPod, and CUDO.
You can also use <code>dstack</code> ro run workloads on on-prem servers.</p>
</blockquote>
<p><code>dstack</code> supports dev environements, running tasks on clusters, and deployment with auto-scaling and
Expand Down
2 changes: 1 addition & 1 deletion docs/installation/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
16 changes: 13 additions & 3 deletions docs/protips/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down Expand Up @@ -2098,7 +2098,7 @@ <h2 id="gpu">GPU<a class="headerlink" href="#gpu" title="Permanent link">&para;<
<li><code>A100:40GB:2</code> (two A100 40GB)</li>
</ul>
<h2 id="service-quotas">Service quotas<a class="headerlink" href="#service-quotas" title="Permanent link">&para;</a></h2>
<p>If you're using your own AWS, GCP, or Azure accounts, before you can use GPUs or spot instances, you have to request the
<p>If you're using your own AWS, GCP, Azure, or OCI accounts, before you can use GPUs or spot instances, you have to request the
corresponding service quotas for each type of instance in each region.</p>
<details class="info">
<summary>AWS</summary>
Expand Down Expand Up @@ -2134,7 +2134,7 @@ <h2 id="service-quotas">Service quotas<a class="headerlink" href="#service-quota
</details>
<details class="info">
<summary>Azure</summary>
<p>Check this <a href="https://learn.microsoft.com/en-us/azure/quotas/quickstart-increase-quota-portal" target="_blank">guide <span class="twemoji external"><svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="m11.93 5 2.83 2.83L5 17.59 6.42 19l9.76-9.75L19 12.07V5h-7.07Z"/></svg></span></a> on Compute Engine service quotas.
<p>Check this <a href="https://learn.microsoft.com/en-us/azure/quotas/quickstart-increase-quota-portal" target="_blank">guide <span class="twemoji external"><svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="m11.93 5 2.83 2.83L5 17.59 6.42 19l9.76-9.75L19 12.07V5h-7.07Z"/></svg></span></a> on Azure service quotas.
The relevant service quotas include:</p>
<ul>
<li><code>Total Regional Spot vCPUs</code> (any spot instances)</li>
Expand All @@ -2147,6 +2147,16 @@ <h2 id="service-quotas">Service quotas<a class="headerlink" href="#service-quota
<li><code>Standard NDSH100v5 Family vCPUs</code> (on-demand H100 x8)</li>
</ul>
</details>
<details class="info">
<summary>OCI</summary>
<p>Check this <a href="https://docs.oracle.com/en-us/iaas/Content/General/Concepts/servicelimits.htm#Requesti" target="_blank">guide <span class="twemoji external"><svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="m11.93 5 2.83 2.83L5 17.59 6.42 19l9.76-9.75L19 12.07V5h-7.07Z"/></svg></span></a> on requesting OCI service limits increase.
The relevant service category is compute. The relevant resources include:</p>
<ul>
<li><code>GPUs for GPU.A10 based VM and BM instances</code> (on-demand A10)</li>
<li><code>GPUs for GPU2 based VM and BM instances</code> (on-demand P100)</li>
<li><code>GPUs for GPU3 based VM and BM instances</code> (on-demand V100)</li>
</ul>
</details>
<p>Note, for AWS, GCP, and Azure, service quota values are measured with the number of CPUs rather than GPUs.</p>
<h2 id="data-and-models">Data and models<a class="headerlink" href="#data-and-models" title="Permanent link">&para;</a></h2>
<p>For loading and saving data, it's best to use object storage like S3 or HuggingFace Datasets.</p>
Expand Down
2 changes: 1 addition & 1 deletion docs/quickstart/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/api/python/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/api/rest/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -214,7 +214,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/api/rest/openapi.json

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion docs/reference/cli/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/dstack.yml/dev-environment/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/dstack.yml/gateway/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/dstack.yml/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -215,7 +215,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/dstack.yml/service/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/dstack.yml/task/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/profiles.yml/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,7 +219,7 @@

</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
Expand Down
Loading

0 comments on commit 617852f

Please sign in to comment.