Skip to content

Commit

Permalink
- Updated the Vast.ai blog announcement (ready to be published)
Browse files Browse the repository at this point in the history
  • Loading branch information
peterschmidt85 committed Nov 21, 2023
1 parent b8e9cf9 commit 421555c
Show file tree
Hide file tree
Showing 4 changed files with 23 additions and 22 deletions.
5 changes: 2 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,11 +30,10 @@ Supported providers: AWS, GCP, Azure, Lambda, TensorDock, and Vast.ai.

## Latest news ✨

- [2023/11] [Access the GPU marketplace with Vast.ai](https://dstack.ai/blog/2023/11/21/vastai/) (Release)
- [2023/10] [Use world's cheapest GPUs with TensorDock](https://dstack.ai/blog/2023/10/31/tensordock/) (Release)
- [2023/10] [Fine-tuning API](https://dstack.ai/docs/guides/fine-tuning/) (Release)
- [2023/10] [A preview of fine-tuning API](https://dstack.ai/docs/guides/fine-tuning/) (Release)
- [2023/09] [RAG with Llama Index and Weaviate](https://dstack.ai/examples/llama-index-weaviate) (Example)
- [2023/09] [Deploying LLMs using Python API](https://dstack.ai/examples/deploy-python) (Example)
- [2023/08] [Fine-tuning Llama 2 using QLoRA](https://dstack.ai/examples/finetuning-llama-2) (Example)
- [2023/08] [Deploying Stable Diffusion using FastAPI](https://dstack.ai/examples/stable-diffusion-xl) (Example)
- [2023/07] [Deploying LLMs using TGI](https://dstack.ai/examples/text-generation-inference) (Example)
- [2023/07] [Deploying LLMs using vLLM](https://dstack.ai/examples/vllm) (Example)
Expand Down
36 changes: 19 additions & 17 deletions docs/blog/posts/vastai.md
Original file line number Diff line number Diff line change
@@ -1,27 +1,27 @@
---
title: "Accessing the GPU marketplace with Vast.ai and dstack"
date: 2023-11-21
description: "With dstack 0.12.3, you can now use Vast.ai's GPU marketplace to train and deploy gen AI models."
description: "With dstack 0.12.3, you can now develop, train and deploy gen AI models using affordable cloud GPUs."
slug: "vastai"
categories:
- Releases
draft: true
---

# Accessing the GPU marketplace with Vast.ai and dstack

__With dstack 0.12.3, you can now use Vast.ai's GPU marketplace as a cloud provider.__

`dstack` offers a developer-friendly CLI and API to train and deploy gen AI models across any
cloud. It streamlines development and deployment, eliminating the need for cloud infrastructure setup.
`dstack` simplifies gen AI model development and deployment through its developer-friendly CLI and API.
It eliminates cloud infrastructure hassles while supporting top cloud providers (such as AWS, GCP,
Azure, among others).

The cost of GPUs is often the most critical factor hindering development. To address this, we
integrated with [Vast.ai](https://vast.ai/), providing GPUs from the marketplace at a lower cost.
While `dstack` streamlines infrastructure challenges, GPU costs can still hinder development. To address this,
we've integrated `dstack` with [Vast.ai](https://vast.ai/), a marketplace providing GPUs from independent hosts at
notably lower prices compared to other providers.

<!-- more -->

Vast.ai offers a variety of GPUs from independent hosts and data centers.
By default, it suggests GPU instances based on their quality score. If you want to, you can set the maximum price.
With the `dstack` 0.12.3 release, it's now possible use Vast.ai alongside other cloud providers.

<div class="termy">

Expand All @@ -39,12 +39,13 @@ Continue? [y/n]:

</div>

By default, it suggests GPU instances based on their quality score. If you want to, you can control the maximum price.

You can use Vast.ai to [fine-tune](../../docs/guides/fine-tuning.md), and
[deploy](../../docs/guides/text-generation.md) models or
launching [dev environments](../../docs/guides/dev-environments.md) (which are highly convenient for interactive coding with your favorite IDE).
Additionally, you can use Vast.ai alongside other cloud providers, switching to it when needed.
launch [dev environments](../../docs/guides/dev-environments.md) (which are highly convenient for interactive coding with your favorite IDE).

Configuring Vast.ai for use with `dstack` is very easy. Log into your [Vast AI](https://cloud.vast.ai/) account, click Account in the sidebar,
Configuring Vast.ai for use with `dstack` is easy. Log into your [Vast AI](https://cloud.vast.ai/) account, click `Account` in the sidebar,
and copy your API Key.

Then, go ahead and configure the backend:
Expand All @@ -65,12 +66,13 @@ projects:
Now you can restart the server and proceed to using `dstack`'s CLI and API.

If you've been seeking the simplest way to train and deploy generative AI models utilizing cost-effective cloud GPUs, be
sure to give `dstack` with Vast.ai a try.

Lastly, take the time to check out the new preview versions of the [fine-tuning](../../docs/guides/fine-tuning.md) and
[text generation](../../docs/guides/text-generation.md) APIs.
If you want an easy way to
develop, train and deploy gen AI models using affordable cloud GPUs,
give `dstack` with Vast.ai a try.

!!! info "Feedback and support"
Feel free to ask questions or seek help in our
[Discord server](https://discord.gg/u8SmfwPpMd).
[Discord server](https://discord.gg/u8SmfwPpMd).

> Lastly, take the time to check out the preview of the new [fine-tuning](../../docs/guides/fine-tuning.md) and
[text generation](../../docs/guides/text-generation.md) APIs.
2 changes: 1 addition & 1 deletion docs/overrides/landing.html
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
{% endblock %}

{% block announce %}
🔥 Use world's cheapest GPUs with <strong>TensorDock</strong> and <strong>dstack</strong>. <a href="/blog/2023/10/31/tensordock/">Learn more</a>.
🔥 Access the GPU marketplace with <strong>Vast.ai</strong> and <strong>dstack</strong>. <a href="/blog/2023/11/21/vastai/">Learn more</a>.
{% endblock %}

{% block footer %}
Expand Down
2 changes: 1 addition & 1 deletion docs/overrides/main.html
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,5 @@
{% endblock %}

{% block announce %}
🔥 Use world's cheapest GPUs with <strong>TensorDock</strong> and <strong>dstack</strong>. <a href="/blog/2023/10/31/tensordock/">Learn more</a>.
🔥 Access the GPU marketplace with <strong>Vast.ai</strong> and <strong>dstack</strong>. <a href="/blog/2023/11/21/vastai/">Learn more</a>.
{% endblock %}

0 comments on commit 421555c

Please sign in to comment.