Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding an example of NIM #1853

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

deep-diver
Copy link
Contributor

Adding an example of NIM

@Bihan
Copy link
Collaborator

Bihan commented Oct 20, 2024

Hey @deep-diver,

  1. I’ve created a sample README.md that follows dstack's structure. Please note that it assumes the reader is already familiar with NIM. Feel free to update it accordingly.
  2. I tested the sample configuration with a 24GB GPU, and it worked. Kindly update the GPU requirement to 24GB.
  3. Could you also provide the source-code for the development environment (.dstack.yml), task (task.dstack.yml), and service (service.dstack.yml)

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants