Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Title: "Need guidance: M2 Mac deployment & model files location" #128

Open
jonschull opened this issue Feb 21, 2025 · 0 comments
Open

Title: "Need guidance: M2 Mac deployment & model files location" #128

jonschull opened this issue Feb 21, 2025 · 0 comments

Comments

@jonschull
Copy link

Environment

  • MacOS on M2 Apple Silicon
  • UI-TARS Desktop v0.0.6 (arm64)
  • vLLM v0.7.2 installed
  • Command Line Tools installed

Current Status

  1. Successfully installed UI-TARS Desktop and vLLM
  2. Attempted to start vLLM server with:
    python -m vllm.entrypoints.openai.api_server --served-model-name ui-tars --model <path>
    

3.Cannot proceed due to two blockers:
Unable to locate UI-TARS model files for download
Unclear if there are M2-specific deployment steps needed
Questions

1.Where can I download the UI-TARS model files for local deployment?
2.Are there any special considerations for M2 Mac deployment?
3.If local deployment isn't recommended for M2, what's the preferred alternative?
Additional Context

Reviewed Issue #64 about M2 deployment
Looking into Inference Endpoints as alternative

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant