WARNING 02-09 10:24:45 cpu.py:99] ray is not supported on CPU, fallback to mp distributed executor backend. #12982
Unanswered
jdmedeiros
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am trying to run vLLM across 9 r5.large (2 vCPU x 16 GB) instances on AWS. I compiled vLLM from source as indicated here https://docs.vllm.ai/en/stable/getting_started/installation/cpu/index.html and I am wondering if this (ray is not supported on CPU) is configurable or if it's by design.
Beta Was this translation helpful? Give feedback.
All reactions