Generates text but does nothing

[NarutoHokageSaskeUchihaSuperItachiMan]

I tried vllm but it just doesn't work for me, giving an error message with no solution on the internet. That's why I use LM Studio. It creates the correct prompt but in UI-TARS-desktop it shows that you click on the lower left edge of the screen and nothing happens. I installed Midscene and it also generates the correct prompt but does nothing.

[AHEADer]

You can paste your vLLM error here, and we can check why it failed. Besides, UI-TARS-desktop may use another prompt for the coordinate, you can submit an issue in https://github.com/bytedance/UI-TARS-desktop

[NarutoHokageSaskeUchihaSuperItachiMan]

You can paste your vLLM error here, and we can check why it failed. Besides, UI-TARS-desktop may use another prompt for the coordinate, you can submit an issue in https://github.com/bytedance/UI-TARS-desktop

I spent 5 hours trying to solve all this, I have already removed it from both the system and conda and I have no desire to dive into this vllm again. If it is not possible to run this with LM Studio, I will wait for the implementation of ollama, thanks for the help.

[AHEADer]

Cloud Deployment definitely works. If you want to use Ollama, please check this issue: #14 . We find Ollama + gguf does not have expected precision compared with the cloud deployment method.

[innokria]

is your lib free to use I am thinking to explore https://huggingface.co/bytedance-research/UI-TARS-2B-SFT and play around

[AHEADer]

is your lib free to use I am thinking to explore https://huggingface.co/bytedance-research/UI-TARS-2B-SFT and play around

We follow apache 2.0 license.

[cwplugovrai]

I had the same issue with DPO looks like the output of the llm is not in the correct format. using SFT version solved the problem for me.

[NarutoHokageSaskeUchihaSuperItachiMan]

I had the same issue with DPO looks like the output of the llm is not in the correct format. using SFT version solved the problem for me.

I tried SFT 2b and 7b, both don't work. Apparently this is a problem in LM studio, since I am not the first one who encountered this.