[Feature] Support InterVL

[zhaochenyang20]

Checklist

• 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 2. Please use English, otherwise it will be closed.

Motivation

https://huggingface.co/internlm/internlm-xcomposer2-vl-7b

As demonstrated by @YerongLi , this model is a good starter, and it's well-performed. Also, take this in mind:

We need a new documents for “adding a new VLM in SGLang” (we have adding a new LLM in SGLang already);

Read this docs, and write one while you are developing:

https://zhuanlan.zhihu.com/p/715805386

And later submit one to guide others on supporting new VLM in SGLang.

@mickqian and @yizhang2077 will help you while developing and reviewing your codes.

You can check mick's latest PR for help.

Related resources

No response

[yinfan98]

HI~ I would like to take it over.

[zhaochenyang20]

@yinfan98 Thanks! Fan