-
Notifications
You must be signed in to change notification settings - Fork 498
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
DOC: update new models in README and doc (#2761)
- Loading branch information
Showing
7 changed files
with
106 additions
and
10 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,31 @@ | ||
| .. _models_llm_cogagent: | ||
|
|
||
| ======================================== | ||
| cogagent | ||
| ======================================== | ||
|
|
||
| - **Context Length:** 4096 | ||
| - **Model Name:** cogagent | ||
| - **Languages:** en, zh | ||
| - **Abilities:** chat, vision | ||
| - **Description:** The CogAgent-9B-20241220 model is based on GLM-4V-9B, a bilingual open-source VLM base model. Through data collection and optimization, multi-stage training, and strategy improvements, CogAgent-9B-20241220 achieves significant advancements in GUI perception, inference prediction accuracy, action space completeness, and task generalizability. | ||
|
|
||
| Specifications | ||
| ^^^^^^^^^^^^^^ | ||
|
|
||
|
|
||
| Model Spec 1 (pytorch, 9 Billion) | ||
| ++++++++++++++++++++++++++++++++++++++++ | ||
|
|
||
| - **Model Format:** pytorch | ||
| - **Model Size (in billions):** 9 | ||
| - **Quantizations:** 4-bit, 8-bit, none | ||
| - **Engines**: Transformers | ||
| - **Model ID:** THUDM/cogagent-9b-20241220 | ||
| - **Model Hubs**: `Hugging Face <https://huggingface.co/THUDM/cogagent-9b-20241220>`__, `ModelScope <https://modelscope.cn/models/ZhipuAI/cogagent-9b-20241220>`__ | ||
|
|
||
| Execute the following command to launch the model, remember to replace ``${quantization}`` with your | ||
| chosen quantization method from the options listed above:: | ||
|
|
||
| xinference launch --model-engine ${engine} --model-name cogagent --size-in-billions 9 --model-format pytorch --quantization ${quantization} | ||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,47 @@ | ||
| .. _models_llm_marco-o1: | ||
|
|
||
| ======================================== | ||
| marco-o1 | ||
| ======================================== | ||
|
|
||
| - **Context Length:** 32768 | ||
| - **Model Name:** marco-o1 | ||
| - **Languages:** en, zh | ||
| - **Abilities:** chat, tools | ||
| - **Description:** Marco-o1: Towards Open Reasoning Models for Open-Ended Solutions | ||
|
|
||
| Specifications | ||
| ^^^^^^^^^^^^^^ | ||
|
|
||
|
|
||
| Model Spec 1 (pytorch, 7 Billion) | ||
| ++++++++++++++++++++++++++++++++++++++++ | ||
|
|
||
| - **Model Format:** pytorch | ||
| - **Model Size (in billions):** 7 | ||
| - **Quantizations:** 4-bit, 8-bit, none | ||
| - **Engines**: vLLM, Transformers (vLLM only available for quantization none) | ||
| - **Model ID:** AIDC-AI/Marco-o1 | ||
| - **Model Hubs**: `Hugging Face <https://huggingface.co/AIDC-AI/Marco-o1>`__, `ModelScope <https://modelscope.cn/models/AIDC-AI/Marco-o1>`__ | ||
|
|
||
| Execute the following command to launch the model, remember to replace ``${quantization}`` with your | ||
| chosen quantization method from the options listed above:: | ||
|
|
||
| xinference launch --model-engine ${engine} --model-name marco-o1 --size-in-billions 7 --model-format pytorch --quantization ${quantization} | ||
|
|
||
|
|
||
| Model Spec 2 (ggufv2, 7 Billion) | ||
| ++++++++++++++++++++++++++++++++++++++++ | ||
|
|
||
| - **Model Format:** ggufv2 | ||
| - **Model Size (in billions):** 7 | ||
| - **Quantizations:** Q2_K, Q3_K_L, Q3_K_M, Q3_K_S, Q4_0, Q4_1, Q4_K_M, Q4_K_S, Q5_0, Q5_1, Q5_K_M, Q5_K_S, Q6_K, Q8_0 | ||
| - **Engines**: llama.cpp | ||
| - **Model ID:** QuantFactory/Marco-o1-GGUF | ||
| - **Model Hubs**: `Hugging Face <https://huggingface.co/QuantFactory/Marco-o1-GGUF>`__, `ModelScope <https://modelscope.cn/models/QuantFactory/Marco-o1-GGUF>`__ | ||
|
|
||
| Execute the following command to launch the model, remember to replace ``${quantization}`` with your | ||
| chosen quantization method from the options listed above:: | ||
|
|
||
| xinference launch --model-engine ${engine} --model-name marco-o1 --size-in-billions 7 --model-format ggufv2 --quantization ${quantization} | ||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters