Skip to content

Commit a967c76

Browse files
committed
doc(Readme.md): Added multi-model compatibility
1 parent f1ba6f5 commit a967c76

File tree

1 file changed

+83
-1
lines changed

1 file changed

+83
-1
lines changed

README.md

Lines changed: 83 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -54,6 +54,89 @@
5454
<img src="doc/img/img.png" style="width:500px;"/>
5555
</p>
5656

57+
### 3. 更多种大模型接入
58+
1. 可通过实现项目接口快速接入自定义模型,具体配置方式参见[config.md](doc/config.md)
59+
2. 项目通过[UnionLLM](https://github.com/EvalsOne/UnionLLM/)进行多模型支持,
60+
兼容[LiteLLM](https://docs.litellm.ai/docs),默认支持模型如下表所示。
61+
62+
<table style="width:100%; text-align:center; border-collapse:collapse;">
63+
<tr>
64+
<td>OpenAI</td>
65+
<td>Azure</td>
66+
<td>AWS - SageMaker</td>
67+
<td>AWS - Bedrock</td>
68+
</tr>
69+
<tr>
70+
<td>Google - Vertex_AI</td>
71+
<td>Google - Palm</td>
72+
<td>Google AI Studio - Gemini</td>
73+
<td>Mistral AI API</td>
74+
</tr>
75+
<tr>
76+
<td>Cloudflare AI Workers</td>
77+
<td>Cohere</td>
78+
<td>Anthropic</td>
79+
<td>Empower</td>
80+
</tr>
81+
<tr>
82+
<td>Huggingface</td>
83+
<td>Replicate</td>
84+
<td>Together_AI</td>
85+
<td>OpenRouter</td>
86+
</tr>
87+
<tr>
88+
<td>AI21</td>
89+
<td>Baseten</td>
90+
<td>Vllm</td>
91+
<td>NLP_Cloud</td>
92+
</tr>
93+
<tr>
94+
<td>Aleph Alpha</td>
95+
<td>Petals</td>
96+
<td>Ollama</td>
97+
<td>Deepinfra</td>
98+
</tr>
99+
<tr>
100+
<td>Perplexity-AI</td>
101+
<td>Groq AI</td>
102+
<td>DeepSeek</td>
103+
<td>Anyscale</td>
104+
</tr>
105+
<tr>
106+
<td>IBM - Watsonx.ai</td>
107+
<td>Voyage AI</td>
108+
<td>Xinference [Xorbits Inference]</td>
109+
<td>FriendliAI</td>
110+
</tr>
111+
<tr>
112+
<td>Galadriel</td>
113+
<td>智谱AI</td>
114+
<td>月之暗面 Moonshot</td>
115+
<td>百度文心一言</td>
116+
</tr>
117+
<tr>
118+
<td>阿里巴巴通义千问</td>
119+
<td>MiniMax</td>
120+
<td>讯飞星火</td>
121+
<td>百川智能</td>
122+
</tr>
123+
<tr>
124+
<td>昆仑天工</td>
125+
<td>零一万物</td>
126+
<td>阶跃星辰</td>
127+
<td>字节豆包</td>
128+
</tr>
129+
<tr>
130+
<td>深度求索 DeepSeek</td>
131+
<td>More</td>
132+
<td></td>
133+
<td></td>
134+
</tr>
135+
</table>
136+
137+
138+
139+
57140

58141
# 部署 📖
59142

@@ -70,7 +153,6 @@ pip install -r requirements.txt
70153
```bash
71154
vim config/config.py
72155
```
73-
参数配置方式与多模型支持参见[config.md](doc/config.md)
74156

75157
4.**运行**
76158
```bash

0 commit comments

Comments
 (0)