File tree Expand file tree Collapse file tree 1 file changed +83
-1
lines changed Expand file tree Collapse file tree 1 file changed +83
-1
lines changed Original file line number Diff line number Diff line change 5454 <img src =" doc/img/img.png " style =" width :500px ;" />
5555</p >
5656
57+ ### 3. 更多种大模型接入
58+ 1 . 可通过实现项目接口快速接入自定义模型,具体配置方式参见[ config.md] ( doc/config.md ) 。
59+ 2 . 项目通过[ UnionLLM] ( https://github.com/EvalsOne/UnionLLM/ ) 进行多模型支持,
60+ 兼容[ LiteLLM] ( https://docs.litellm.ai/docs ) ,默认支持模型如下表所示。
61+
62+ <table style =" width :100% ; text-align :center ; border-collapse :collapse ;" >
63+ <tr >
64+ <td>OpenAI</td>
65+ <td>Azure</td>
66+ <td>AWS - SageMaker</td>
67+ <td>AWS - Bedrock</td>
68+ </tr >
69+ <tr >
70+ <td>Google - Vertex_AI</td>
71+ <td>Google - Palm</td>
72+ <td>Google AI Studio - Gemini</td>
73+ <td>Mistral AI API</td>
74+ </tr >
75+ <tr >
76+ <td>Cloudflare AI Workers</td>
77+ <td>Cohere</td>
78+ <td>Anthropic</td>
79+ <td>Empower</td>
80+ </tr >
81+ <tr >
82+ <td>Huggingface</td>
83+ <td>Replicate</td>
84+ <td>Together_AI</td>
85+ <td>OpenRouter</td>
86+ </tr >
87+ <tr >
88+ <td>AI21</td>
89+ <td>Baseten</td>
90+ <td>Vllm</td>
91+ <td>NLP_Cloud</td>
92+ </tr >
93+ <tr >
94+ <td>Aleph Alpha</td>
95+ <td>Petals</td>
96+ <td>Ollama</td>
97+ <td>Deepinfra</td>
98+ </tr >
99+ <tr >
100+ <td>Perplexity-AI</td>
101+ <td>Groq AI</td>
102+ <td>DeepSeek</td>
103+ <td>Anyscale</td>
104+ </tr >
105+ <tr >
106+ <td>IBM - Watsonx.ai</td>
107+ <td>Voyage AI</td>
108+ <td>Xinference [Xorbits Inference]</td>
109+ <td>FriendliAI</td>
110+ </tr >
111+ <tr >
112+ <td>Galadriel</td>
113+ <td>智谱AI</td>
114+ <td>月之暗面 Moonshot</td>
115+ <td>百度文心一言</td>
116+ </tr >
117+ <tr >
118+ <td>阿里巴巴通义千问</td>
119+ <td>MiniMax</td>
120+ <td>讯飞星火</td>
121+ <td>百川智能</td>
122+ </tr >
123+ <tr >
124+ <td>昆仑天工</td>
125+ <td>零一万物</td>
126+ <td>阶跃星辰</td>
127+ <td>字节豆包</td>
128+ </tr >
129+ <tr >
130+ <td>深度求索 DeepSeek</td>
131+ <td>More</td>
132+ <td></td>
133+ <td></td>
134+ </tr >
135+ </table >
136+
137+
138+
139+
57140
58141# 部署 📖
59142
@@ -70,7 +153,6 @@ pip install -r requirements.txt
70153``` bash
71154vim config/config.py
72155```
73- 参数配置方式与多模型支持参见[ config.md] ( doc/config.md )
74156
751574.** 运行**
76158``` bash
You can’t perform that action at this time.
0 commit comments