File tree Expand file tree Collapse file tree 2 files changed +3
-4
lines changed Expand file tree Collapse file tree 2 files changed +3
-4
lines changed Original file line number Diff line number Diff line change @@ -6,6 +6,6 @@ COPY requirements.txt /workspace/
66
77RUN pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple && \
88 pip install bitsandbytes --upgrade && \
9- pip install vllm==0.4.2 && \
9+ pip install vllm==0.4.3 && \
1010 pip install --no-cache-dir -r /workspace/requirements.txt && \
1111 pip uninstall transformer-engine -y
Original file line number Diff line number Diff line change @@ -15,10 +15,9 @@ docker build -f docker/Dockerfile.vllm -t llm-api:vllm .
1515安装依赖,确保安装顺序严格按照下面的命令:
1616
1717``` shell
18- pip install torch==2.1.0
19- pip install vllm==0.4.2
18+ pip install vllm==0.4.3
2019pip install -r requirements.txt
21- pip uninstall transformer-engine -y
20+ # pip uninstall transformer-engine -y
2221```
2322
2423## 启动模型
You can’t perform that action at this time.
0 commit comments