Skip to content

Commit 1f1cbab

Browse files
carloryrootfs
andauthored
Fix docker build for the mock-vllm component and wrong vsr_base_url in vLLM Semantic Router Pipe (#462)
Signed-off-by: carlory <baofa.fan@daocloud.io> Co-authored-by: Huamin Chen <rootfs@users.noreply.github.com>
1 parent 49ab206 commit 1f1cbab

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

deploy/docker-compose/addons/vllm_semantic_router_pipe.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@
1818
class Pipeline:
1919
class Valves(BaseModel):
2020
# vLLM Semantic Router endpoint URL
21-
vsr_base_url: str = "http://envoy-proxy:8801/v1"
21+
vsr_base_url: str = "http://envoy-proxy:8801"
2222

2323
# API key for authentication (if required)
2424
api_key: str = ""
@@ -45,7 +45,7 @@ def __init__(self):
4545
# Initialize valves
4646
self.valves = self.Valves(
4747
**{
48-
"vsr_base_url": "http://envoy-proxy:8801/v1",
48+
"vsr_base_url": "http://envoy-proxy:8801",
4949
"api_key": "",
5050
"show_vsr_info": True,
5151
"log_vsr_info": True,

tools/mock-vllm/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,10 +6,10 @@ RUN apt-get update && apt-get install -y --no-install-recommends \
66
curl \
77
&& rm -rf /var/lib/apt/lists/*
88

9-
COPY src/training/requirements.txt ./
9+
COPY requirements.txt ./
1010
RUN pip install --no-cache-dir -r requirements.txt
1111

12-
COPY app.py ./
12+
COPY app.py ./
1313

1414
EXPOSE 8000
1515

0 commit comments

Comments
 (0)