Skip to content

Commit c365f62

Browse files
committed
Only run parse_payload middleware for prediction requests
1 parent eb986a0 commit c365f62

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

pkg/workloads/cortex/serve/serve.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -157,6 +157,9 @@ async def register_request(request: Request, call_next):
157157

158158
@app.middleware("http")
159159
async def parse_payload(request: Request, call_next):
160+
if not is_prediction_request(request):
161+
return await call_next(request)
162+
160163
if "payload" not in local_cache["predict_fn_args"]:
161164
return await call_next(request)
162165

0 commit comments

Comments
 (0)