Skip to content

Commit e24e0d8

Browse files
yankaynirrozenbaum
andauthored
rename EPP config to kv-cache-utilization-scorer from kv-cache-scorer (#358)
Signed-off-by: Kay Yan <kay.yan@daocloud.io> Co-authored-by: Nir Rozenbaum <nirro@il.ibm.com>
1 parent 4829137 commit e24e0d8

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

deploy/config/epp-precise-prefix-cache-config.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ plugins:
1313
hashSeed: "42" # must match vLLM PYTHONHASHSEED env var
1414
kvBlockIndexConfig:
1515
enableMetrics: true # enable kv-block index metrics (prometheus)
16-
- type: kv-cache-scorer # kv-cache-utilization
16+
- type: kv-cache-utilization-scorer
1717
- type: queue-scorer
1818
- type: max-score-picker
1919
schedulingProfiles:
@@ -22,7 +22,7 @@ schedulingProfiles:
2222
- pluginRef: decode-filter
2323
- pluginRef: precise-prefix-cache-scorer
2424
weight: 2.0
25-
- pluginRef: kv-cache-scorer
25+
- pluginRef: kv-cache-utilization-scorer
2626
weight: 1.0
2727
- pluginRef: queue-scorer
2828
weight: 1.0

0 commit comments

Comments
 (0)