Commit 45240d8
authored
refactor(config): remove models field from vLLM endpoints (#413)
* refactor(config): remove models field from vLLM endpoints
Remove the redundant models field from VLLMEndpoint configuration.
Model-to-endpoint mapping is now solely determined by the
preferred_endpoints field in model_config, eliminating the need
for bidirectional association.
Changes:
- Remove Models field from VLLMEndpoint struct
- Update GetEndpointsForModel to use only preferred_endpoints
- Update GetAllModels to retrieve models from model_config keys
- Update all configuration files to remove models field
- Update all tests to reflect the new configuration structure
- Update TypeScript interface in dashboard frontend
This simplifies the configuration and removes potential
inconsistencies between models and preferred_endpoints.
Signed-off-by: bitliu <bitliu@tencent.com>
* more
Signed-off-by: bitliu <bitliu@tencent.com>
* more
Signed-off-by: bitliu <bitliu@tencent.com>
---------
Signed-off-by: bitliu <bitliu@tencent.com>1 parent c35e98a commit 45240d8
File tree
26 files changed
+105
-148
lines changed- config
- examples
- dashboard/frontend/src/pages
- deploy
- kubernetes
- istio
- openshift
- src/semantic-router/pkg
- api
- config
- extproc
- website/docs
- installation
- training
- tutorials
- content-safety
- intelligent-route
26 files changed
+105
-148
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
75 | 75 | | |
76 | 76 | | |
77 | 77 | | |
78 | | - | |
79 | | - | |
80 | 78 | | |
81 | 79 | | |
82 | 80 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
33 | | - | |
34 | 32 | | |
35 | 33 | | |
36 | 34 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
45 | | - | |
46 | | - | |
47 | 45 | | |
48 | 46 | | |
49 | 47 | | |
50 | 48 | | |
51 | 49 | | |
52 | | - | |
53 | | - | |
54 | 50 | | |
55 | 51 | | |
56 | 52 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
34 | 34 | | |
35 | 35 | | |
36 | 36 | | |
37 | | - | |
38 | | - | |
39 | 37 | | |
40 | 38 | | |
41 | 39 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
44 | 44 | | |
45 | 45 | | |
46 | 46 | | |
47 | | - | |
48 | | - | |
49 | 47 | | |
50 | 48 | | |
51 | 49 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
39 | 39 | | |
40 | 40 | | |
41 | 41 | | |
42 | | - | |
43 | | - | |
44 | 42 | | |
45 | 43 | | |
46 | 44 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
44 | 44 | | |
45 | 45 | | |
46 | 46 | | |
47 | | - | |
48 | | - | |
49 | 47 | | |
50 | 48 | | |
51 | 49 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
33 | | - | |
34 | | - | |
35 | 33 | | |
36 | 34 | | |
37 | 35 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
34 | 34 | | |
35 | 35 | | |
36 | 36 | | |
37 | | - | |
38 | | - | |
39 | 37 | | |
40 | 38 | | |
41 | 39 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
100 | 100 | | |
101 | 101 | | |
102 | 102 | | |
103 | | - | |
104 | | - | |
105 | | - | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
106 | 106 | | |
107 | 107 | | |
108 | 108 | | |
| |||
0 commit comments