fix(vertex_ai): improve passthrough endpoint url parsing and construction (#17402) #17526
+85
−7
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Title
fix(vertex_ai): improve passthrough endpoint url parsing and construction
Relevant issues
Fixes #17402
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/litellm/directory,make test-unitType
🐛 Bug Fix
Changes
litellm/llms/vertex_ai/common_utils.py:
/v1/and/v1beta1/version prefixes from the requested route to prevent double versioning in the target URL.litellm/proxy/pass_through_endpoints/llm_passthrough_endpoints.py:
_base_vertex_proxy_routeto improve project and location resolution. If vertex_project or vertex_location cannot be parsed from the URL, it now attempts to extract the model ID and look up the corresponding deployment in thellm_routerto find the configured vertex_project and vertex_location.tests/test_litellm/llms/vertex_ai/test_vertex_ai_common_utils.py:
construct_target_urlverifying correct handling of/v1/and/v1beta1/prefixes.