-
Notifications
You must be signed in to change notification settings - Fork 720
fix: [ci] WAR to suppress test_serve_deployment in main #4693
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
WalkthroughThe Changes
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes Poem
Pre-merge checks❌ Failed checks (1 warning)
✅ Passed checks (2 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 1
📜 Review details
Configuration used: Path: .coderabbit.yaml
Review profile: CHILL
Plan: Pro
📒 Files selected for processing (1)
tests/serve/test_vllm.py(1 hunks)
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (7)
- GitHub Check: operator (amd64)
- GitHub Check: sglang (amd64)
- GitHub Check: operator (arm64)
- GitHub Check: vllm (arm64)
- GitHub Check: trtllm (amd64)
- GitHub Check: vllm (amd64)
- GitHub Check: Build and Test - dynamo
| @pytest.mark.vllm | ||
| @pytest.mark.e2e | ||
| @pytest.mark.gpu_1 | ||
| # @pytest.mark.gpu_1 # Disabled for now to unblock CI in main. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🧩 Analysis chain
🏁 Script executed:
# Find params_with_model_mark function definition
rg -n "def params_with_model_mark" -A 15Repository: ai-dynamo/dynamo
Length of output: 793
🏁 Script executed:
# Also search for where params_with_model_mark is imported or used
rg -n "params_with_model_mark" -B 2 -A 2Repository: ai-dynamo/dynamo
Length of output: 2051
🏁 Script executed:
# Check for any issue references or TODOs in the file
rg -n "(TODO|FIXME|issue|#[0-9])" tests/serve/test_vllm.pyRepository: ai-dynamo/dynamo
Length of output: 296
🏁 Script executed:
# Look at the file structure to understand mark application
head -350 tests/serve/test_vllm.py | tail -50Repository: ai-dynamo/dynamo
Length of output: 1833
This workaround is ineffective—config-level gpu_1 marks will still apply.
The params_with_model_mark() function (tests/serve/common.py:70) preserves all config-level marks by copying them into the parameterized test parameters (line 77). Commenting out the function-level @pytest.mark.gpu_1 does not disable GPU requirements for test instances whose configs explicitly include pytest.mark.gpu_1 in their marks array—specifically "aggregated" (line 46), "aggregated_lmcache" (line 58), "agg-request-plane-tcp" (line 71), and "agg-request-plane-http" (line 83).
Additionally, this temporary workaround lacks a tracking issue. The PR description should reference an issue for:
- Re-enabling the marker once CI is fixed
- Addressing the root cause of the GPU requirement conflict
🤖 Prompt for AI Agents
In tests/serve/test_vllm.py around line 340, commenting out the function-level
@pytest.mark.gpu_1 is ineffective because params_with_model_mark in
tests/serve/common.py preserves config-level marks (so configs like
"aggregated", "aggregated_lmcache", "agg-request-plane-tcp", and
"agg-request-plane-http" still force GPU). Fix by either removing or
conditionally filtering out pytest.mark.gpu_1 from the per-config marks in
params_with_model_mark (so a test-level disable actually takes effect), or add a
top-level check in test_vllm.py to skip parameterized cases whose combined marks
include gpu_1; also add a tracking issue reference in the PR description for (1)
re-enabling the marker when CI is fixed and (2) investigating/fixing the root
cause of the GPU requirement conflict.
Overview:
Details:
Where should the reviewer start?
Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)
Summary by CodeRabbit
Note: This release contains no user-facing changes. The modification is internal testing infrastructure only.
✏️ Tip: You can customize this high-level summary in your review settings.