-
Notifications
You must be signed in to change notification settings - Fork 468
chore(serverless): test to ensure that all imports in datadog-lambda-python still valid #14746
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
073eb93 to
ae94597
Compare
|
|
ae94597 to
e4e0449
Compare
e4e0449 to
1047aac
Compare
Bootstrap import analysisComparison of import times between this PR and base. SummaryThe average import time from this PR is: 249 ± 7 ms. The average import time from base is: 249 ± 6 ms. The import time difference between this PR and base is: -0.4 ± 0.3 ms. The difference is not statistically significant (z = -1.43). Import time breakdownThe following import paths have shrunk:
|
Performance SLOsComparing candidate rey.abolofia/serverless-imports (73c0961) with baseline main (620dc72) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.4% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.8% ✅ add_inplace_aspectTime: ✅ 0.412µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +1.3% Memory: ✅ 37.945MB (SLO: <39.000MB -2.7%) vs baseline: +4.6% ✅ add_inplace_noaspectTime: ✅ 0.318µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +0.2% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.8% ✅ add_noaspectTime: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.7% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.5% ✅ bytearray_aspectTime: ✅ 1.332µs (SLO: <10.000µs 📉 -86.7%) vs baseline: -0.1% Memory: ✅ 37.945MB (SLO: <39.000MB -2.7%) vs baseline: +5.7% ✅ bytearray_extend_aspectTime: ✅ 1.510µs (SLO: <10.000µs 📉 -84.9%) vs baseline: -0.4% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.7% ✅ bytearray_extend_noaspectTime: ✅ 0.610µs (SLO: <10.000µs 📉 -93.9%) vs baseline: -0.3% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9% ✅ bytearray_noaspectTime: ✅ 0.483µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -0.2% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.7% ✅ bytes_aspectTime: ✅ 1.401µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +7.2% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.9% ✅ bytes_noaspectTime: ✅ 0.495µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.2% Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +3.6% ✅ bytesio_aspectTime: ✅ 1.377µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.7% Memory: ✅ 37.886MB (SLO: <39.000MB -2.9%) vs baseline: +5.4% ✅ bytesio_noaspectTime: ✅ 0.498µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.6% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.7% ✅ capitalize_aspectTime: ✅ 0.744µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.1% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.6% ✅ capitalize_noaspectTime: ✅ 0.439µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +1.3% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.7% ✅ casefold_aspectTime: ✅ 0.737µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.2% Memory: ✅ 37.945MB (SLO: <39.000MB -2.7%) vs baseline: +5.7% ✅ casefold_noaspectTime: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.0% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.8% ✅ decode_aspectTime: ✅ 0.731µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.9% Memory: ✅ 37.965MB (SLO: <39.000MB -2.7%) vs baseline: +4.7% ✅ decode_noaspectTime: ✅ 0.419µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.7% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.7% ✅ encode_aspectTime: ✅ 0.703µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.8% Memory: ✅ 37.945MB (SLO: <39.000MB -2.7%) vs baseline: +4.4% ✅ encode_noaspectTime: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +1.6% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.9% ✅ format_aspectTime: ✅ 3.389µs (SLO: <10.000µs 📉 -66.1%) vs baseline: ~same Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.7% ✅ format_map_aspectTime: ✅ 3.640µs (SLO: <10.000µs 📉 -63.6%) vs baseline: +0.6% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ format_map_noaspectTime: ✅ 0.790µs (SLO: <10.000µs 📉 -92.1%) vs baseline: +1.9% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.0% ✅ format_noaspectTime: ✅ 0.595µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.5% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.8% ✅ index_aspectTime: ✅ 0.362µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +2.2% Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +3.9% ✅ index_noaspectTime: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -1.0% Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +3.6% ✅ join_aspectTime: ✅ 1.365µs (SLO: <10.000µs 📉 -86.4%) vs baseline: ~same Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +3.8% ✅ join_noaspectTime: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.3% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9% ✅ ljust_aspectTime: ✅ 2.559µs (SLO: <20.000µs 📉 -87.2%) vs baseline: ~same Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.8% ✅ ljust_noaspectTime: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.9% ✅ lower_aspectTime: ✅ 2.359µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +6.9% Memory: ✅ 37.906MB (SLO: <39.000MB -2.8%) vs baseline: +4.3% ✅ lower_noaspectTime: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -2.3% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.1% ✅ lstrip_aspectTime: ✅ 2.525µs (SLO: <20.000µs 📉 -87.4%) vs baseline: 📈 +13.3% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.7% ✅ lstrip_noaspectTime: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.9% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.7% ✅ modulo_aspectTime: ✅ 0.988µs (SLO: <10.000µs 📉 -90.1%) vs baseline: -0.3% Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +5.1% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 1.532µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.7% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.6% ✅ modulo_aspect_for_bytesTime: ✅ 0.970µs (SLO: <10.000µs 📉 -90.3%) vs baseline: ~same Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.8% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 1.237µs (SLO: <10.000µs 📉 -87.6%) vs baseline: -0.6% Memory: ✅ 37.945MB (SLO: <39.000MB -2.7%) vs baseline: +5.5% ✅ modulo_noaspectTime: ✅ 0.625µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.8% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.8% ✅ replace_aspectTime: ✅ 5.377µs (SLO: <10.000µs 📉 -46.2%) vs baseline: 📈 +11.4% Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +3.5% ✅ replace_noaspectTime: ✅ 0.458µs (SLO: <10.000µs 📉 -95.4%) vs baseline: ~same Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.7% ✅ repr_aspectTime: ✅ 0.903µs (SLO: <10.000µs 📉 -91.0%) vs baseline: -1.2% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.9% ✅ repr_noaspectTime: ✅ 0.418µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.8% Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.1% ✅ rstrip_aspectTime: ✅ 2.035µs (SLO: <20.000µs 📉 -89.8%) vs baseline: +5.6% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.8% ✅ rstrip_noaspectTime: ✅ 0.378µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +1.1% Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +3.6% ✅ slice_aspectTime: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.1% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.9% ✅ slice_noaspectTime: ✅ 0.449µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.3% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.7% ✅ stringio_aspectTime: ✅ 1.576µs (SLO: <10.000µs 📉 -84.2%) vs baseline: +0.3% Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +3.5% ✅ stringio_noaspectTime: ✅ 0.724µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +0.7% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.8% ✅ strip_aspectTime: ✅ 2.507µs (SLO: <20.000µs 📉 -87.5%) vs baseline: 📈 +14.4% Memory: ✅ 37.886MB (SLO: <39.000MB -2.9%) vs baseline: +4.4% ✅ strip_noaspectTime: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.4% Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +3.5% ✅ swapcase_aspectTime: ✅ 2.404µs (SLO: <10.000µs 📉 -76.0%) vs baseline: -0.2% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.6% ✅ swapcase_noaspectTime: ✅ 0.541µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.6% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +3.9% ✅ title_aspectTime: ✅ 2.347µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.4% Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.8% ✅ title_noaspectTime: ✅ 0.504µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +1.0% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +3.9% ✅ translate_aspectTime: ✅ 3.218µs (SLO: <10.000µs 📉 -67.8%) vs baseline: -2.1% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.7% ✅ translate_noaspectTime: ✅ 1.055µs (SLO: <10.000µs 📉 -89.4%) vs baseline: +1.5% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.8% ✅ upper_aspectTime: ✅ 2.363µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +6.9% Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9% ✅ upper_noaspectTime: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.2% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.8% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 4.155µs (SLO: <10.000µs 📉 -58.4%) vs baseline: +1.2% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ ospathbasename_noaspectTime: ✅ 1.080µs (SLO: <10.000µs 📉 -89.2%) vs baseline: +0.3% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ ospathjoin_aspectTime: ✅ 6.102µs (SLO: <10.000µs 📉 -39.0%) vs baseline: ~same Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7% ✅ ospathjoin_noaspectTime: ✅ 2.299µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +0.6% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ ospathnormcase_aspectTime: ✅ 3.464µs (SLO: <10.000µs 📉 -65.4%) vs baseline: -0.3% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ ospathnormcase_noaspectTime: ✅ 0.566µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.5% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ ospathsplit_aspectTime: ✅ 4.754µs (SLO: <10.000µs 📉 -52.5%) vs baseline: +0.2% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ ospathsplit_noaspectTime: ✅ 1.593µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.3% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0% ✅ ospathsplitdrive_aspectTime: ✅ 4.085µs (SLO: <10.000µs 📉 -59.2%) vs baseline: 📈 +12.4% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0% ✅ ospathsplitdrive_noaspectTime: ✅ 0.693µs (SLO: <10.000µs 📉 -93.1%) vs baseline: -0.8% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ ospathsplitext_aspectTime: ✅ 4.509µs (SLO: <10.000µs 📉 -54.9%) vs baseline: +0.4% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1% ✅ ospathsplitext_noaspectTime: ✅ 1.382µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -0.6% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.265µs (SLO: <20.000µs 📉 -83.7%) vs baseline: +4.8% Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.7% ✅ 1-count-metrics-100-timesTime: ✅ 216.283µs (SLO: <250.000µs 📉 -13.5%) vs baseline: +2.0% Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.8% ✅ 1-distribution-metric-1-timesTime: ✅ 3.318µs (SLO: <20.000µs 📉 -83.4%) vs baseline: 📈 +14.3% Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.7% ✅ 1-distribution-metrics-100-timesTime: ✅ 190.108µs (SLO: <220.000µs 📉 -13.6%) vs baseline: ~same Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0% ✅ 1-gauge-metric-1-timesTime: ✅ 2.130µs (SLO: <20.000µs 📉 -89.4%) vs baseline: +2.9% Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.8% ✅ 1-gauge-metrics-100-timesTime: ✅ 125.357µs (SLO: <150.000µs 📉 -16.4%) vs baseline: +0.2% Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0% ✅ 1-rate-metric-1-timesTime: ✅ 3.108µs (SLO: <20.000µs 📉 -84.5%) vs baseline: -0.3% Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9% ✅ 1-rate-metrics-100-timesTime: ✅ 214.423µs (SLO: <250.000µs 📉 -14.2%) vs baseline: +1.4% Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.8% ✅ 100-count-metrics-100-timesTime: ✅ 21.477ms (SLO: <23.500ms -8.6%) vs baseline: +0.7% Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.5% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.018ms (SLO: <2.250ms 📉 -10.3%) vs baseline: +2.1% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.298ms (SLO: <1.550ms 📉 -16.3%) vs baseline: +0.2% Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.0% ✅ 100-rate-metrics-100-timesTime: ✅ 2.216ms (SLO: <2.550ms 📉 -13.1%) vs baseline: +1.7% Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.7% ✅ flush-1-metricTime: ✅ 4.424µs (SLO: <20.000µs 📉 -77.9%) vs baseline: +6.5% Memory: ✅ 32.027MB (SLO: <34.000MB -5.8%) vs baseline: +4.4% ✅ flush-100-metricsTime: ✅ 181.879µs (SLO: <250.000µs 📉 -27.2%) vs baseline: -0.3% Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.0% ✅ flush-1000-metricsTime: ✅ 2.203ms (SLO: <2.500ms 📉 -11.9%) vs baseline: +0.4% Memory: ✅ 32.814MB (SLO: <34.500MB -4.9%) vs baseline: +4.5% 🟡 Near SLO Breach (4 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 20.510ms (SLO: <22.300ms -8.0%) vs baseline: +0.3% Memory: ✅ 65.516MB (SLO: <67.000MB -2.2%) vs baseline: +5.1% ✅ exception-replay-enabledTime: ✅ 1.346ms (SLO: <1.450ms -7.2%) vs baseline: +0.2% Memory: ✅ 64.504MB (SLO: <67.000MB -3.7%) vs baseline: +4.8% ✅ iastTime: ✅ 20.491ms (SLO: <22.250ms -7.9%) vs baseline: +0.1% Memory: ✅ 65.390MB (SLO: <67.000MB -2.4%) vs baseline: +4.8% ✅ profilerTime: ✅ 15.275ms (SLO: <16.550ms -7.7%) vs baseline: +0.2% Memory: ✅ 53.710MB (SLO: <54.500MB 🟡 -1.4%) vs baseline: +4.7% ✅ resource-renamingTime: ✅ 20.532ms (SLO: <21.750ms -5.6%) vs baseline: -0.4% Memory: ✅ 65.518MB (SLO: <67.000MB -2.2%) vs baseline: +5.0% ✅ span-code-originTime: ✅ 26.174ms (SLO: <28.200ms -7.2%) vs baseline: ~same Memory: ✅ 67.650MB (SLO: <69.500MB -2.7%) vs baseline: +4.6% ✅ tracerTime: ✅ 20.454ms (SLO: <21.750ms -6.0%) vs baseline: -0.4% Memory: ✅ 65.554MB (SLO: <67.000MB -2.2%) vs baseline: +5.0% ✅ tracer-and-profilerTime: ✅ 21.975ms (SLO: <23.500ms -6.5%) vs baseline: -0.4% Memory: ✅ 66.579MB (SLO: <67.500MB 🟡 -1.4%) vs baseline: +4.8% ✅ tracer-dont-create-db-spansTime: ✅ 19.297ms (SLO: <21.500ms 📉 -10.2%) vs baseline: ~same Memory: ✅ 65.534MB (SLO: <66.000MB 🟡 -0.7%) vs baseline: +5.1% ✅ tracer-minimalTime: ✅ 16.622ms (SLO: <17.500ms -5.0%) vs baseline: -0.2% Memory: ✅ 65.471MB (SLO: <66.000MB 🟡 -0.8%) vs baseline: +4.9% ✅ tracer-nativeTime: ✅ 20.478ms (SLO: <21.750ms -5.8%) vs baseline: ~same Memory: ✅ 71.375MB (SLO: <72.500MB 🟡 -1.6%) vs baseline: +4.9% ✅ tracer-no-cachesTime: ✅ 18.456ms (SLO: <19.650ms -6.1%) vs baseline: +0.6% Memory: ✅ 65.497MB (SLO: <67.000MB -2.2%) vs baseline: +4.8% ✅ tracer-no-databasesTime: ✅ 18.773ms (SLO: <20.100ms -6.6%) vs baseline: ~same Memory: ✅ 65.255MB (SLO: <67.000MB -2.6%) vs baseline: +4.6% ✅ tracer-no-middlewareTime: ✅ 20.183ms (SLO: <21.500ms -6.1%) vs baseline: +0.2% Memory: ✅ 65.436MB (SLO: <67.000MB -2.3%) vs baseline: +5.0% ✅ tracer-no-templatesTime: ✅ 20.368ms (SLO: <22.000ms -7.4%) vs baseline: +0.1% Memory: ✅ 65.410MB (SLO: <67.000MB -2.4%) vs baseline: +4.8% 🟡 errortrackingdjangosimple - 6/6✅ errortracking-enabled-allTime: ✅ 18.049ms (SLO: <19.850ms -9.1%) vs baseline: -0.2% Memory: ✅ 65.294MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.8% ✅ errortracking-enabled-userTime: ✅ 18.067ms (SLO: <19.400ms -6.9%) vs baseline: -0.2% Memory: ✅ 65.333MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ tracer-enabledTime: ✅ 18.122ms (SLO: <19.450ms -6.8%) vs baseline: -0.4% Memory: ✅ 65.333MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9% 🟡 flasksimple - 18/18✅ appsec-getTime: ✅ 4.580ms (SLO: <4.750ms -3.6%) vs baseline: ~same Memory: ✅ 61.912MB (SLO: <65.000MB -4.8%) vs baseline: +4.9% ✅ appsec-postTime: ✅ 6.578ms (SLO: <6.750ms -2.5%) vs baseline: +0.1% Memory: ✅ 62.010MB (SLO: <65.000MB -4.6%) vs baseline: +5.0% ✅ appsec-telemetryTime: ✅ 4.578ms (SLO: <4.750ms -3.6%) vs baseline: -0.6% Memory: ✅ 61.892MB (SLO: <65.000MB -4.8%) vs baseline: +4.8% ✅ debuggerTime: ✅ 1.855ms (SLO: <2.000ms -7.2%) vs baseline: ~same Memory: ✅ 45.436MB (SLO: <47.000MB -3.3%) vs baseline: +4.9% ✅ iast-getTime: ✅ 1.870ms (SLO: <2.000ms -6.5%) vs baseline: +0.1% Memory: ✅ 42.251MB (SLO: <49.000MB 📉 -13.8%) vs baseline: +4.7% ✅ profilerTime: ✅ 1.912ms (SLO: <2.100ms -9.0%) vs baseline: +0.1% Memory: ✅ 46.458MB (SLO: <47.000MB 🟡 -1.2%) vs baseline: +4.8% ✅ resource-renamingTime: ✅ 3.382ms (SLO: <3.650ms -7.3%) vs baseline: ~same Memory: ✅ 52.219MB (SLO: <53.500MB -2.4%) vs baseline: +4.8% ✅ tracerTime: ✅ 3.366ms (SLO: <3.650ms -7.8%) vs baseline: -0.2% Memory: ✅ 52.239MB (SLO: <53.500MB -2.4%) vs baseline: +5.0% ✅ tracer-nativeTime: ✅ 3.367ms (SLO: <3.650ms -7.7%) vs baseline: ~same Memory: ✅ 58.253MB (SLO: <60.000MB -2.9%) vs baseline: +4.8% 🟡 otelspan - 22/22✅ add-eventTime: ✅ 45.307ms (SLO: <47.150ms -3.9%) vs baseline: +0.5% Memory: ✅ 45.287MB (SLO: <47.000MB -3.6%) vs baseline: +4.8% ✅ add-metricsTime: ✅ 323.247ms (SLO: <344.800ms -6.3%) vs baseline: +1.2% Memory: ✅ 553.791MB (SLO: <562.000MB 🟡 -1.5%) vs baseline: +5.1% ✅ add-tagsTime: ✅ 289.837ms (SLO: <314.000ms -7.7%) vs baseline: -1.6% Memory: ✅ 555.508MB (SLO: <563.500MB 🟡 -1.4%) vs baseline: +5.1% ✅ get-contextTime: ✅ 84.290ms (SLO: <92.350ms -8.7%) vs baseline: +1.1% Memory: ✅ 40.319MB (SLO: <46.500MB 📉 -13.3%) vs baseline: +4.8% ✅ is-recordingTime: ✅ 43.115ms (SLO: <44.500ms -3.1%) vs baseline: +0.7% Memory: ✅ 44.581MB (SLO: <47.500MB -6.1%) vs baseline: +4.7% ✅ record-exceptionTime: ✅ 61.718ms (SLO: <67.650ms -8.8%) vs baseline: -0.3% Memory: ✅ 40.524MB (SLO: <47.000MB 📉 -13.8%) vs baseline: +4.5% ✅ set-statusTime: ✅ 48.879ms (SLO: <50.400ms -3.0%) vs baseline: ~same Memory: ✅ 44.648MB (SLO: <47.000MB -5.0%) vs baseline: +5.0% ✅ startTime: ✅ 42.238ms (SLO: <43.450ms -2.8%) vs baseline: ~same Memory: ✅ 44.615MB (SLO: <47.000MB -5.1%) vs baseline: +5.0% ✅ start-finishTime: ✅ 84.741ms (SLO: <88.000ms -3.7%) vs baseline: ~same Memory: ✅ 34.623MB (SLO: <46.500MB 📉 -25.5%) vs baseline: +5.0% ✅ start-finish-telemetryTime: ✅ 88.264ms (SLO: <89.000ms 🟡 -0.8%) vs baseline: +2.3% Memory: ✅ 34.564MB (SLO: <46.500MB 📉 -25.7%) vs baseline: +4.7% ✅ update-nameTime: ✅ 44.021ms (SLO: <45.150ms -2.5%) vs baseline: -0.6% Memory: ✅ 45.035MB (SLO: <47.000MB -4.2%) vs baseline: +5.0%
|
30cfb98 to
769d5b1
Compare
769d5b1 to
1c10712
Compare
1c10712 to
73c0961
Compare
Description
Customer reported that a class name changed in the most recent version of ddtrace which was then causing errors when attempting to import
datadog_lambda. See DataDog/datadog-lambda-python#661 and #14653.Testing
Risks
It's just some tests, so risk is low.
Additional Notes
Added additional tests on the
datadog_lambdaside as well, including running our unit tests twice a day. See DataDog/datadog-lambda-python#662.