chore(llmobs): deprecate warning and error logs on misuse of llm observability sdk #15838

sabrenner · 2026-01-05T13:50:26Z

Description

In ddtrace==4.0.0, we deprecated emitting warning and error logs in favor of raising errors directly. This PR makes sure we emit the correct "deprecation" log for this in ddtrace~=3.19 so that this is surfaced for users.

Testing

None, adds deprecation logs.

Risks

None, the breaking change was released in ddtrace==4.0.0, and we should have had this initially but did not.

…propriate

…llmobs-raise-errors-deprecations

github-actions · 2026-01-05T13:51:03Z

CODEOWNERS have been resolved as:

releasenotes/notes/deprecate-warning-logs-llmobs-sdk-b5f43fffb20fdc79.yaml  @DataDog/apm-python
ddtrace/llmobs/_llmobs.py                                               @DataDog/ml-observability

github-actions · 2026-01-05T14:18:01Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 205 ± 3 ms.

The average import time from base is: 208 ± 3 ms.

The import time difference between this PR and base is: -3.2 ± 0.1 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.683 ms (0.82%)

ddtrace.bootstrap.sitecustomize 1.127 ms (0.55%)

ddtrace.bootstrap.preload 1.127 ms (0.55%)

ddtrace.internal.remoteconfig.client 0.532 ms (0.26%)

ddtrace 0.556 ms (0.27%)

ddtrace.internal._unpatched 0.096 ms (0.05%)

subprocess 0.059 ms (0.03%)

contextlib 0.059 ms (0.03%)

json 0.037 ms (0.02%)

json.decoder 0.037 ms (0.02%)

re 0.037 ms (0.02%)

enum 0.037 ms (0.02%)

types 0.037 ms (0.02%)

pr-commenter · 2026-01-05T14:42:08Z

Performance SLOs

Comparing candidate sabrenner/llmobs-raise-errors-deprecations (64080a2) with baseline 3.19 (81e7988)

📈 Performance Regressions (2 suites)

📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.3%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.9%

✅ add_inplace_aspect

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -2.7%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +5.0%

✅ add_inplace_noaspect

Time: ✅ 0.288µs (SLO: <10.000µs 📉 -97.1%) vs baseline: -1.3%

Memory: ✅ 37.926MB (SLO: <41.500MB -8.6%) vs baseline: +5.1%

✅ add_noaspect

Time: ✅ 0.358µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +0.2%

Memory: ✅ 37.926MB (SLO: <41.500MB -8.6%) vs baseline: +5.0%

✅ bytearray_aspect

Time: ✅ 1.328µs (SLO: <10.000µs 📉 -86.7%) vs baseline: -0.7%

Memory: ✅ 37.926MB (SLO: <41.500MB -8.6%) vs baseline: +5.0%

✅ bytearray_extend_aspect

Time: ✅ 1.558µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +4.6%

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +4.5%

✅ bytearray_extend_noaspect

Time: ✅ 0.613µs (SLO: <10.000µs 📉 -93.9%) vs baseline: -0.4%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.9%

✅ bytearray_noaspect

Time: ✅ 0.485µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -0.5%

Memory: ✅ 37.926MB (SLO: <41.500MB -8.6%) vs baseline: +5.1%

✅ bytes_aspect

Time: ✅ 1.290µs (SLO: <10.000µs 📉 -87.1%) vs baseline: +1.9%

Memory: ✅ 37.926MB (SLO: <41.500MB -8.6%) vs baseline: +5.1%

✅ bytes_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.9%

Memory: ✅ 37.906MB (SLO: <41.500MB -8.7%) vs baseline: +4.7%

✅ bytesio_aspect

Time: ✅ 1.314µs (SLO: <10.000µs 📉 -86.9%) vs baseline: -0.8%

Memory: ✅ 37.906MB (SLO: <41.500MB -8.7%) vs baseline: +5.0%

✅ bytesio_noaspect

Time: ✅ 0.503µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.6%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.8%

✅ capitalize_aspect

Time: ✅ 0.737µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.7%

Memory: ✅ 37.965MB (SLO: <41.500MB -8.5%) vs baseline: +5.0%

✅ capitalize_noaspect

Time: ✅ 0.442µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +0.9%

Memory: ✅ 37.906MB (SLO: <41.500MB -8.7%) vs baseline: +5.1%

✅ casefold_aspect

Time: ✅ 0.740µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -1.0%

Memory: ✅ 37.827MB (SLO: <41.500MB -8.8%) vs baseline: +4.9%

✅ casefold_noaspect

Time: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.5%

Memory: ✅ 37.945MB (SLO: <41.500MB -8.6%) vs baseline: +5.1%

✅ decode_aspect

Time: ✅ 0.728µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.7%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.8%

✅ decode_noaspect

Time: ✅ 0.422µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.3%

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +4.6%

✅ encode_aspect

Time: ✅ 0.722µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +1.5%

Memory: ✅ 37.945MB (SLO: <41.500MB -8.6%) vs baseline: +4.9%

✅ encode_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.6%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +5.0%

✅ format_aspect

Time: ✅ 3.344µs (SLO: <10.000µs 📉 -66.6%) vs baseline: -0.6%

Memory: ✅ 37.827MB (SLO: <41.500MB -8.8%) vs baseline: +4.7%

✅ format_map_aspect

Time: ✅ 3.537µs (SLO: <10.000µs 📉 -64.6%) vs baseline: -0.8%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +5.0%

✅ format_map_noaspect

Time: ✅ 0.815µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -1.9%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.8%

✅ format_noaspect

Time: ✅ 0.603µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +1.2%

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +4.7%

✅ index_aspect

Time: ✅ 0.344µs (SLO: <10.000µs 📉 -96.6%) vs baseline: +0.1%

Memory: ✅ 37.985MB (SLO: <41.500MB -8.5%) vs baseline: +5.1%

✅ index_noaspect

Time: ✅ 0.315µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +0.8%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.9%

✅ join_aspect

Time: ✅ 1.277µs (SLO: <10.000µs 📉 -87.2%) vs baseline: +0.2%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +5.0%

✅ join_noaspect

Time: ✅ 0.533µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -1.2%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.6%

✅ ljust_aspect

Time: ✅ 2.544µs (SLO: <20.000µs 📉 -87.3%) vs baseline: +0.3%

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +4.9%

✅ ljust_noaspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -1.0%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.7%

✅ lower_aspect

Time: ✅ 2.214µs (SLO: <10.000µs 📉 -77.9%) vs baseline: -0.3%

Memory: ✅ 37.808MB (SLO: <41.500MB -8.9%) vs baseline: +4.6%

✅ lower_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -1.0%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.9%

✅ lstrip_aspect

Time: ✅ 2.401µs (SLO: <20.000µs 📉 -88.0%) vs baseline: 📈 +10.6%

Memory: ✅ 37.906MB (SLO: <41.500MB -8.7%) vs baseline: +4.8%

✅ lstrip_noaspect

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -1.0%

Memory: ✅ 37.945MB (SLO: <41.500MB -8.6%) vs baseline: +4.6%

✅ modulo_aspect

Time: ✅ 0.973µs (SLO: <10.000µs 📉 -90.3%) vs baseline: +0.2%

Memory: ✅ 37.906MB (SLO: <41.500MB -8.7%) vs baseline: +5.0%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.484µs (SLO: <10.000µs 📉 -85.2%) vs baseline: -0.4%

Memory: ✅ 37.926MB (SLO: <41.500MB -8.6%) vs baseline: +4.9%

✅ modulo_aspect_for_bytes

Time: ✅ 0.948µs (SLO: <10.000µs 📉 -90.5%) vs baseline: -0.9%

Memory: ✅ 37.945MB (SLO: <41.500MB -8.6%) vs baseline: +5.1%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.172µs (SLO: <10.000µs 📉 -88.3%) vs baseline: -0.3%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.4%

✅ modulo_noaspect

Time: ✅ 0.673µs (SLO: <10.000µs 📉 -93.3%) vs baseline: -1.6%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.9%

✅ replace_aspect

Time: ✅ 4.898µs (SLO: <10.000µs 📉 -51.0%) vs baseline: +0.3%

Memory: ✅ 37.945MB (SLO: <41.500MB -8.6%) vs baseline: +5.1%

✅ replace_noaspect

Time: ✅ 0.461µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.7%

Memory: ✅ 37.906MB (SLO: <41.500MB -8.7%) vs baseline: +4.9%

✅ repr_aspect

Time: ✅ 0.947µs (SLO: <10.000µs 📉 -90.5%) vs baseline: ~same

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.9%

✅ repr_noaspect

Time: ✅ 0.455µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -1.0%

Memory: ✅ 38.004MB (SLO: <41.500MB -8.4%) vs baseline: +5.2%

✅ rstrip_aspect

Time: ✅ 1.877µs (SLO: <20.000µs 📉 -90.6%) vs baseline: ~same

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +5.0%

✅ rstrip_noaspect

Time: ✅ 0.388µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.1%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.8%

✅ slice_aspect

Time: ✅ 0.489µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.4%

Memory: ✅ 37.985MB (SLO: <41.500MB -8.5%) vs baseline: +4.9%

✅ slice_noaspect

Time: ✅ 0.446µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.6%

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +4.7%

✅ stringio_aspect

Time: ✅ 1.734µs (SLO: <10.000µs 📉 -82.7%) vs baseline: +1.3%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.5%

✅ stringio_noaspect

Time: ✅ 0.929µs (SLO: <10.000µs 📉 -90.7%) vs baseline: +0.9%

Memory: ✅ 37.827MB (SLO: <41.500MB -8.8%) vs baseline: +4.7%

✅ strip_aspect

Time: ✅ 2.175µs (SLO: <20.000µs 📉 -89.1%) vs baseline: -1.3%

Memory: ✅ 37.926MB (SLO: <41.500MB -8.6%) vs baseline: +5.1%

✅ strip_noaspect

Time: ✅ 0.394µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.9%

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +4.7%

✅ swapcase_aspect

Time: ✅ 2.405µs (SLO: <10.000µs 📉 -75.9%) vs baseline: +0.3%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.7%

✅ swapcase_noaspect

Time: ✅ 0.540µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.9%

Memory: ✅ 37.926MB (SLO: <41.500MB -8.6%) vs baseline: +4.9%

✅ title_aspect

Time: ✅ 2.352µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.5%

Memory: ✅ 37.768MB (SLO: <41.500MB -9.0%) vs baseline: +4.4%

✅ title_noaspect

Time: ✅ 0.505µs (SLO: <10.000µs 📉 -94.9%) vs baseline: ~same

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.8%

✅ translate_aspect

Time: ✅ 3.203µs (SLO: <10.000µs 📉 -68.0%) vs baseline: -0.4%

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.9%

✅ translate_noaspect

Time: ✅ 1.042µs (SLO: <10.000µs 📉 -89.6%) vs baseline: ~same

Memory: ✅ 37.886MB (SLO: <41.500MB -8.7%) vs baseline: +4.8%

✅ upper_aspect

Time: ✅ 2.230µs (SLO: <10.000µs 📉 -77.7%) vs baseline: +0.5%

Memory: ✅ 37.867MB (SLO: <41.500MB -8.8%) vs baseline: +4.7%

✅ upper_noaspect

Time: ✅ 0.371µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.2%

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +4.6%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.655µs (SLO: <10.000µs 📉 -53.5%) vs baseline: 📈 +11.3%

Memory: ✅ 37.886MB (SLO: <41.000MB -7.6%) vs baseline: +3.8%

✅ ospathbasename_noaspect

Time: ✅ 1.085µs (SLO: <10.000µs 📉 -89.1%) vs baseline: +0.4%

Memory: ✅ 37.867MB (SLO: <41.000MB -7.6%) vs baseline: +3.8%

✅ ospathjoin_aspect

Time: ✅ 6.002µs (SLO: <10.000µs 📉 -40.0%) vs baseline: -0.5%

Memory: ✅ 37.965MB (SLO: <41.000MB -7.4%) vs baseline: +4.8%

✅ ospathjoin_noaspect

Time: ✅ 2.302µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +0.6%

Memory: ✅ 37.926MB (SLO: <41.000MB -7.5%) vs baseline: +4.7%

✅ ospathnormcase_aspect

Time: ✅ 3.428µs (SLO: <10.000µs 📉 -65.7%) vs baseline: -0.1%

Memory: ✅ 37.788MB (SLO: <41.000MB -7.8%) vs baseline: +3.9%

✅ ospathnormcase_noaspect

Time: ✅ 0.575µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +1.9%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +4.4%

✅ ospathsplit_aspect

Time: ✅ 4.729µs (SLO: <10.000µs 📉 -52.7%) vs baseline: ~same

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +4.4%

✅ ospathsplit_noaspect

Time: ✅ 1.588µs (SLO: <10.000µs 📉 -84.1%) vs baseline: ~same

Memory: ✅ 37.965MB (SLO: <41.000MB -7.4%) vs baseline: +4.9%

✅ ospathsplitdrive_aspect

Time: ✅ 3.632µs (SLO: <10.000µs 📉 -63.7%) vs baseline: -0.5%

Memory: ✅ 38.083MB (SLO: <41.000MB -7.1%) vs baseline: +4.6%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.703µs (SLO: <10.000µs 📉 -93.0%) vs baseline: +0.9%

Memory: ✅ 37.827MB (SLO: <41.000MB -7.7%) vs baseline: +3.8%

✅ ospathsplitext_aspect

Time: ✅ 5.106µs (SLO: <10.000µs 📉 -48.9%) vs baseline: 📈 +13.1%

Memory: ✅ 37.926MB (SLO: <41.000MB -7.5%) vs baseline: +4.2%

✅ ospathsplitext_noaspect

Time: ✅ 1.372µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -0.6%

Memory: ✅ 37.945MB (SLO: <41.000MB -7.5%) vs baseline: +4.2%

🟡 Near SLO Breach (1 suite)

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.590ms (SLO: <4.750ms -3.4%) vs baseline: -0.8%

Memory: ✅ 64.059MB (SLO: <66.500MB -3.7%) vs baseline: +4.8%

✅ appsec-post

Time: ✅ 6.632ms (SLO: <6.750ms 🟡 -1.7%) vs baseline: +0.1%

Memory: ✅ 64.060MB (SLO: <66.500MB -3.7%) vs baseline: +4.7%

✅ appsec-telemetry

Time: ✅ 4.587ms (SLO: <4.750ms -3.4%) vs baseline: -0.2%

Memory: ✅ 64.144MB (SLO: <66.500MB -3.5%) vs baseline: +5.0%

✅ debugger

Time: ✅ 1.860ms (SLO: <2.000ms -7.0%) vs baseline: ~same

Memory: ✅ 47.823MB (SLO: <49.500MB -3.4%) vs baseline: +4.8%

✅ iast-get

Time: ✅ 1.861ms (SLO: <2.000ms -6.9%) vs baseline: ~same

Memory: ✅ 44.529MB (SLO: <49.000MB -9.1%) vs baseline: +4.7%

✅ profiler

Time: ✅ 1.914ms (SLO: <2.100ms -8.9%) vs baseline: -0.2%

Memory: ✅ 48.574MB (SLO: <50.000MB -2.9%) vs baseline: +4.4%

✅ resource-renaming

Time: ✅ 3.366ms (SLO: <3.650ms -7.8%) vs baseline: -0.2%

Memory: ✅ 54.361MB (SLO: <56.000MB -2.9%) vs baseline: +4.7%

✅ tracer

Time: ✅ 3.350ms (SLO: <3.650ms -8.2%) vs baseline: -0.2%

Memory: ✅ 54.438MB (SLO: <56.500MB -3.6%) vs baseline: +4.8%

✅ tracer-native

Time: ✅ 3.346ms (SLO: <3.650ms -8.3%) vs baseline: -0.4%

Memory: ✅ 54.364MB (SLO: <60.000MB -9.4%) vs baseline: +4.8%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.317µs (SLO: <20.000µs 📉 -33.4%) vs baseline: ~same

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +5.0%

✅ context_with_data_no_listeners

Time: ✅ 3.293µs (SLO: <10.000µs 📉 -67.1%) vs baseline: -0.4%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ get_item_exists

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.5%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.9%

✅ get_item_missing

Time: ✅ 0.637µs (SLO: <10.000µs 📉 -93.6%) vs baseline: -0.2%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.9%

✅ set_item

Time: ✅ 24.054µs (SLO: <30.000µs 📉 -19.8%) vs baseline: -0.6%

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +5.0%

✅ All Tests Passing (19 suites)

✅ djangosimple - 30/30

✅ appsec

Time: ✅ 20.484ms (SLO: <22.300ms -8.1%) vs baseline: ~same

Memory: ✅ 68.026MB (SLO: <70.500MB -3.5%) vs baseline: +4.8%

✅ exception-replay-enabled

Time: ✅ 1.340ms (SLO: <1.450ms -7.6%) vs baseline: -0.5%

Memory: ✅ 65.943MB (SLO: <67.500MB -2.3%) vs baseline: +4.9%

✅ iast

Time: ✅ 20.407ms (SLO: <22.250ms -8.3%) vs baseline: -0.3%

Memory: ✅ 67.987MB (SLO: <70.000MB -2.9%) vs baseline: +4.6%

✅ profiler

Time: ✅ 15.209ms (SLO: <16.550ms -8.1%) vs baseline: -0.3%

Memory: ✅ 55.860MB (SLO: <57.500MB -2.9%) vs baseline: +4.6%

✅ resource-renaming

Time: ✅ 20.548ms (SLO: <21.750ms -5.5%) vs baseline: +0.2%

Memory: ✅ 68.007MB (SLO: <70.500MB -3.5%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 25.395ms (SLO: <28.200ms -9.9%) vs baseline: ~same

Memory: ✅ 68.923MB (SLO: <71.000MB -2.9%) vs baseline: +4.4%

✅ tracer

Time: ✅ 20.509ms (SLO: <21.750ms -5.7%) vs baseline: +0.1%

Memory: ✅ 68.007MB (SLO: <70.000MB -2.8%) vs baseline: +5.0%

✅ tracer-and-profiler

Time: ✅ 22.181ms (SLO: <23.500ms -5.6%) vs baseline: -0.4%

Memory: ✅ 69.279MB (SLO: <71.000MB -2.4%) vs baseline: +5.2%

✅ tracer-dont-create-db-spans

Time: ✅ 19.276ms (SLO: <21.500ms 📉 -10.3%) vs baseline: -0.2%

Memory: ✅ 67.928MB (SLO: <70.000MB -3.0%) vs baseline: +4.6%

✅ tracer-minimal

Time: ✅ 16.620ms (SLO: <17.500ms -5.0%) vs baseline: +0.2%

Memory: ✅ 67.712MB (SLO: <70.000MB -3.3%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 20.509ms (SLO: <21.750ms -5.7%) vs baseline: ~same

Memory: ✅ 68.125MB (SLO: <72.500MB -6.0%) vs baseline: +5.0%

✅ tracer-no-caches

Time: ✅ 18.425ms (SLO: <19.650ms -6.2%) vs baseline: ~same

Memory: ✅ 67.653MB (SLO: <70.000MB -3.4%) vs baseline: +4.8%

✅ tracer-no-databases

Time: ✅ 18.797ms (SLO: <20.100ms -6.5%) vs baseline: ~same

Memory: ✅ 67.672MB (SLO: <70.000MB -3.3%) vs baseline: +4.7%

✅ tracer-no-middleware

Time: ✅ 20.175ms (SLO: <21.500ms -6.2%) vs baseline: +0.1%

Memory: ✅ 67.771MB (SLO: <70.000MB -3.2%) vs baseline: +5.1%

✅ tracer-no-templates

Time: ✅ 20.293ms (SLO: <22.000ms -7.8%) vs baseline: -0.5%

Memory: ✅ 67.987MB (SLO: <70.500MB -3.6%) vs baseline: +4.8%

✅ errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.061ms (SLO: <19.850ms -9.0%) vs baseline: -0.1%

Memory: ✅ 67.606MB (SLO: <70.000MB -3.4%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 18.143ms (SLO: <19.400ms -6.5%) vs baseline: +0.5%

Memory: ✅ 67.662MB (SLO: <70.000MB -3.3%) vs baseline: +4.6%

✅ tracer-enabled

Time: ✅ 18.017ms (SLO: <19.450ms -7.4%) vs baseline: -0.3%

Memory: ✅ 67.684MB (SLO: <70.000MB -3.3%) vs baseline: +4.9%

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.069ms (SLO: <2.300ms 📉 -10.0%) vs baseline: ~same

Memory: ✅ 54.401MB (SLO: <56.500MB -3.7%) vs baseline: +5.1%

✅ errortracking-enabled-user

Time: ✅ 2.089ms (SLO: <2.250ms -7.1%) vs baseline: +1.1%

Memory: ✅ 54.382MB (SLO: <56.500MB -3.7%) vs baseline: +4.7%

✅ tracer-enabled

Time: ✅ 2.077ms (SLO: <2.300ms -9.7%) vs baseline: +0.8%

Memory: ✅ 54.323MB (SLO: <56.500MB -3.9%) vs baseline: +4.4%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.965ms (SLO: <4.200ms -5.6%) vs baseline: -0.1%

Memory: ✅ 64.173MB (SLO: <66.000MB -2.8%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.437ms (SLO: <2.800ms 📉 -13.0%) vs baseline: -0.2%

Memory: ✅ 60.359MB (SLO: <62.500MB -3.4%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.060ms (SLO: <2.250ms -8.5%) vs baseline: +0.2%

Memory: ✅ 54.441MB (SLO: <56.500MB -3.6%) vs baseline: +4.7%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 84.466µs (SLO: <100.000µs 📉 -15.5%) vs baseline: +4.9%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.8%

✅ b3_headers

Time: ✅ 14.213µs (SLO: <20.000µs 📉 -28.9%) vs baseline: ~same

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ b3_single_headers

Time: ✅ 14.485µs (SLO: <20.000µs 📉 -27.6%) vs baseline: +9.1%

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.545µs (SLO: <80.000µs 📉 -20.6%) vs baseline: ~same

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +4.8%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 69.087µs (SLO: <80.000µs 📉 -13.6%) vs baseline: +5.0%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.7%

✅ empty_headers

Time: ✅ 1.608µs (SLO: <10.000µs 📉 -83.9%) vs baseline: ~same

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.7%

✅ full_t_id_datadog_headers

Time: ✅ 24.098µs (SLO: <30.000µs 📉 -19.7%) vs baseline: +5.9%

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +4.7%

✅ invalid_priority_header

Time: ✅ 6.500µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.6%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.7%

✅ invalid_span_id_header

Time: ✅ 6.548µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.2%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.6%

✅ invalid_tags_header

Time: ✅ 6.558µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.5%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.8%

✅ invalid_trace_id_header

Time: ✅ 6.533µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.1%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ large_header_no_matches

Time: ✅ 27.627µs (SLO: <30.000µs -7.9%) vs baseline: -0.2%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +4.7%

✅ large_valid_headers_all

Time: ✅ 28.711µs (SLO: <40.000µs 📉 -28.2%) vs baseline: -0.5%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +4.7%

✅ medium_header_no_matches

Time: ✅ 9.855µs (SLO: <20.000µs 📉 -50.7%) vs baseline: -0.1%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +5.0%

✅ medium_valid_headers_all

Time: ✅ 11.256µs (SLO: <20.000µs 📉 -43.7%) vs baseline: +0.2%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.6%

✅ none_propagation_style

Time: ✅ 1.716µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +1.1%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.5%

✅ tracecontext_headers

Time: ✅ 36.265µs (SLO: <40.000µs -9.3%) vs baseline: +4.8%

Memory: ✅ 34.642MB (SLO: <35.500MB -2.4%) vs baseline: +5.0%

✅ valid_headers_all

Time: ✅ 6.525µs (SLO: <10.000µs 📉 -34.8%) vs baseline: +0.3%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ valid_headers_basic

Time: ✅ 6.110µs (SLO: <10.000µs 📉 -38.9%) vs baseline: +0.2%

Memory: ✅ 34.623MB (SLO: <35.500MB -2.5%) vs baseline: +5.2%

✅ wsgi_empty_headers

Time: ✅ 1.593µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.9%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +5.3%

✅ wsgi_invalid_priority_header

Time: ✅ 6.554µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.6%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.603µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.3%

Memory: ✅ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.9%

✅ wsgi_invalid_tags_header

Time: ✅ 6.659µs (SLO: <10.000µs 📉 -33.4%) vs baseline: +1.6%

Memory: ✅ 34.623MB (SLO: <35.500MB -2.5%) vs baseline: +5.0%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.550µs (SLO: <10.000µs 📉 -34.5%) vs baseline: -0.4%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +5.3%

✅ wsgi_large_header_no_matches

Time: ✅ 28.817µs (SLO: <40.000µs 📉 -28.0%) vs baseline: +0.5%

Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +4.3%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.919µs (SLO: <40.000µs 📉 -25.2%) vs baseline: +0.5%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.137µs (SLO: <20.000µs 📉 -49.3%) vs baseline: +0.3%

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.6%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.641µs (SLO: <20.000µs 📉 -41.8%) vs baseline: +0.2%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ wsgi_valid_headers_all

Time: ✅ 6.554µs (SLO: <10.000µs 📉 -34.5%) vs baseline: -0.1%

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +4.9%

✅ wsgi_valid_headers_basic

Time: ✅ 6.212µs (SLO: <10.000µs 📉 -37.9%) vs baseline: +2.0%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.056µs (SLO: <30.000µs 📉 -29.8%) vs baseline: +0.2%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ with_all

Time: ✅ 29.104µs (SLO: <40.000µs 📉 -27.2%) vs baseline: +2.5%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.8%

✅ with_dd_origin

Time: ✅ 24.949µs (SLO: <30.000µs 📉 -16.8%) vs baseline: +0.6%

Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +4.6%

✅ with_priority_and_origin

Time: ✅ 24.407µs (SLO: <40.000µs 📉 -39.0%) vs baseline: +0.7%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.9%

✅ with_sampling_priority

Time: ✅ 21.224µs (SLO: <30.000µs 📉 -29.3%) vs baseline: +1.1%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ with_tags

Time: ✅ 26.815µs (SLO: <40.000µs 📉 -33.0%) vs baseline: +1.3%

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +5.0%

✅ with_tags_invalid

Time: ✅ 28.281µs (SLO: <40.000µs 📉 -29.3%) vs baseline: +1.4%

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +4.9%

✅ with_tags_max_size

Time: ✅ 28.046µs (SLO: <40.000µs 📉 -29.9%) vs baseline: +4.0%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 32.030µs (SLO: <40.000µs 📉 -19.9%) vs baseline: +0.5%

Memory: ✅ 38.142MB (SLO: <41.000MB -7.0%) vs baseline: +4.5%

✅ re_expand_noaspect

Time: ✅ 28.648µs (SLO: <40.000µs 📉 -28.4%) vs baseline: ~same

Memory: ✅ 38.201MB (SLO: <41.000MB -6.8%) vs baseline: +5.6%

✅ re_findall_aspect

Time: ✅ 2.917µs (SLO: <10.000µs 📉 -70.8%) vs baseline: +0.2%

Memory: ✅ 38.162MB (SLO: <41.000MB -6.9%) vs baseline: +4.9%

✅ re_findall_noaspect

Time: ✅ 1.423µs (SLO: <10.000µs 📉 -85.8%) vs baseline: -0.4%

Memory: ✅ 38.221MB (SLO: <41.000MB -6.8%) vs baseline: +5.5%

✅ re_finditer_aspect

Time: ✅ 4.427µs (SLO: <10.000µs 📉 -55.7%) vs baseline: +0.4%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +4.0%

✅ re_finditer_noaspect

Time: ✅ 1.410µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.7%

Memory: ✅ 38.142MB (SLO: <41.000MB -7.0%) vs baseline: +5.2%

✅ re_fullmatch_aspect

Time: ✅ 2.681µs (SLO: <10.000µs 📉 -73.2%) vs baseline: -0.6%

Memory: ✅ 37.847MB (SLO: <41.000MB -7.7%) vs baseline: +4.0%

✅ re_fullmatch_noaspect

Time: ✅ 1.289µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -1.0%

Memory: ✅ 38.221MB (SLO: <41.000MB -6.8%) vs baseline: +5.8%

✅ re_group_aspect

Time: ✅ 2.961µs (SLO: <10.000µs 📉 -70.4%) vs baseline: +0.4%

Memory: ✅ 38.142MB (SLO: <41.000MB -7.0%) vs baseline: +4.9%

✅ re_group_noaspect

Time: ✅ 1.602µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same

Memory: ✅ 37.965MB (SLO: <41.000MB -7.4%) vs baseline: +4.4%

✅ re_groups_aspect

Time: ✅ 3.084µs (SLO: <10.000µs 📉 -69.2%) vs baseline: +0.9%

Memory: ✅ 38.319MB (SLO: <41.000MB -6.5%) vs baseline: +5.6%

✅ re_groups_noaspect

Time: ✅ 1.713µs (SLO: <10.000µs 📉 -82.9%) vs baseline: +1.4%

Memory: ✅ 38.280MB (SLO: <41.000MB -6.6%) vs baseline: +5.9%

✅ re_match_aspect

Time: ✅ 2.767µs (SLO: <10.000µs 📉 -72.3%) vs baseline: +2.0%

Memory: ✅ 38.162MB (SLO: <41.000MB -6.9%) vs baseline: +4.7%

✅ re_match_noaspect

Time: ✅ 1.300µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.4%

Memory: ✅ 38.181MB (SLO: <41.000MB -6.9%) vs baseline: +4.7%

✅ re_search_aspect

Time: ✅ 2.538µs (SLO: <10.000µs 📉 -74.6%) vs baseline: +0.8%

Memory: ✅ 38.122MB (SLO: <41.000MB -7.0%) vs baseline: +4.9%

✅ re_search_noaspect

Time: ✅ 1.206µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.4%

Memory: ✅ 37.965MB (SLO: <41.000MB -7.4%) vs baseline: +4.9%

✅ re_sub_aspect

Time: ✅ 3.405µs (SLO: <10.000µs 📉 -65.9%) vs baseline: +2.0%

Memory: ✅ 38.122MB (SLO: <41.000MB -7.0%) vs baseline: +4.6%

✅ re_sub_noaspect

Time: ✅ 1.531µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.6%

Memory: ✅ 38.122MB (SLO: <41.000MB -7.0%) vs baseline: +4.4%

✅ re_subn_aspect

Time: ✅ 3.611µs (SLO: <10.000µs 📉 -63.9%) vs baseline: -0.6%

Memory: ✅ 38.162MB (SLO: <41.000MB -6.9%) vs baseline: +4.7%

✅ re_subn_noaspect

Time: ✅ 1.620µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.9%

Memory: ✅ 38.044MB (SLO: <41.000MB -7.2%) vs baseline: +4.6%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.375µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -0.6%

Memory: ✅ 38.280MB (SLO: <41.000MB -6.6%) vs baseline: +5.0%

✅ rsplit_noaspect

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.7%

Memory: ✅ 38.260MB (SLO: <41.000MB -6.7%) vs baseline: +4.8%

✅ split_aspect

Time: ✅ 1.382µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.8%

Memory: ✅ 38.221MB (SLO: <41.000MB -6.8%) vs baseline: +4.7%

✅ split_noaspect

Time: ✅ 0.569µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -1.8%

Memory: ✅ 38.260MB (SLO: <41.000MB -6.7%) vs baseline: +4.7%

✅ splitlines_aspect

Time: ✅ 1.376µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -0.9%

Memory: ✅ 38.201MB (SLO: <41.000MB -6.8%) vs baseline: +4.8%

✅ splitlines_noaspect

Time: ✅ 0.593µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +1.8%

Memory: ✅ 38.260MB (SLO: <41.000MB -6.7%) vs baseline: +5.0%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.546ms (SLO: <42.000ms -3.5%) vs baseline: ~same

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%) vs baseline: +4.7%

✅ add-link

Time: ✅ 36.510ms (SLO: <38.550ms -5.3%) vs baseline: ~same

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 217.925ms (SLO: <232.000ms -6.1%) vs baseline: -0.4%

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 210.863ms (SLO: <221.600ms -4.8%) vs baseline: -0.6%

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%) vs baseline: +5.0%

✅ get-context

Time: ✅ 29.128ms (SLO: <31.300ms -6.9%) vs baseline: -0.3%

Memory: ✅ 36.943MB (SLO: <39.000MB -5.3%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 29.098ms (SLO: <31.000ms -6.1%) vs baseline: -1.1%

Memory: ✅ 36.943MB (SLO: <39.000MB -5.3%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 63.165ms (SLO: <65.850ms -4.1%) vs baseline: -0.4%

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%) vs baseline: +4.4%

✅ set-status

Time: ✅ 31.919ms (SLO: <34.150ms -6.5%) vs baseline: -0.1%

Memory: ✅ 36.982MB (SLO: <39.000MB -5.2%) vs baseline: +5.1%

✅ start

Time: ✅ 28.812ms (SLO: <30.150ms -4.4%) vs baseline: -1.0%

Memory: ✅ 37.021MB (SLO: <39.000MB -5.1%) vs baseline: +5.1%

✅ start-finish

Time: ✅ 33.781ms (SLO: <35.350ms -4.4%) vs baseline: -0.3%

Memory: ✅ 36.962MB (SLO: <39.000MB -5.2%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 34.108ms (SLO: <35.450ms -3.8%) vs baseline: ~same

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%) vs baseline: +4.5%

✅ update-name

Time: ✅ 31.295ms (SLO: <33.400ms -6.3%) vs baseline: +0.6%

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%) vs baseline: +5.0%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 38.297ms (SLO: <47.150ms 📉 -18.8%) vs baseline: -0.1%

Memory: ✅ 39.257MB (SLO: <47.000MB 📉 -16.5%) vs baseline: +5.2%

✅ add-metrics

Time: ✅ 316.516ms (SLO: <344.800ms -8.2%) vs baseline: ~same

Memory: ✅ 43.314MB (SLO: <47.500MB -8.8%) vs baseline: +5.1%

✅ add-tags

Time: ✅ 288.183ms (SLO: <314.000ms -8.2%) vs baseline: -1.0%

Memory: ✅ 43.288MB (SLO: <47.500MB -8.9%) vs baseline: +4.5%

✅ get-context

Time: ✅ 81.423ms (SLO: <92.350ms 📉 -11.8%) vs baseline: +3.2%

Memory: ✅ 39.468MB (SLO: <46.500MB 📉 -15.1%) vs baseline: +5.1%

✅ is-recording

Time: ✅ 36.209ms (SLO: <44.500ms 📉 -18.6%) vs baseline: +0.5%

Memory: ✅ 38.987MB (SLO: <47.500MB 📉 -17.9%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 57.825ms (SLO: <67.650ms 📉 -14.5%) vs baseline: +1.2%

Memory: ✅ 39.527MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +5.0%

✅ set-status

Time: ✅ 42.059ms (SLO: <50.400ms 📉 -16.6%) vs baseline: ~same

Memory: ✅ 38.888MB (SLO: <47.000MB 📉 -17.3%) vs baseline: +4.8%

✅ start

Time: ✅ 35.707ms (SLO: <43.450ms 📉 -17.8%) vs baseline: +1.3%

Memory: ✅ 38.902MB (SLO: <47.000MB 📉 -17.2%) vs baseline: +4.6%

✅ start-finish

Time: ✅ 82.095ms (SLO: <88.000ms -6.7%) vs baseline: +0.4%

Memory: ✅ 36.923MB (SLO: <46.500MB 📉 -20.6%) vs baseline: +4.7%

✅ start-finish-telemetry

Time: ✅ 84.661ms (SLO: <89.000ms -4.9%) vs baseline: +1.5%

Memory: ✅ 36.943MB (SLO: <46.500MB 📉 -20.6%) vs baseline: +4.7%

✅ update-name

Time: ✅ 37.468ms (SLO: <45.150ms 📉 -17.0%) vs baseline: +1.2%

Memory: ✅ 38.986MB (SLO: <47.000MB 📉 -17.1%) vs baseline: +4.6%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.800ms (SLO: <354.300ms -3.2%) vs baseline: -0.8%

Memory: ✅ 40.557MB (SLO: <41.500MB -2.3%) vs baseline: +4.3%

✅ cache_on

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.7%

Memory: ✅ 38.840MB (SLO: <41.000MB -5.3%) vs baseline: +5.3%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 156.063µs (SLO: <170.000µs -8.2%) vs baseline: +0.1%

Memory: ✅ 39.715MB (SLO: <41.000MB -3.1%) vs baseline: +5.8%

✅ import_many_cached

Time: ✅ 121.418µs (SLO: <130.000µs -6.6%) vs baseline: +0.5%

Memory: ✅ 39.543MB (SLO: <41.000MB -3.6%) vs baseline: +4.8%

✅ import_many_stdlib

Time: ✅ 1.623ms (SLO: <1.750ms -7.2%) vs baseline: -0.2%

Memory: ✅ 39.638MB (SLO: <41.000MB -3.3%) vs baseline: +4.9%

✅ import_many_stdlib_cached

Time: ✅ 0.976ms (SLO: <1.100ms 📉 -11.3%) vs baseline: ~same

Memory: ✅ 39.817MB (SLO: <41.000MB -2.9%) vs baseline: +5.2%

✅ import_many_unknown

Time: ✅ 835.165µs (SLO: <890.000µs -6.2%) vs baseline: ~same

Memory: ✅ 39.767MB (SLO: <41.000MB -3.0%) vs baseline: +4.8%

✅ import_many_unknown_cached

Time: ✅ 797.015µs (SLO: <870.000µs -8.4%) vs baseline: +1.0%

Memory: ✅ 39.687MB (SLO: <41.000MB -3.2%) vs baseline: +5.0%

✅ import_one

Time: ✅ 19.795µs (SLO: <30.000µs 📉 -34.0%) vs baseline: ~same

Memory: ✅ 39.599MB (SLO: <41.000MB -3.4%) vs baseline: +4.2%

✅ import_one_cache

Time: ✅ 6.306µs (SLO: <10.000µs 📉 -36.9%) vs baseline: +0.7%

Memory: ✅ 39.582MB (SLO: <41.000MB -3.5%) vs baseline: +4.6%

✅ import_one_stdlib

Time: ✅ 18.626µs (SLO: <20.000µs -6.9%) vs baseline: -0.6%

Memory: ✅ 39.517MB (SLO: <41.000MB -3.6%) vs baseline: +4.5%

✅ import_one_stdlib_cache

Time: ✅ 6.263µs (SLO: <10.000µs 📉 -37.4%) vs baseline: ~same

Memory: ✅ 39.637MB (SLO: <41.000MB -3.3%) vs baseline: +4.0%

✅ import_one_unknown

Time: ✅ 45.660µs (SLO: <50.000µs -8.7%) vs baseline: +0.1%

Memory: ✅ 39.567MB (SLO: <41.000MB -3.5%) vs baseline: +5.1%

✅ import_one_unknown_cache

Time: ✅ 6.347µs (SLO: <10.000µs 📉 -36.5%) vs baseline: -0.2%

Memory: ✅ 39.574MB (SLO: <41.000MB -3.5%) vs baseline: +4.1%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.363µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.6%

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +5.2%

✅ high_rate_limit

Time: ✅ 2.407µs (SLO: <10.000µs 📉 -75.9%) vs baseline: -0.8%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +5.0%

✅ long_window

Time: ✅ 2.367µs (SLO: <10.000µs 📉 -76.3%) vs baseline: -0.8%

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +5.0%

✅ low_rate_limit

Time: ✅ 2.349µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -1.1%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ no_rate_limit

Time: ✅ 0.834µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +0.5%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.7%

✅ short_window

Time: ✅ 2.510µs (SLO: <10.000µs 📉 -74.9%) vs baseline: -1.2%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.9%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 309.866ms (SLO: <320.950ms -3.5%) vs baseline: +0.2%

Memory: ✅ 35.743MB (SLO: <36.500MB -2.1%) vs baseline: +5.0%

✅ deep-profiled

Time: ✅ 328.701ms (SLO: <359.150ms -8.5%) vs baseline: +0.1%

Memory: ✅ 39.381MB (SLO: <40.500MB -2.8%) vs baseline: +4.9%

✅ medium

Time: ✅ 7.026ms (SLO: <7.400ms -5.0%) vs baseline: ~same

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +5.2%

✅ shallow

Time: ✅ 0.949ms (SLO: <1.050ms -9.6%) vs baseline: +0.6%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +5.0%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 138.145µs (SLO: <290.000µs 📉 -52.4%) vs baseline: +0.5%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.9%

✅ high_match

Time: ✅ 173.086µs (SLO: <480.000µs 📉 -63.9%) vs baseline: -0.6%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.7%

✅ low_match

Time: ✅ 99.431µs (SLO: <120.000µs 📉 -17.1%) vs baseline: +1.0%

Memory: ✅ 603.307MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.663ms (SLO: <8.500ms 📉 -68.7%) vs baseline: -0.4%

Memory: ✅ 70.579MB (SLO: <75.000MB -5.9%) vs baseline: +4.8%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.611µs (SLO: <20.000µs 📉 -46.9%) vs baseline: +0.1%

Memory: ✅ 34.977MB (SLO: <36.000MB -2.8%) vs baseline: +4.8%

✅ all-enabled

Time: ✅ 40.134µs (SLO: <50.000µs 📉 -19.7%) vs baseline: +0.9%

Memory: ✅ 35.016MB (SLO: <36.000MB -2.7%) vs baseline: +5.1%

✅ collectipvariant_exists

Time: ✅ 40.702µs (SLO: <50.000µs 📉 -18.6%) vs baseline: +0.4%

Memory: ✅ 34.957MB (SLO: <36.000MB -2.9%) vs baseline: +5.0%

✅ no-collectipvariant

Time: ✅ 40.105µs (SLO: <50.000µs 📉 -19.8%) vs baseline: +0.9%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +4.9%

✅ no-useragentvariant

Time: ✅ 38.799µs (SLO: <50.000µs 📉 -22.4%) vs baseline: +0.3%

Memory: ✅ 34.898MB (SLO: <36.000MB -3.1%) vs baseline: +5.1%

✅ obfuscation-no-query

Time: ✅ 40.474µs (SLO: <50.000µs 📉 -19.1%) vs baseline: +0.5%

Memory: ✅ 34.918MB (SLO: <36.000MB -3.0%) vs baseline: +4.9%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.978µs (SLO: <90.000µs 📉 -15.6%) vs baseline: +0.6%

Memory: ✅ 35.271MB (SLO: <36.500MB -3.4%) vs baseline: +4.5%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 77.614µs (SLO: <90.000µs 📉 -13.8%) vs baseline: +1.6%

Memory: ✅ 35.409MB (SLO: <36.500MB -3.0%) vs baseline: +5.3%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.310µs (SLO: <170.000µs -9.2%) vs baseline: +0.1%

Memory: ✅ 35.389MB (SLO: <36.500MB -3.0%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.790µs (SLO: <160.000µs -7.0%) vs baseline: +0.7%

Memory: ✅ 35.271MB (SLO: <36.500MB -3.4%) vs baseline: +4.4%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.951µs (SLO: <170.000µs -8.9%) vs baseline: +0.4%

Memory: ✅ 35.330MB (SLO: <36.500MB -3.2%) vs baseline: +4.9%

✅ useragentvariant_exists_1

Time: ✅ 39.546µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +0.6%

Memory: ✅ 34.878MB (SLO: <36.000MB -3.1%) vs baseline: +4.5%

✅ useragentvariant_exists_2

Time: ✅ 40.610µs (SLO: <50.000µs 📉 -18.8%) vs baseline: +0.4%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +4.9%

✅ useragentvariant_exists_3

Time: ✅ 40.070µs (SLO: <50.000µs 📉 -19.9%) vs baseline: +0.6%

Memory: ✅ 34.898MB (SLO: <36.000MB -3.1%) vs baseline: +4.8%

✅ useragentvariant_not_exists_1

Time: ✅ 39.426µs (SLO: <50.000µs 📉 -21.1%) vs baseline: +0.4%

Memory: ✅ 34.898MB (SLO: <36.000MB -3.1%) vs baseline: +4.7%

✅ useragentvariant_not_exists_2

Time: ✅ 39.472µs (SLO: <50.000µs 📉 -21.1%) vs baseline: +0.4%

Memory: ✅ 34.918MB (SLO: <36.000MB -3.0%) vs baseline: +4.7%

✅ span - 26/26

✅ add-event

Time: ✅ 17.395ms (SLO: <22.500ms 📉 -22.7%) vs baseline: +0.6%

Memory: ✅ 36.552MB (SLO: <53.000MB 📉 -31.0%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 87.052ms (SLO: <93.500ms -6.9%) vs baseline: +0.5%

Memory: ✅ 40.828MB (SLO: <53.000MB 📉 -23.0%) vs baseline: +5.0%

✅ add-tags

Time: ✅ 144.485ms (SLO: <155.000ms -6.8%) vs baseline: -0.3%

Memory: ✅ 40.797MB (SLO: <53.000MB 📉 -23.0%) vs baseline: +5.0%

✅ get-context

Time: ✅ 16.040ms (SLO: <20.500ms 📉 -21.8%) vs baseline: -0.6%

Memory: ✅ 36.360MB (SLO: <53.000MB 📉 -31.4%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 16.302ms (SLO: <20.500ms 📉 -20.5%) vs baseline: -1.0%

Memory: ✅ 36.379MB (SLO: <53.000MB 📉 -31.4%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 35.223ms (SLO: <40.000ms 📉 -11.9%) vs baseline: -0.4%

Memory: ✅ 36.974MB (SLO: <53.000MB 📉 -30.2%) vs baseline: +4.9%

✅ set-status

Time: ✅ 17.799ms (SLO: <22.000ms 📉 -19.1%) vs baseline: -1.0%

Memory: ✅ 36.417MB (SLO: <53.000MB 📉 -31.3%) vs baseline: +4.9%

✅ start

Time: ✅ 16.113ms (SLO: <20.500ms 📉 -21.4%) vs baseline: +1.3%

Memory: ✅ 36.374MB (SLO: <53.000MB 📉 -31.4%) vs baseline: +4.7%

✅ start-finish

Time: ✅ 50.861ms (SLO: <52.500ms -3.1%) vs baseline: +0.6%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.7%

✅ start-finish-telemetry

Time: ✅ 52.083ms (SLO: <54.500ms -4.4%) vs baseline: -0.6%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.8%

✅ start-finish-traceid128

Time: ✅ 53.715ms (SLO: <57.000ms -5.8%) vs baseline: -0.1%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +5.1%

✅ start-traceid128

Time: ✅ 16.650ms (SLO: <22.500ms 📉 -26.0%) vs baseline: +1.8%

Memory: ✅ 36.436MB (SLO: <53.000MB 📉 -31.3%) vs baseline: +4.9%

✅ update-name

Time: ✅ 16.373ms (SLO: <22.000ms 📉 -25.6%) vs baseline: -0.3%

Memory: ✅ 36.529MB (SLO: <53.000MB 📉 -31.1%) vs baseline: +4.9%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.924µs (SLO: <20.000µs 📉 -85.4%) vs baseline: -0.2%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +5.0%

✅ 1-count-metrics-100-times

Time: ✅ 202.727µs (SLO: <220.000µs -7.9%) vs baseline: +1.4%

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.9%

✅ 1-distribution-metric-1-times

Time: ✅ 3.244µs (SLO: <20.000µs 📉 -83.8%) vs baseline: -0.2%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.7%

✅ 1-distribution-metrics-100-times

Time: ✅ 214.026µs (SLO: <220.000µs -2.7%) vs baseline: +0.2%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ 1-gauge-metric-1-times

Time: ✅ 2.298µs (SLO: <20.000µs 📉 -88.5%) vs baseline: +5.4%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.6%

✅ 1-gauge-metrics-100-times

Time: ✅ 136.771µs (SLO: <150.000µs -8.8%) vs baseline: ~same

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.9%

✅ 1-rate-metric-1-times

Time: ✅ 3.086µs (SLO: <20.000µs 📉 -84.6%) vs baseline: +0.5%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +5.2%

✅ 1-rate-metrics-100-times

Time: ✅ 213.433µs (SLO: <250.000µs 📉 -14.6%) vs baseline: ~same

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +5.0%

✅ 100-count-metrics-100-times

Time: ✅ 20.056ms (SLO: <22.000ms -8.8%) vs baseline: -0.4%

Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +4.5%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.236ms (SLO: <2.300ms -2.8%) vs baseline: -0.4%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.401ms (SLO: <1.550ms -9.6%) vs baseline: -0.6%

Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +4.7%

✅ 100-rate-metrics-100-times

Time: ✅ 2.192ms (SLO: <2.550ms 📉 -14.0%) vs baseline: +0.4%

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.9%

✅ flush-1-metric

Time: ✅ 4.816µs (SLO: <20.000µs 📉 -75.9%) vs baseline: +8.5%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.9%

✅ flush-100-metrics

Time: ✅ 174.046µs (SLO: <250.000µs 📉 -30.4%) vs baseline: -0.4%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ flush-1000-metrics

Time: ✅ 2.101ms (SLO: <2.500ms 📉 -16.0%) vs baseline: -0.6%

Memory: ✅ 35.311MB (SLO: <36.500MB -3.3%) vs baseline: +4.9%

✅ tracer - 6/6

✅ large

Time: ✅ 28.998ms (SLO: <32.950ms 📉 -12.0%) vs baseline: +0.4%

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +4.9%

✅ medium

Time: ✅ 2.902ms (SLO: <3.200ms -9.3%) vs baseline: +0.6%

Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +4.6%

✅ small

Time: ✅ 325.225µs (SLO: <370.000µs 📉 -12.1%) vs baseline: +0.3%

Memory: ✅ 34.623MB (SLO: <35.500MB -2.5%) vs baseline: +5.1%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

sabrenner added 3 commits December 17, 2025 16:12

add in deprecations for logs -> raising errors in llmobs sdk where ap…

e5dbca7

…propriate

release note

d50337b

Merge branch '3.19' of github.com:DataDog/dd-trace-py into sabrenner/…

fc2e738

…llmobs-raise-errors-deprecations

brettlangdon approved these changes Jan 5, 2026

View reviewed changes

sabrenner marked this pull request as ready for review January 5, 2026 14:04

sabrenner requested review from a team as code owners January 5, 2026 14:04

sabrenner requested review from avara1986 and taegyunkim January 5, 2026 14:04

Yun-Kim approved these changes Jan 5, 2026

View reviewed changes

Kyle-Verhoog approved these changes Jan 5, 2026

View reviewed changes

sabrenner enabled auto-merge (squash) January 5, 2026 19:03

Merge branch '3.19' into sabrenner/llmobs-raise-errors-deprecations

64080a2

sabrenner merged commit 5d5fd8d into 3.19 Jan 6, 2026
496 checks passed

sabrenner deleted the sabrenner/llmobs-raise-errors-deprecations branch January 6, 2026 19:06

chore(llmobs): deprecate warning and error logs on misuse of llm observability sdk #15838

chore(llmobs): deprecate warning and error logs on misuse of llm observability sdk #15838

Conversation

sabrenner commented Jan 5, 2026

Description

Testing

Risks

Uh oh!

github-actions bot commented Jan 5, 2026

Uh oh!

github-actions bot commented Jan 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Jan 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ add_aspect

✅ add_inplace_aspect

✅ add_inplace_noaspect

✅ add_noaspect

✅ bytearray_aspect

✅ bytearray_extend_aspect

✅ bytearray_extend_noaspect

✅ bytearray_noaspect

✅ bytes_aspect

✅ bytes_noaspect

✅ bytesio_aspect

✅ bytesio_noaspect

✅ capitalize_aspect

✅ capitalize_noaspect

✅ casefold_aspect

✅ casefold_noaspect

✅ decode_aspect

✅ decode_noaspect

✅ encode_aspect

✅ encode_noaspect

✅ format_aspect

✅ format_map_aspect

✅ format_map_noaspect

✅ format_noaspect

✅ index_aspect

✅ index_noaspect

✅ join_aspect

✅ join_noaspect

✅ ljust_aspect

✅ ljust_noaspect

✅ lower_aspect

✅ lower_noaspect

✅ lstrip_aspect

✅ lstrip_noaspect

✅ modulo_aspect

✅ modulo_aspect_for_bytearray_bytearray

✅ modulo_aspect_for_bytes

✅ modulo_aspect_for_bytes_bytearray

✅ modulo_noaspect

✅ replace_aspect

✅ replace_noaspect

✅ repr_aspect

✅ repr_noaspect

✅ rstrip_aspect

✅ rstrip_noaspect

✅ slice_aspect

✅ slice_noaspect

✅ stringio_aspect

✅ stringio_noaspect

✅ strip_aspect

✅ strip_noaspect

✅ swapcase_aspect

✅ swapcase_noaspect

✅ title_aspect

✅ title_noaspect

✅ translate_aspect

✅ translate_noaspect

✅ upper_aspect

✅ upper_noaspect

✅ ospathbasename_aspect

✅ ospathbasename_noaspect

github-actions bot commented Jan 5, 2026 •

edited

Loading

pr-commenter bot commented Jan 5, 2026 •

edited

Loading