Skip to content

Update OTLP trace metrics parametric tests to align with JS and .NET implementations#7217

Merged
mabdinur merged 4 commits into
mainfrom
munir/otlp-trace-metrics-dotnet
Jul 1, 2026
Merged

Update OTLP trace metrics parametric tests to align with JS and .NET implementations#7217
mabdinur merged 4 commits into
mainfrom
munir/otlp-trace-metrics-dotnet

Conversation

@mabdinur

@mabdinur mabdinur commented Jun 25, 2026

Copy link
Copy Markdown
Contributor

Summary

Activates tests/parametric/test_otlp_trace_metrics.py for the .NET tracer, replacing the whole-file missing_feature skip in manifests/dotnet.yml with targeted per-test skips for the two features the tracer does not emit yet.

  • Run against dd-trace-dotnet munir/otlp-span-metrics (OTLP trace metrics over HTTP/JSON): 43 passed / 2 skipped-as-missing_feature.
  • fr01_5 now asserts the span-duration metric specifically (other OTLP metrics such as runtime metrics may legitimately be present).
  • fr02_3 and fr15 now key off the real span flush (X-Datadog-Trace-Count > 0) rather than empty keep-alive payloads, via a new _span_carrying_trace_requests helper.
  • Removed the fr06_6 (rpc.method) case (feature not planned for this iteration).
  • Updates test_fr06_7_rpc_status_code to assert the string value of grpc statuses (ABORT, CANCELLED, OK) instead of it's corresponding int value, this better aligns with the otel spec.

Manifest skips (dotnet)

  • Test_FR06_Otel_Resource_Attributes::test_fr06_10_hostnamehost.name not yet reported on the OTLP trace metrics resource.
  • Test_FR08_Datadog_Attributes::test_fr08_8_process_tags — process tags not yet emitted on the OTLP trace metrics resource.

Test plan

  • TEST_LIBRARY=dotnet ./run.sh PARAMETRIC -k test_otlp_trace_metrics is green (the two skips above are expected).
  • ./format.sh passes.

Made with Cursor

Activate tests/parametric/test_otlp_trace_metrics.py for dotnet (replacing the
whole-file missing_feature skip). The span-duration check (fr01_5) and the
client-computed-stats checks (fr02_3, fr15) now key off the real span flush, and
the unimplemented fr06_6 (rpc.method) case is removed. host.name (fr06_10) and
process tags (fr08_8) remain skipped as missing_feature until the tracer emits them.

Co-authored-by: Cursor <cursoragent@cursor.com>
@mabdinur mabdinur requested review from a team as code owners June 25, 2026 21:10
@mabdinur mabdinur requested review from zacharycmontoya and removed request for a team June 25, 2026 21:10
@github-actions

Copy link
Copy Markdown
Contributor

CODEOWNERS have been resolved as:

manifests/dotnet.yml                                                    @DataDog/apm-dotnet @DataDog/asm-dotnet
tests/parametric/test_otlp_trace_metrics.py                             @DataDog/system-tests-core @DataDog/apm-sdk-capabilities

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 958fe9be73

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread manifests/dotnet.yml
Comment thread tests/parametric/test_otlp_trace_metrics.py Outdated
Comment thread tests/parametric/test_otlp_trace_metrics.py
@datadog-datadog-prod-us1

datadog-datadog-prod-us1 Bot commented Jun 25, 2026

Copy link
Copy Markdown

Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 5062729 | Docs | Datadog PR Page | Give us feedback!

Comment thread manifests/dotnet.yml
mabdinur and others added 2 commits June 25, 2026 17:15
- fr01_5 now polls the full flush window and fails only if the span-duration
  metric ever appears, so an unrelated OTLP metric (e.g. runtime metrics) can
  no longer mask a regression.
- Fix YAML indentation of the test_otlp_trace_metrics.py missing_feature
  entries in manifests/dotnet.yml.

test_fr06_6_rpc_method is intentionally left removed (no longer in the RFC).

Co-authored-by: Cursor <cursoragent@cursor.com>
@mabdinur mabdinur marked this pull request as draft June 25, 2026 21:29
@mabdinur

Copy link
Copy Markdown
Contributor Author

Blocked by: DataDog/dd-trace-dotnet#8826

@mabdinur mabdinur changed the title Enable OTLP trace metrics parametric tests for .NET Update OTLP trace metrics parametric tests to align with JS and .NET implementations Jun 30, 2026
@mabdinur mabdinur marked this pull request as ready for review June 30, 2026 21:04
@mabdinur mabdinur enabled auto-merge (squash) July 1, 2026 15:23
@mabdinur mabdinur merged commit b99816f into main Jul 1, 2026
440 checks passed
@mabdinur mabdinur deleted the munir/otlp-trace-metrics-dotnet branch July 1, 2026 15:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants