Skip to content

Add Android/Robolectric visibility to Test Optimization spans#11852

Draft
daniel-mohedano wants to merge 14 commits into
masterfrom
daniel.mohedano/android-robolectric
Draft

Add Android/Robolectric visibility to Test Optimization spans#11852
daniel-mohedano wants to merge 14 commits into
masterfrom
daniel.mohedano/android-robolectric

Conversation

@daniel-mohedano

@daniel-mohedano daniel-mohedano commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

  • Implements additional visibility to test spans for test emulated with the Android SDK through Robolectric. These tests are already traced OOTB as JUnit4 tests.
    • New per-test span tags:
      • test.android.api_level
      • test.android.release
      • test.android.codename
      • test.android.robolectric.version
    • New is_android_emulated boolean field on the test_event_finished telemetry metric.
  • Adds a new GradleDaemonSmokeTest test to validate the new instrumentation and tagging. It covers both @RunWith(RobolectricTestRunner.class) and @RunWith(AndroidJUnit4.class).

Motivation

With Android tests already being supported OOTB, these changes provide better visibility for customers using the Robolectric framework.

Additional Notes

test-environment-trigger: skip

Contributor Checklist

  • Format the title according to the contribution guidelines
  • Assign the type: and (comp: or inst:) labels in addition to any other useful labels
  • Avoid using close, fix, or any linking keywords when referencing an issue
    Use solves instead, and assign the PR milestone to the issue
  • Update the CODEOWNERS file on source file addition, migration, or deletion
  • Update public documentation with any new configuration flags or behaviors
  • Add your completed PR to the merge queue by commenting /merge. You can also:
    • Customize the commit message associated with the merge with /merge --commit-message "..."
    • Remove your PR from the merge queue with /merge -c
    • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level (note: the PR still needs to be mergeable, this will only skip the pre-merge build)
    • Get more information in this doc

Jira ticket: SDTEST-3887 [SDTEST-3888] [SDTEST-3889]

@daniel-mohedano daniel-mohedano added type: feature Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Jul 3, 2026
@daniel-mohedano daniel-mohedano changed the title Report additional information for Android tests with Robolectric Add Android/Robolectric visibility to Test Optimization spans Jul 3, 2026
@datadog-datadog-us1-prod

This comment has been minimized.

@dd-octo-sts

dd-octo-sts Bot commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 13.94 s 13.99 s [-0.9%; +0.3%] (no difference)
startup:insecure-bank:tracing:Agent 12.84 s 13.03 s [-2.2%; -0.8%] (maybe better)
startup:petclinic:appsec:Agent 16.86 s 16.65 s [+0.4%; +2.1%] (maybe worse)
startup:petclinic:iast:Agent 16.31 s 16.94 s [-8.0%; +0.6%] (no difference)
startup:petclinic:profiling:Agent 16.64 s 16.69 s [-1.3%; +0.6%] (no difference)
startup:petclinic:sca:Agent 16.89 s 16.80 s [-0.5%; +1.6%] (no difference)
startup:petclinic:tracing:Agent 16.15 s 16.22 s [-1.5%; +0.6%] (no difference)

Commit: 757ad2c1 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@daniel-mohedano daniel-mohedano force-pushed the daniel.mohedano/android-robolectric branch from 4d4dc9e to 1b228ee Compare July 8, 2026 09:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: ci visibility Continuous Integration Visibility type: feature Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant