Skip to content

Add AGP usage visibility for Gradle projects#11869

Draft
daniel-mohedano wants to merge 3 commits into
daniel.mohedano/android-robolectricfrom
daniel.mohedano/agp-visibility
Draft

Add AGP usage visibility for Gradle projects#11869
daniel-mohedano wants to merge 3 commits into
daniel.mohedano/android-robolectricfrom
daniel.mohedano/agp-visibility

Conversation

@daniel-mohedano

@daniel-mohedano daniel-mohedano commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

  • Implements additional visibility for session and module spans in Gradle projects making use of the Android Gradle Plugin. Our Gradle instrumentation will consider "Android Projects" those containing the com.android.base plugin in their used plugins.
    • New test.is_android tag is added to module spans and propagated to session spans with an OR operation.
    • New is_android boolean field on the event_finished telemetry metric.

Motivation

Together with #11852, the changes aim to provide better visibility for Android users using Test Optimization. In this case, it provides visibility on the overall Android user base, even if they don't use Robolectric emulation for unit tests.

Contributor Checklist

  • Format the title according to the contribution guidelines
  • Assign the type: and (comp: or inst:) labels in addition to any other useful labels
  • Avoid using close, fix, or any linking keywords when referencing an issue
    Use solves instead, and assign the PR milestone to the issue
  • Update the CODEOWNERS file on source file addition, migration, or deletion
  • Update public documentation with any new configuration flags or behaviors
  • Add your completed PR to the merge queue by commenting /merge. You can also:
    • Customize the commit message associated with the merge with /merge --commit-message "..."
    • Remove your PR from the merge queue with /merge -c
    • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level (note: the PR still needs to be mergeable, this will only skip the pre-merge build)
    • Get more information in this doc

Jira ticket: SDTEST-3887

@daniel-mohedano daniel-mohedano added type: feature Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Jul 6, 2026
@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - sbt-scalatest

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 55.60 54.33 $\color{red}{\blacktriangle}$ +1.27 54.33 $\color{red}{\blacktriangle}$ +1.27 52/210
agentEvpProxy 54.64 n/a n/a n/a n/a -

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@datadog-datadog-us1-prod

datadog-datadog-us1-prod Bot commented Jul 6, 2026

Copy link
Copy Markdown

🎯 Code Coverage (details)
Patch Coverage: 12.50%
Overall Coverage: 56.92% (-0.00%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 6b9bc56 | Docs | Datadog PR Page | Give us feedback!

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - pass4s

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 11.96 10.54 $\color{red}{\blacktriangle}$ +1.42 10.33 $\color{red}{\blacktriangle}$ +1.63 27/105
agentless 11.26 10.75 $\color{red}{\blacktriangle}$ +0.51 9.73 $\color{red}{\blacktriangle}$ +1.53 27/105
agentlessCodeCoverage 22.08 17.03 $\color{red}{\blacktriangle}$ +5.05 17.73 $\color{red}{\blacktriangle}$ +4.35 26/103

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - nebula-release-plugin

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 37.26 36.42 $\color{red}{\blacktriangle}$ +0.84 36.42 $\color{red}{\blacktriangle}$ +0.84 28/104
agentless 35.29 36.42 $\color{green}{\blacktriangledown}$ -1.13 35.70 $\color{green}{\blacktriangledown}$ -0.41 28/104
agentlessCodeCoverage 45.57 44.48 $\color{red}{\blacktriangle}$ +1.09 44.48 $\color{red}{\blacktriangle}$ +1.09 28/104
agentlessLineCoverage 72.79 74.82 $\color{green}{\blacktriangledown}$ -2.03 74.82 $\color{green}{\blacktriangledown}$ -2.03 27/103

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - reactive-streams-jvm

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 22.23 22.09 $\color{red}{\blacktriangle}$ +0.14 21.65 $\color{red}{\blacktriangle}$ +0.58 29/130
agentless 18.27 18.82 $\color{green}{\blacktriangledown}$ -0.55 18.82 $\color{green}{\blacktriangledown}$ -0.55 29/128
agentlessCodeCoverage 20.46 19.99 $\color{red}{\blacktriangle}$ +0.47 19.99 $\color{red}{\blacktriangle}$ +0.47 28/127
agentlessLineCoverage 30.69 30.42 $\color{red}{\blacktriangle}$ +0.27 29.82 $\color{red}{\blacktriangle}$ +0.87 28/127

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - netflix-zuul

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 86.57 87.80 $\color{green}{\blacktriangledown}$ -1.23 86.07 $\color{red}{\blacktriangle}$ +0.50 29/127
agentless 80.57 81.05 $\color{green}{\blacktriangledown}$ -0.48 81.05 $\color{green}{\blacktriangledown}$ -0.48 30/128
agentlessCodeCoverage 95.34 95.12 $\color{red}{\blacktriangle}$ +0.22 95.12 $\color{red}{\blacktriangle}$ +0.22 29/124
agentlessLineCoverage 111.55 111.62 $\color{green}{\blacktriangledown}$ -0.07 111.62 $\color{green}{\blacktriangledown}$ -0.07 28/123

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@daniel-mohedano daniel-mohedano force-pushed the daniel.mohedano/agp-visibility branch from bec0bb1 to 2d4c049 Compare July 6, 2026 14:10
@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - sonar-kotlin

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 11.94 13.13 $\color{green}{\blacktriangledown}$ -1.19 13.13 $\color{green}{\blacktriangledown}$ -1.19 30/107
agentless 11.60 12.37 $\color{green}{\blacktriangledown}$ -0.77 12.12 $\color{green}{\blacktriangledown}$ -0.52 30/106
agentlessCodeCoverage 15.03 15.11 $\color{green}{\blacktriangledown}$ -0.08 15.11 $\color{green}{\blacktriangledown}$ -0.08 30/106
agentlessLineCoverage 18.31 19.59 $\color{green}{\blacktriangledown}$ -1.28 19.20 $\color{green}{\blacktriangledown}$ -0.89 29/106

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - jolokia

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 94.74 93.23 $\color{red}{\blacktriangle}$ +1.51 93.23 $\color{red}{\blacktriangle}$ +1.51 28/110
agentless 90.06 89.58 $\color{red}{\blacktriangle}$ +0.48 89.58 $\color{red}{\blacktriangle}$ +0.48 27/108
agentlessCodeCoverage 100.72 99.00 $\color{red}{\blacktriangle}$ +1.72 99.00 $\color{red}{\blacktriangle}$ +1.72 28/107
agentlessLineCoverage 103.12 99.00 $\color{red}{\blacktriangle}$ +4.12 99.00 $\color{red}{\blacktriangle}$ +4.12 27/106

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@dd-octo-sts

dd-octo-sts Bot commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 14.82 s 14.61 s [+0.4%; +2.5%] (maybe worse)
startup:insecure-bank:tracing:Agent 13.56 s 13.65 s [-1.4%; +0.1%] (no difference)
startup:petclinic:appsec:Agent 16.89 s 16.87 s [-0.7%; +1.0%] (no difference)
startup:petclinic:iast:Agent 16.95 s 16.94 s [-0.8%; +0.9%] (no difference)
startup:petclinic:profiling:Agent 16.65 s 16.81 s [-2.2%; +0.2%] (no difference)
startup:petclinic:sca:Agent 16.99 s 16.87 s [-0.3%; +1.8%] (no difference)
startup:petclinic:tracing:Agent 16.18 s 16.11 s [-0.8%; +1.6%] (no difference)

Commit: 6b9bc561 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - okhttp

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 19.50 19.20 $\color{red}{\blacktriangle}$ +0.30 19.59 $\color{green}{\blacktriangledown}$ -0.09 28/113
agentless 20.51 19.20 $\color{red}{\blacktriangle}$ +1.31 19.20 $\color{red}{\blacktriangle}$ +1.31 27/111
agentlessCodeCoverage 23.37 22.09 $\color{red}{\blacktriangle}$ +1.28 22.09 $\color{red}{\blacktriangle}$ +1.28 28/110
agentlessLineCoverage 45.70 44.48 $\color{red}{\blacktriangle}$ +1.22 44.48 $\color{red}{\blacktriangle}$ +1.22 29/116

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - spring_boot

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 16.33 16.36 $\color{green}{\blacktriangledown}$ -0.03 16.04 $\color{red}{\blacktriangle}$ +0.29 28/102
agentless 9.53 9.73 $\color{green}{\blacktriangledown}$ -0.20 9.73 $\color{green}{\blacktriangledown}$ -0.20 29/103
agentlessCodeCoverage 13.12 13.13 $\color{green}{\blacktriangledown}$ -0.01 13.13 $\color{green}{\blacktriangledown}$ -0.01 28/101
agentlessLineCoverage 32.81 32.95 $\color{green}{\blacktriangledown}$ -0.14 32.30 $\color{red}{\blacktriangle}$ +0.51 28/102

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - sonar-java

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 15.93 17.73 $\color{green}{\blacktriangledown}$ -1.80 15.72 $\color{red}{\blacktriangle}$ +0.21 27/108
agentless 5.33 22.99 $\color{green}{\blacktriangledown}$ -17.66 17.73 $\color{green}{\blacktriangledown}$ -12.40 27/107
agentlessCodeCoverage 92.15 91.39 $\color{red}{\blacktriangle}$ +0.76 87.80 $\color{red}{\blacktriangle}$ +4.35 27/107
agentlessLineCoverage 114.30 147.69 $\color{green}{\blacktriangledown}$ -33.39 141.90 $\color{green}{\blacktriangledown}$ -27.60 27/107

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - heliboard

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 8.19 9.35 $\color{green}{\blacktriangledown}$ -1.16 9.35 $\color{green}{\blacktriangledown}$ -1.16 7/7

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: ci visibility Continuous Integration Visibility type: feature Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant