Add support for JUnit 5.13-RC1 #8865

daniel-mohedano · 2025-05-22T08:19:59Z

What Does This Do

Updates JUnit 5 instrumentation to reflect changes introduced in version 5.13-RC1 to org.junit.platform.engine.ExecutionRequest, adding two new fields to the class, at least one of them required for the execution of tests. The instrumentation now chooses the available method to create objects of the class through reflection.

Motivation

Unblocks #8842

Additional Notes

Tested locally by upgrading the gradle dependencies on junit-5.3 and junit-5.8 instrumentations and running both test and latestDepTest.

Passing results for junit-5.3:

Passing results for junit-5.8:

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-05-22T08:53:01Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/junit5-execution-request-fix
git_commit_date	1747901310	1747901594
git_commit_sha	`8e7b515`	`a08d100`
release_version	1.50.0-SNAPSHOT~8e7b515c37	1.50.0-SNAPSHOT~a08d1007c4

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747903933	1747903933
ci_job_id	949570563	949570563
ci_pipeline_id	65823270	65823270
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner--hkbl4tc-project-304-concurrent-2-uxe3nc4y 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner--hkbl4tc-project-304-concurrent-2-uxe3nc4y 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 54 metrics, 16 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:petclinic:profiling:GlobalTracer	worse [+8.908ms; +17.549ms] or [+2.466%; +4.858%]	374.490ms	361.262ms

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020538
Total [baseline] (8.642 s) : 0, 8642340
Agent [candidate] (1.026 s) : 0, 1025779
Total [candidate] (8.646 s) : 0, 8646413
section iast
Agent [baseline] (1.151 s) : 0, 1150747
Total [baseline] (9.226 s) : 0, 9225719
Agent [candidate] (1.153 s) : 0, 1152672
Total [candidate] (9.211 s) : 0, 9210645
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.156 s) : 0, 1156213
Total [baseline] (9.187 s) : 0, 9186862
Agent [candidate] (1.15 s) : 0, 1149683
Total [candidate] (9.185 s) : 0, 9184776
section iast_TELEMETRY_OFF
Agent [baseline] (1.147 s) : 0, 1147354
Total [baseline] (9.224 s) : 0, 9223544
Agent [candidate] (1.144 s) : 0, 1143852
Total [candidate] (9.176 s) : 0, 9176192

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.021 s	-
Agent	iast	1.151 s	130.21 ms (12.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.156 s	135.675 ms (13.3%)
Agent	iast_TELEMETRY_OFF	1.147 s	126.816 ms (12.4%)
Total	tracing	8.642 s	-
Total	iast	9.226 s	583.379 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.187 s	544.522 ms (6.3%)
Total	iast_TELEMETRY_OFF	9.224 s	581.204 ms (6.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.026 s	-
Agent	iast	1.153 s	126.893 ms (12.4%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.15 s	123.904 ms (12.1%)
Agent	iast_TELEMETRY_OFF	1.144 s	118.073 ms (11.5%)
Total	tracing	8.646 s	-
Total	iast	9.211 s	564.232 ms (6.5%)
Total	iast_HARDCODED_SECRET_DISABLED	9.185 s	538.362 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.176 s	529.779 ms (6.1%)

gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.113 ms) : 0, 682113
BytebuddyAgent [candidate] (686.927 ms) : 0, 686927
GlobalTracer [baseline] (239.941 ms) : 0, 239941
GlobalTracer [candidate] (241.525 ms) : 0, 241525
AppSec [baseline] (54.257 ms) : 0, 54257
AppSec [candidate] (55.592 ms) : 0, 55592
Debugger [baseline] (9.604 ms) : 0, 9604
Debugger [candidate] (8.283 ms) : 0, 8283
Remote Config [baseline] (694.046 µs) : 0, 694
Remote Config [candidate] (703.269 µs) : 0, 703
Telemetry [baseline] (10.436 ms) : 0, 10436
Telemetry [candidate] (9.078 ms) : 0, 9078
section iast
BytebuddyAgent [baseline] (803.152 ms) : 0, 803152
BytebuddyAgent [candidate] (806.101 ms) : 0, 806101
GlobalTracer [baseline] (230.716 ms) : 0, 230716
GlobalTracer [candidate] (230.849 ms) : 0, 230849
IAST [baseline] (26.068 ms) : 0, 26068
IAST [candidate] (28.927 ms) : 0, 28927
AppSec [baseline] (50.624 ms) : 0, 50624
AppSec [candidate] (48.937 ms) : 0, 48937
Debugger [baseline] (5.907 ms) : 0, 5907
Debugger [candidate] (5.818 ms) : 0, 5818
Remote Config [baseline] (593.11 µs) : 0, 593
Remote Config [candidate] (578.545 µs) : 0, 579
Telemetry [baseline] (7.852 ms) : 0, 7852
Telemetry [candidate] (7.809 ms) : 0, 7809
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (807.355 ms) : 0, 807355
BytebuddyAgent [candidate] (801.657 ms) : 0, 801657
GlobalTracer [baseline] (232.14 ms) : 0, 232140
GlobalTracer [candidate] (231.017 ms) : 0, 231017
IAST [baseline] (29.885 ms) : 0, 29885
IAST [candidate] (27.764 ms) : 0, 27764
AppSec [baseline] (48.716 ms) : 0, 48716
AppSec [candidate] (51.275 ms) : 0, 51275
Debugger [baseline] (5.887 ms) : 0, 5887
Debugger [candidate] (5.887 ms) : 0, 5887
Remote Config [baseline] (602.205 µs) : 0, 602
Remote Config [candidate] (578.533 µs) : 0, 579
Telemetry [baseline] (7.965 ms) : 0, 7965
Telemetry [candidate] (7.909 ms) : 0, 7909
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.113 ms) : 0, 798113
BytebuddyAgent [candidate] (797.804 ms) : 0, 797804
GlobalTracer [baseline] (232.297 ms) : 0, 232297
GlobalTracer [candidate] (230.455 ms) : 0, 230455
IAST [baseline] (23.371 ms) : 0, 23371
IAST [candidate] (22.23 ms) : 0, 22230
AppSec [baseline] (55.507 ms) : 0, 55507
AppSec [candidate] (55.569 ms) : 0, 55569
Debugger [baseline] (6.008 ms) : 0, 6008
Debugger [candidate] (5.902 ms) : 0, 5902
Remote Config [baseline] (607.025 µs) : 0, 607
Remote Config [candidate] (596.621 µs) : 0, 597
Telemetry [baseline] (7.857 ms) : 0, 7857
Telemetry [candidate] (7.75 ms) : 0, 7750

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020848
Total [baseline] (10.429 s) : 0, 10428549
Agent [candidate] (1.031 s) : 0, 1031400
Total [candidate] (10.484 s) : 0, 10484230
section appsec
Agent [baseline] (1.168 s) : 0, 1167919
Total [baseline] (10.652 s) : 0, 10652238
Agent [candidate] (1.165 s) : 0, 1164762
Total [candidate] (10.657 s) : 0, 10657252
section iast
Agent [baseline] (1.153 s) : 0, 1152587
Total [baseline] (10.851 s) : 0, 10851071
Agent [candidate] (1.156 s) : 0, 1155568
Total [candidate] (10.828 s) : 0, 10828150
section profiling
Agent [baseline] (1.269 s) : 0, 1269323
Total [baseline] (10.821 s) : 0, 10821187
Agent [candidate] (1.279 s) : 0, 1279099
Total [candidate] (10.818 s) : 0, 10818208

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.021 s	-
Agent	appsec	1.168 s	147.071 ms (14.4%)
Agent	iast	1.153 s	131.739 ms (12.9%)
Agent	profiling	1.269 s	248.475 ms (24.3%)
Total	tracing	10.429 s	-
Total	appsec	10.652 s	223.688 ms (2.1%)
Total	iast	10.851 s	422.521 ms (4.1%)
Total	profiling	10.821 s	392.638 ms (3.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.031 s	-
Agent	appsec	1.165 s	133.362 ms (12.9%)
Agent	iast	1.156 s	124.168 ms (12.0%)
Agent	profiling	1.279 s	247.699 ms (24.0%)
Total	tracing	10.484 s	-
Total	appsec	10.657 s	173.022 ms (1.7%)
Total	iast	10.828 s	343.921 ms (3.3%)
Total	profiling	10.818 s	333.979 ms (3.2%)

gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.8 ms) : 0, 682800
BytebuddyAgent [candidate] (691.571 ms) : 0, 691571
GlobalTracer [baseline] (240.313 ms) : 0, 240313
GlobalTracer [candidate] (241.542 ms) : 0, 241542
AppSec [baseline] (55.205 ms) : 0, 55205
AppSec [candidate] (55.534 ms) : 0, 55534
Debugger [baseline] (7.615 ms) : 0, 7615
Debugger [candidate] (7.65 ms) : 0, 7650
Remote Config [baseline] (696.198 µs) : 0, 696
Remote Config [candidate] (720.388 µs) : 0, 720
Telemetry [baseline] (10.53 ms) : 0, 10530
Telemetry [candidate] (10.731 ms) : 0, 10731
section appsec
BytebuddyAgent [baseline] (704.606 ms) : 0, 704606
BytebuddyAgent [candidate] (702.281 ms) : 0, 702281
GlobalTracer [baseline] (238.246 ms) : 0, 238246
GlobalTracer [candidate] (237.718 ms) : 0, 237718
IAST [baseline] (21.946 ms) : 0, 21946
IAST [candidate] (21.937 ms) : 0, 21937
AppSec [baseline] (175.535 ms) : 0, 175535
AppSec [candidate] (176.285 ms) : 0, 176285
Debugger [baseline] (6.363 ms) : 0, 6363
Debugger [candidate] (5.936 ms) : 0, 5936
Remote Config [baseline] (621.473 µs) : 0, 621
Remote Config [candidate] (623.646 µs) : 0, 624
Telemetry [baseline] (7.786 ms) : 0, 7786
Telemetry [candidate] (7.38 ms) : 0, 7380
section iast
BytebuddyAgent [baseline] (804.109 ms) : 0, 804109
BytebuddyAgent [candidate] (807.656 ms) : 0, 807656
GlobalTracer [baseline] (231.23 ms) : 0, 231230
GlobalTracer [candidate] (231.143 ms) : 0, 231143
IAST [baseline] (28.578 ms) : 0, 28578
IAST [candidate] (27.541 ms) : 0, 27541
AppSec [baseline] (50.592 ms) : 0, 50592
AppSec [candidate] (51.224 ms) : 0, 51224
Debugger [baseline] (5.951 ms) : 0, 5951
Debugger [candidate] (5.921 ms) : 0, 5921
Remote Config [baseline] (583.641 µs) : 0, 584
Remote Config [candidate] (595.896 µs) : 0, 596
Telemetry [baseline] (7.905 ms) : 0, 7905
Telemetry [candidate] (7.862 ms) : 0, 7862
section profiling
BytebuddyAgent [baseline] (676.359 ms) : 0, 676359
BytebuddyAgent [candidate] (672.392 ms) : 0, 672392
GlobalTracer [baseline] (361.262 ms) : 0, 361262
GlobalTracer [candidate] (374.49 ms) : 0, 374490
AppSec [baseline] (62.277 ms) : 0, 62277
AppSec [candidate] (62.434 ms) : 0, 62434
Debugger [baseline] (6.337 ms) : 0, 6337
Debugger [candidate] (6.369 ms) : 0, 6369
Remote Config [baseline] (662.692 µs) : 0, 663
Remote Config [candidate] (683.124 µs) : 0, 683
Telemetry [baseline] (8.268 ms) : 0, 8268
Telemetry [candidate] (8.297 ms) : 0, 8297
ProfilingAgent [baseline] (103.345 ms) : 0, 103345
ProfilingAgent [candidate] (103.687 ms) : 0, 103687
Profiling [baseline] (103.37 ms) : 0, 103370
Profiling [candidate] (103.711 ms) : 0, 103711

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-05-22T08:24:34	2025-05-22T08:32:18
git_branch	master	daniel.mohedano/junit5-execution-request-fix
git_commit_date	1747901310	1747901594
git_commit_sha	`8e7b515`	`a08d100`
release_version	1.50.0-SNAPSHOT~8e7b515c37	1.50.0-SNAPSHOT~a08d1007c4
start_time	2025-05-22T08:24:20	2025-05-22T08:32:04

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747903136	1747903136
ci_job_id	949570564	949570564
ci_pipeline_id	65823270	65823270
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-wra86y3r-project-304-concurrent-4-wxub48iv 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-wra86y3r-project-304-concurrent-4-wxub48iv 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (385.543 µs) : 364, 408
.   : milestone, 386,
iast (518.06 µs) : 496, 540
.   : milestone, 518,
iast_FULL (735.202 µs) : 713, 757
.   : milestone, 735,
iast_GLOBAL (580.782 µs) : 558, 604
.   : milestone, 581,
iast_HARDCODED_SECRET_DISABLED (515.04 µs) : 492, 538
.   : milestone, 515,
iast_INACTIVE (473.895 µs) : 449, 499
.   : milestone, 474,
iast_TELEMETRY_OFF (507.04 µs) : 484, 530
.   : milestone, 507,
tracing (459.08 µs) : 437, 481
.   : milestone, 459,
section candidate
no_agent (376.322 µs) : 356, 396
.   : milestone, 376,
iast (521.832 µs) : 500, 543
.   : milestone, 522,
iast_FULL (732.4 µs) : 710, 754
.   : milestone, 732,
iast_GLOBAL (569.757 µs) : 548, 592
.   : milestone, 570,
iast_HARDCODED_SECRET_DISABLED (517.52 µs) : 495, 540
.   : milestone, 518,
iast_INACTIVE (466.902 µs) : 444, 489
.   : milestone, 467,
iast_TELEMETRY_OFF (512.128 µs) : 489, 535
.   : milestone, 512,
tracing (457.373 µs) : 435, 479
.   : milestone, 457,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	385.543 µs [363.569 µs, 407.518 µs]	-
iast	518.06 µs [496.089 µs, 540.032 µs]	132.517 µs (34.4%)
iast_FULL	735.202 µs [713.387 µs, 757.017 µs]	349.659 µs (90.7%)
iast_GLOBAL	580.782 µs [557.962 µs, 603.602 µs]	195.239 µs (50.6%)
iast_HARDCODED_SECRET_DISABLED	515.04 µs [491.809 µs, 538.271 µs]	129.496 µs (33.6%)
iast_INACTIVE	473.895 µs [448.965 µs, 498.824 µs]	88.351 µs (22.9%)
iast_TELEMETRY_OFF	507.04 µs [484.117 µs, 529.963 µs]	121.496 µs (31.5%)
tracing	459.08 µs [436.861 µs, 481.299 µs]	73.537 µs (19.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	376.322 µs [356.343 µs, 396.301 µs]	-
iast	521.832 µs [500.172 µs, 543.492 µs]	145.51 µs (38.7%)
iast_FULL	732.4 µs [710.348 µs, 754.452 µs]	356.077 µs (94.6%)
iast_GLOBAL	569.757 µs [547.752 µs, 591.762 µs]	193.435 µs (51.4%)
iast_HARDCODED_SECRET_DISABLED	517.52 µs [494.859 µs, 540.182 µs]	141.198 µs (37.5%)
iast_INACTIVE	466.902 µs [444.461 µs, 489.343 µs]	90.58 µs (24.1%)
iast_TELEMETRY_OFF	512.128 µs [489.286 µs, 534.97 µs]	135.806 µs (36.1%)
tracing	457.373 µs [435.264 µs, 479.482 µs]	81.05 µs (21.5%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1373
.   : milestone, 1354,
appsec (1.731 ms) : 1708, 1755
.   : milestone, 1731,
appsec_no_iast (1.719 ms) : 1695, 1743
.   : milestone, 1719,
code_origins (1.657 ms) : 1630, 1684
.   : milestone, 1657,
iast (1.51 ms) : 1485, 1534
.   : milestone, 1510,
profiling (1.51 ms) : 1486, 1535
.   : milestone, 1510,
tracing (1.497 ms) : 1474, 1520
.   : milestone, 1497,
section candidate
no_agent (1.334 ms) : 1316, 1353
.   : milestone, 1334,
appsec (1.737 ms) : 1713, 1760
.   : milestone, 1737,
appsec_no_iast (1.734 ms) : 1711, 1758
.   : milestone, 1734,
code_origins (1.669 ms) : 1641, 1696
.   : milestone, 1669,
iast (1.51 ms) : 1484, 1535
.   : milestone, 1510,
profiling (1.505 ms) : 1481, 1529
.   : milestone, 1505,
tracing (1.494 ms) : 1470, 1519
.   : milestone, 1494,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.354 ms [1.334 ms, 1.373 ms]	-
appsec	1.731 ms [1.708 ms, 1.755 ms]	377.705 µs (27.9%)
appsec_no_iast	1.719 ms [1.695 ms, 1.743 ms]	365.397 µs (27.0%)
code_origins	1.657 ms [1.63 ms, 1.684 ms]	303.549 µs (22.4%)
iast	1.51 ms [1.485 ms, 1.534 ms]	156.185 µs (11.5%)
profiling	1.51 ms [1.486 ms, 1.535 ms]	156.612 µs (11.6%)
tracing	1.497 ms [1.474 ms, 1.52 ms]	143.453 µs (10.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.334 ms [1.316 ms, 1.353 ms]	-
appsec	1.737 ms [1.713 ms, 1.76 ms]	402.169 µs (30.1%)
appsec_no_iast	1.734 ms [1.711 ms, 1.758 ms]	400.01 µs (30.0%)
code_origins	1.669 ms [1.641 ms, 1.696 ms]	334.084 µs (25.0%)
iast	1.51 ms [1.484 ms, 1.535 ms]	175.343 µs (13.1%)
profiling	1.505 ms [1.481 ms, 1.529 ms]	170.313 µs (12.8%)
tracing	1.494 ms [1.47 ms, 1.519 ms]	159.812 µs (12.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/junit5-execution-request-fix
git_commit_date	1747901310	1747901594
git_commit_sha	`8e7b515`	`a08d100`
release_version	1.50.0-SNAPSHOT~8e7b515c37	1.50.0-SNAPSHOT~a08d1007c4

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1747903698	1747903698
ci_job_id	949570565	949570565
ci_pipeline_id	65823270	65823270
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner--hkbl4tc-project-304-concurrent-3-l8z22qq4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner--hkbl4tc-project-304-concurrent-3-l8z22qq4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.561 s) : 15561000, 15561000
.   : milestone, 15561000,
appsec (14.92 s) : 14920000, 14920000
.   : milestone, 14920000,
iast (18.59 s) : 18590000, 18590000
.   : milestone, 18590000,
iast_GLOBAL (18.11 s) : 18110000, 18110000
.   : milestone, 18110000,
profiling (14.846 s) : 14846000, 14846000
.   : milestone, 14846000,
tracing (15.069 s) : 15069000, 15069000
.   : milestone, 15069000,
section candidate
no_agent (15.235 s) : 15235000, 15235000
.   : milestone, 15235000,
appsec (14.993 s) : 14993000, 14993000
.   : milestone, 14993000,
iast (18.808 s) : 18808000, 18808000
.   : milestone, 18808000,
iast_GLOBAL (18.133 s) : 18133000, 18133000
.   : milestone, 18133000,
profiling (15.668 s) : 15668000, 15668000
.   : milestone, 15668000,
tracing (14.869 s) : 14869000, 14869000
.   : milestone, 14869000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.561 s [15.561 s, 15.561 s]	-
appsec	14.92 s [14.92 s, 14.92 s]	-641.0 ms (-4.1%)
iast	18.59 s [18.59 s, 18.59 s]	3.029 s (19.5%)
iast_GLOBAL	18.11 s [18.11 s, 18.11 s]	2.549 s (16.4%)
profiling	14.846 s [14.846 s, 14.846 s]	-715.0 ms (-4.6%)
tracing	15.069 s [15.069 s, 15.069 s]	-492.0 ms (-3.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.235 s [15.235 s, 15.235 s]	-
appsec	14.993 s [14.993 s, 14.993 s]	-242.0 ms (-1.6%)
iast	18.808 s [18.808 s, 18.808 s]	3.573 s (23.5%)
iast_GLOBAL	18.133 s [18.133 s, 18.133 s]	2.898 s (19.0%)
profiling	15.668 s [15.668 s, 15.668 s]	433.0 ms (2.8%)
tracing	14.869 s [14.869 s, 14.869 s]	-366.0 ms (-2.4%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.387 ms) : 2339, 2435
.   : milestone, 2387,
iast (2.176 ms) : 2115, 2237
.   : milestone, 2176,
iast_GLOBAL (2.214 ms) : 2152, 2275
.   : milestone, 2214,
profiling (2.039 ms) : 1990, 2089
.   : milestone, 2039,
tracing (1.999 ms) : 1952, 2046
.   : milestone, 1999,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (2.398 ms) : 2349, 2447
.   : milestone, 2398,
iast (2.174 ms) : 2113, 2235
.   : milestone, 2174,
iast_GLOBAL (2.215 ms) : 2154, 2276
.   : milestone, 2215,
profiling (2.032 ms) : 1983, 2082
.   : milestone, 2032,
tracing (2.002 ms) : 1955, 2049
.   : milestone, 2002,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	2.387 ms [2.339 ms, 2.435 ms]	910.935 µs (61.7%)
iast	2.176 ms [2.115 ms, 2.237 ms]	699.937 µs (47.4%)
iast_GLOBAL	2.214 ms [2.152 ms, 2.275 ms]	737.267 µs (49.9%)
profiling	2.039 ms [1.99 ms, 2.089 ms]	563.163 µs (38.1%)
tracing	1.999 ms [1.952 ms, 2.046 ms]	522.924 µs (35.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.46 ms, 1.483 ms]	-
appsec	2.398 ms [2.349 ms, 2.447 ms]	926.364 µs (62.9%)
iast	2.174 ms [2.113 ms, 2.235 ms]	702.263 µs (47.7%)
iast_GLOBAL	2.215 ms [2.154 ms, 2.276 ms]	743.166 µs (50.5%)
profiling	2.032 ms [1.983 ms, 2.082 ms]	560.414 µs (38.1%)
tracing	2.002 ms [1.955 ms, 2.049 ms]	529.885 µs (36.0%)

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.49.0` -> `1.50.0` | --- ### Release Notes <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.50.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.50.0): 1.50.0 ### Deprecation Notice > \[!NOTE] > `DD_RUNTIME_ID_ENABLED` has been deprecated and will be removed in future releases. Please use `DD_RUNTIME_METRICS_RUNTIME_ID_ENABLED` instead. ### Components #### Application Security Management (WAF) - 🐛 Add String length truncation limit to ObjectIntrospector and update truncation metrics ([#8825](DataDog/dd-trace-java#8825) - [@jandro996](https://github.com/jandro996)) - 🐛 Adapt standalone ASM to support API Security ([#8804](DataDog/dd-trace-java#8804) - [@jandro996](https://github.com/jandro996)) - ✨ Add appsec.waf.input\_truncated metric ([#8791](DataDog/dd-trace-java#8791) - [@jandro996](https://github.com/jandro996)) - ✨ Extended appsec request body collection ([#8748](DataDog/dd-trace-java#8748) - [@jandro996](https://github.com/jandro996)) - ✨ Extended appsec request/response headers collection ([#8724](DataDog/dd-trace-java#8724) - [@jandro996](https://github.com/jandro996)) #### Build & Tooling - ✨ Add artifacts to public s3 bucket ([#8947](DataDog/dd-trace-java#8947) - [@randomanderson](https://github.com/randomanderson)) #### Continuous Integration Visibility - ✨ Improve PR information building ([#8908](DataDog/dd-trace-java#8908) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Truncate span stack traces when Test Optimization is enabled ([#8903](DataDog/dd-trace-java#8903) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Ensure auto-detected service name is the same for every process in the same build ([#8902](DataDog/dd-trace-java#8902) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Use tag as fallback in api requests if no branch is available ([#8876](DataDog/dd-trace-java#8876) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Add support for JUnit 5.13-RC1 ([#8865](DataDog/dd-trace-java#8865), [#8871](DataDog/dd-trace-java#8871) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Implement attempt to fix v3 and v4 and bump capability version ([#8824](DataDog/dd-trace-java#8824) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - 🧹 Align retry logic for all test framework instrumentations ([#8803](DataDog/dd-trace-java#8803) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - 🐛 Always build ci workspace without trailing separator ([#8788](DataDog/dd-trace-java#8788) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Add commit discrepancies telemetry when building repository git information ([#8763](DataDog/dd-trace-java#8763) - [@daniel-mohedano](https://github.com/daniel-mohedano)) #### Data Streams Monitoring - 💡 Surface process tags in dsm payloads and use them for base hash calculation ([#8836](DataDog/dd-trace-java#8836) - [@amarziali](https://github.com/amarziali)) #### Dynamic Instrumentation - ✨ Optimized allocations for collection filter functions ([#8896](DataDog/dd-trace-java#8896) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Fix SymDB upload size check ([#8887](DataDog/dd-trace-java#8887) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Add support for Set in filter function ([#8873](DataDog/dd-trace-java#8873) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Add support for isDefined in log template ([#8859](DataDog/dd-trace-java#8859) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Fix Max captured frames for Exception Replay ([#8856](DataDog/dd-trace-java#8856) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Remove static inherited fields collection ([#8832](DataDog/dd-trace-java#8832) - [@jpbempel](https://github.com/jpbempel)) - 💡 Add process tags to dynamic instrumentation intake payload ([#8779](DataDog/dd-trace-java#8779) - [@amarziali](https://github.com/amarziali)) #### GraalVM native-image - ✨ Add support for GraalVM Native GC metrics ([#8913](DataDog/dd-trace-java#8913) - [@ygree](https://github.com/ygree)) - ✨ Add JMXFetch support for GraalVM Native ([#8569](DataDog/dd-trace-java#8569) - [@ygree](https://github.com/ygree)) #### JMX fetch - ✨ Add support for GraalVM Native GC metrics ([#8913](DataDog/dd-trace-java#8913) - [@ygree](https://github.com/ygree)) #### Library Injection - ✨ Deny oracle db jvm based tools ([#8909](DataDog/dd-trace-java#8909) - [@bric3](https://github.com/bric3)) #### OpenTracing - 🐛 Fix OT packaging for exception replay ([#8912](DataDog/dd-trace-java#8912) - [@jpbempel](https://github.com/jpbempel)) #### Profiling - ✨ Bump ddprof to 1.27.0 ([#8893](DataDog/dd-trace-java#8893) - [@jbachorik](https://github.com/jbachorik)) - Properly handle the adaptive sampling interval overflow by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#213 - Fix [#200](DataDog/dd-trace-java#200) Crash related to aligned\_alloc and free in context by [@yanglong1010](https://github.com/yanglong1010) in DataDog/java-profiler#208 - Explicitly initialize empty context page by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#210 - Re-connect crash recursion protection with VM stackwalker by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#214 - ✨ Enable ZSTD compression for profiling ([#8862](DataDog/dd-trace-java#8862) - [@MattAlp](https://github.com/MattAlp)) - ✨ Extend JPS re-implementation to J9 family ([#8813](DataDog/dd-trace-java#8813) - [@MattAlp](https://github.com/MattAlp)) - 💡 Collect process tags for profiling upload requests ([#8780](DataDog/dd-trace-java#8780) - [@amarziali](https://github.com/amarziali)) #### Telemetry - 💡 Surface process tags on telemetry payloads ([#8837](DataDog/dd-trace-java#8837) - [@amarziali](https://github.com/amarziali)) #### Trace context propagation - ✨ Migrating all HttpClient Instrumentations to Inject Full Context ([#8826](DataDog/dd-trace-java#8826) - [@mhlidd](https://github.com/mhlidd)) - ✨ Migrating all HttpServer Instrumentations to Extract full Context ([#8820](DataDog/dd-trace-java#8820) - [@mhlidd](https://github.com/mhlidd)) - ✨ Add context API support OTel propagators ([#8770](DataDog/dd-trace-java#8770) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Tracer core - ✨⚡ Skip JAXB generated classes classloader ([#9003](DataDog/dd-trace-java#9003) - [@bric3](https://github.com/bric3)) - ✨ Add DD\_RUNTIME\_METRICS\_RUNTIME\_ID\_ENABLED alias for runtime id generation ([#8981](DataDog/dd-trace-java#8981) - [@amarziali](https://github.com/amarziali)) - 🐛 Use resolved address for peer.hostname when available without hitting the cache ([#8915](DataDog/dd-trace-java#8915) - [@amarziali](https://github.com/amarziali)) - 💡 Surface server name process tag for tomcat ([#8894](DataDog/dd-trace-java#8894) - [@amarziali](https://github.com/amarziali)) - 💡 Surface websphere cell and server name on process tags ([#8880](DataDog/dd-trace-java#8880) - [@amarziali](https://github.com/amarziali)) - ✨ Added special lightweight pre-main class that skips installation on incompatible JVMs. ([#8855](DataDog/dd-trace-java#8855) - [@AlexeyKuznetsov-DD](https://github.com/AlexeyKuznetsov-DD)) - 💡 Add entrypoint type to process tags ([#8839](DataDog/dd-trace-java#8839) - [@amarziali](https://github.com/amarziali)) - ✨ Extend JPS re-im 8000 plementation to J9 family ([#8813](DataDog/dd-trace-java#8813) - [@MattAlp](https://github.com/MattAlp)) - ✨ Notify listeners when the scope top changes after switching scope stacks ([#8797](DataDog/dd-trace-java#8797) - [@mcculls](https://github.com/mcculls)) - ✨ Read hsperfdata for Java PIDs if jvmstat is unavailable ([#8792](DataDog/dd-trace-java#8792) - [@MattAlp](https://github.com/MattAlp)) - 🐛 Turn JDK socket support on by default ([#8752](DataDog/dd-trace-java#8752) - [@sarahchen6](https://github.com/sarahchen6)) - ✨ Simplify context propagation ([#8719](DataDog/dd-trace-java#8719) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨ Add JSON parsing support ([#8579](DataDog/dd-trace-java#8579) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Tracer internal logging - ✨ Fix printing format of span identifiers ([#8897](DataDog/dd-trace-java#8897) - [@vandonr](https://github.com/vandonr)) #### Tracer public API - 💡 Track the source of installation ([#8956](DataDog/dd-trace-java#8956) - [@mabdinur](https://github.com/mabdinur)) - ✨ Enforce size limit on application\_monitoring.yaml files ([#8789](DataDog/dd-trace-java#8789) - [@mtoffl01](https://github.com/mtoffl01)) - ✨ Enabling baggage cache to support limits and non-ascii characters ([#8713](DataDog/dd-trace-java#8713) - [@mhlidd](https://github.com/mhlidd)) ### Instrumentations #### AWS Lambda instrumentation - ✨ Pass Lambda Request ID to Extension ([#8814](DataDog/dd-trace-java#8814) - [@nhulston](https://github.com/nhulston)) #### Core Java language instrumentation - ✨ Ensure ClassloadingInstrumentation is always applied even with `DD_TRACE_ENABLED=false` ([#8863](DataDog/dd-trace-java#8863) - [@mcculls](https://github.com/mcculls)) #### Eclipse Vert.x instrumentation - 🐛 Do not override route with / in vertx instrumentation ([#8881](DataDog/dd-trace-java#8881) - [@vandonr](https://github.com/vandonr)) #### IBM Liberty - 🐛 Fix error mark on http status for IBM liberty ([#8822](DataDog/dd-trace-java#8822) - [@amarziali](https://github.com/amarziali)) #### JDBC instrumentation - 🐛 Do not prepend DBM <> APM trace comment in SQLCommenter if there is a pg plan hint ([#8864](DataDog/dd-trace-java#8864) - [@edengorevoy](https://github.com/edengorevoy)) #### JMS instrumentation - ✨ Add jms as an extra integration name where there is JMS involved ([#8933](DataDog/dd-trace-java#8933) - [@vandonr](https://github.com/vandonr)) #### Kotlin instrumentation - ✨ Enable kotlin\_coroutine integration by default ([#8848](DataDog/dd-trace-java#8848) - [@mcculls](https://github.com/mcculls)) - 🧹 Rework Kotlin coroutines instrumentation around coroutine context ([#8774](DataDog/dd-trace-java#8774) - [@mcculls](https://github.com/mcculls)) #### OpenTelemetry instrumentation - 🐛 Support WithSpan inheritContext attribute ([#8858](DataDog/dd-trace-java#8858) - [@amarziali](https://github.com/amarziali)) - ✨ Add context API support OTel propagators ([#8770](DataDog/dd-trace-java#8770) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Play Framework instrumentation - 🐛 Fix the Play Framework's span resource name priority so that the client JAX-RS 404 cannot override it ([#8591](DataDog/dd-trace-java#8591) - [@ygree](https://github.com/ygree)) #### Quarkus Instrumentation - 🐛 Ignore quarkus jaxrs stubs and cdi wrapper proxies ([#8891](DataDog/dd-trace-java#8891) - [@amarziali](https://github.com/amarziali)) #### ServiceTalk - ✨ Improve ServiceTalk Captured Context API Instrumentation for v0.42.56+ ([#8821](DataDog/dd-trace-java#8821) - [@ygree](https://github.com/ygree)) #### Spring instrumentation - ✨ Supporting Baggage for Instrumentations used in Weblog Tests ([#8773](DataDog/dd-trace-java#8773) - [@mhlidd](https://github.com/mhlidd)) #### WebSocket Instrumentation - 💡 Trace websocket for spring webflux reactive handlers ([#8831](DataDog/dd-trace-java#8831) - [@amarziali](https://github.com/amarziali)) - 💡:test\_tube: WebSocket support for Netty ([#8632](DataDog/dd-trace-java#8632) - [@ValentinZakharov](https://github.com/ValentinZakharov)) #### Zio Instrumentation - 🧹 Cleanup Zio fiber instrumentation to avoid repeated activation of continuation ([#8798](DataDog/dd-trace-java#8798) - [@mcculls](https://github.com/mcculls)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 9207366cdb6a1bd098082305d354a0a3c4622d7a

fix junit5 instrumentation after 5.13-RC

a08d100

daniel-mohedano added type: enhancement comp: ci visibility Continuous Integration Visibility labels May 22, 2025

daniel-mohedano changed the title ~~Add support for JUnit 5.13-RC~~ Add support for JUnit 5.13-RC1 May 22, 2025

daniel-mohedano requested a review from nikita-tkachenko-datadog May 22, 2025 08:43

daniel-mohedano marked this pull request as ready for review May 22, 2025 09:27

daniel-mohedano requested a review from a team as a code owner May 22, 2025 09:27

nikita-tkachenko-datadog approved these changes May 22, 2025

View reviewed changes

daniel-mohedano merged commit 35cbdee into master May 22, 2025
794 of 797 checks passed

daniel-mohedano deleted the daniel.mohedano/junit5-execution-request-fix branch May 22, 2025 10:52

github-actions bot added this to the 1.50.0 milestone May 22, 2025

daniel-mohedano mentioned this pull request May 23, 2025

Use constructor as fallback for ExecutionRequest creation in JUnit5 instrumentation #8871

Merged

daniel-mohedano mentioned this pull request Jun 4, 2025

Datadog CI Visibility broken with JUnit 5.13.0 #8920

Open

nikita-tkachenko-datadog mentioned this pull request Jun 5, 2025

🍒 8865 - Add support for JUnit 5.13-RC1 #8928

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add support for JUnit 5.13-RC1 #8865

Add support for JUnit 5.13-RC1 #8865

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Add support for JUnit 5.13-RC1 #8865

Add support for JUnit 5.13-RC1 #8865

Uh oh!

Conversation

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Uh oh!