Collect system-tests logs on test failure #8500
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~f618cc6762, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.142 s) : 0, 1141725
Total [baseline] (9.272 s) : 0, 9271536
Agent [candidate] (1.134 s) : 0, 1133736
Total [candidate] (9.224 s) : 0, 9223763
section iast
Agent [baseline] (1.265 s) : 0, 1264916
Total [baseline] (9.889 s) : 0, 9888974
Agent [candidate] (1.26 s) : 0, 1260109
Total [candidate] (9.873 s) : 0, 9872776
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.259 s) : 0, 1259181
Total [baseline] (9.841 s) : 0, 9840662
Agent [candidate] (1.259 s) : 0, 1258512
Total [candidate] (9.835 s) : 0, 9835361
section iast_TELEMETRY_OFF
Agent [baseline] (1.251 s) : 0, 1251327
Total [baseline] (9.89 s) : 0, 9890407
Agent [candidate] (1.26 s) : 0, 1259926
Total [candidate] (9.904 s) : 0, 9904428
gantt
title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~f618cc6762, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (721.097 ms) : 0, 721097
BytebuddyAgent [candidate] (715.742 ms) : 0, 715742
GlobalTracer [baseline] (241.077 ms) : 0, 241077
GlobalTracer [candidate] (239.254 ms) : 0, 239254
AppSec [baseline] (56.064 ms) : 0, 56064
AppSec [candidate] (55.626 ms) : 0, 55626
Debugger [baseline] (95.49 ms) : 0, 95490
Debugger [candidate] (95.086 ms) : 0, 95086
Remote Config [baseline] (598.764 µs) : 0, 599
Remote Config [candidate] (584.867 µs) : 0, 585
Telemetry [baseline] (12.372 ms) : 0, 12372
Telemetry [candidate] (12.493 ms) : 0, 12493
section iast
BytebuddyAgent [baseline] (840.229 ms) : 0, 840229
BytebuddyAgent [candidate] (836.697 ms) : 0, 836697
GlobalTracer [baseline] (231.399 ms) : 0, 231399
GlobalTracer [candidate] (230.626 ms) : 0, 230626
IAST [baseline] (22.876 ms) : 0, 22876
IAST [candidate] (22.704 ms) : 0, 22704
AppSec [baseline] (57.225 ms) : 0, 57225
AppSec [candidate] (57.119 ms) : 0, 57119
Debugger [baseline] (83.972 ms) : 0, 83972
Debugger [candidate] (83.304 ms) : 0, 83304
Remote Config [baseline] (520.249 µs) : 0, 520
Remote Config [candidate] (517.053 µs) : 0, 517
Telemetry [baseline] (13.601 ms) : 0, 13601
Telemetry [candidate] (14.162 ms) : 0, 14162
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.007 ms) : 0, 834007
BytebuddyAgent [candidate] (836.126 ms) : 0, 836126
GlobalTracer [baseline] (230.376 ms) : 0, 230376
GlobalTracer [candidate] (230.847 ms) : 0, 230847
IAST [baseline] (23.731 ms) : 0, 23731
IAST [candidate] (22.881 ms) : 0, 22881
AppSec [baseline] (56.429 ms) : 0, 56429
AppSec [candidate] (56.762 ms) : 0, 56762
Debugger [baseline] (84.199 ms) : 0, 84199
Debugger [candidate] (83.527 ms) : 0, 83527
Remote Config [baseline] (509.883 µs) : 0, 510
Remote Config [candidate] (519.247 µs) : 0, 519
Telemetry [baseline] (14.964 ms) : 0, 14964
Telemetry [candidate] (12.883 ms) : 0, 12883
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (831.076 ms) : 0, 831076
BytebuddyAgent [candidate] (838.472 ms) : 0, 838472
GlobalTracer [baseline] (229.954 ms) : 0, 229954
GlobalTracer [candidate] (231.011 ms) : 0, 231011
IAST [baseline] (23.733 ms) : 0, 23733
IAST [candidate] (23.974 ms) : 0, 23974
AppSec [baseline] (55.281 ms) : 0, 55281
AppSec [candidate] (55.236 ms) : 0, 55236
Debugger [baseline] (83.792 ms) : 0, 83792
Debugger [candidate] (83.524 ms) : 0, 83524
Remote Config [baseline] (512.962 µs) : 0, 513
Remote Config [candidate] (527.623 µs) : 0, 528
Telemetry [baseline] (12.024 ms) : 0, 12024
Telemetry [candidate] (12.056 ms) : 0, 12056
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~f618cc6762, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.138 s) : 0, 1137968
Total [baseline] (11.473 s) : 0, 11473318
Agent [candidate] (1.149 s) : 0, 1148972
Total [candidate] (11.464 s) : 0, 11463550
section appsec
Agent [baseline] (1.272 s) : 0, 1271712
Total [baseline] (11.668 s) : 0, 11668412
Agent [candidate] (1.273 s) : 0, 1273327
Total [candidate] (11.64 s) : 0, 11639673
section iast
Agent [baseline] (1.26 s) : 0, 1259961
Total [baseline] (11.925 s) : 0, 11925329
Agent [candidate] (1.261 s) : 0, 1260972
Total [candidate] (11.963 s) : 0, 11962567
section profiling
Agent [baseline] (1.376 s) : 0, 1376017
Total [baseline] (11.757 s) : 0, 11756703
Agent [candidate] (1.39 s) : 0, 1390279
Total [candidate] (11.901 s) : 0, 11900901
gantt
title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~f618cc6762, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.519 ms) : 0, 718519
BytebuddyAgent [candidate] (726.013 ms) : 0, 726013
GlobalTracer [baseline] (240.113 ms) : 0, 240113
GlobalTracer [candidate] (243.137 ms) : 0, 243137
AppSec [baseline] (55.574 ms) : 0, 55574
AppSec [candidate] (55.929 ms) : 0, 55929
Debugger [baseline] (95.752 ms) : 0, 95752
Debugger [candidate] (95.688 ms) : 0, 95688
Remote Config [baseline] (592.401 µs) : 0, 592
Remote Config [candidate] (601.276 µs) : 0, 601
Telemetry [baseline] (12.433 ms) : 0, 12433
Telemetry [candidate] (12.562 ms) : 0, 12562
section appsec
BytebuddyAgent [baseline] (734.827 ms) : 0, 734827
BytebuddyAgent [candidate] (735.525 ms) : 0, 735525
GlobalTracer [baseline] (236.656 ms) : 0, 236656
GlobalTracer [candidate] (237.023 ms) : 0, 237023
IAST [baseline] (21.315 ms) : 0, 21315
IAST [candidate] (21.646 ms) : 0, 21646
AppSec [baseline] (177.403 ms) : 0, 177403
AppSec [candidate] (177.763 ms) : 0, 177763
Debugger [baseline] (84.341 ms) : 0, 84341
Debugger [candidate] (84.276 ms) : 0, 84276
Remote Config [baseline] (647.119 µs) : 0, 647
Remote Config [candidate] (631.07 µs) : 0, 631
Telemetry [baseline] (12.276 ms) : 0, 12276
Telemetry [candidate] (12.327 ms) : 0, 12327
section iast
BytebuddyAgent [baseline] (836.675 ms) : 0, 836675
BytebuddyAgent [candidate] (836.293 ms) : 0, 836293
GlobalTracer [baseline] (230.651 ms) : 0, 230651
GlobalTracer [candidate] (230.702 ms) : 0, 230702
IAST [baseline] (22.812 ms) : 0, 22812
IAST [candidate] (22.843 ms) : 0, 22843
AppSec [baseline] (57.335 ms) : 0, 57335
AppSec [candidate] (57.186 ms) : 0, 57186
Debugger [baseline] (83.305 ms) : 0, 83305
Debugger [candidate] (83.504 ms) : 0, 83504
Remote Config [baseline] (523.128 µs) : 0, 523
Remote Config [candidate] (517.197 µs) : 0, 517
Telemetry [baseline] (13.666 ms) : 0, 13666
Telemetry [candidate] (14.922 ms) : 0, 14922
section profiling
BytebuddyAgent [baseline] (706.79 ms) : 0, 706790
BytebuddyAgent [candidate] (713.727 ms) : 0, 713727
GlobalTracer [baseline] (349.423 ms) : 0, 349423
GlobalTracer [candidate] (353.174 ms) : 0, 353174
AppSec [baseline] (55.246 ms) : 0, 55246
AppSec [candidate] (55.024 ms) : 0, 55024
Debugger [baseline] (88.195 ms) : 0, 88195
Debugger [candidate] (88.959 ms) : 0, 88959
Remote Config [baseline] (619.499 µs) : 0, 619
Remote Config [candidate] (637.259 µs) : 0, 637
Telemetry [baseline] (12.489 ms) : 0, 12489
Telemetry [candidate] (12.72 ms) : 0, 12720
ProfilingAgent [baseline] (123.033 ms) : 0, 123033
ProfilingAgent [candidate] (125.354 ms) : 0, 125354
Profiling [baseline] (123.053 ms) : 0, 123053
Profiling [candidate] (125.375 ms) : 0, 125375
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~f618cc6762, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1364
. : milestone, 1345,
appsec (1.737 ms) : 1714, 1761
. : milestone, 1737,
appsec_no_iast (1.734 ms) : 1711, 1757
. : milestone, 1734,
code_origins (1.681 ms) : 1647, 1715
. : milestone, 1681,
iast (1.523 ms) : 1498, 1549
. : milestone, 1523,
profiling (1.512 ms) : 1486, 1537
. : milestone, 1512,
tracing (1.486 ms) : 1462, 1510
. : milestone, 1486,
section candidate
no_agent (1.355 ms) : 1336, 1374
. : milestone, 1355,
appsec (1.727 ms) : 1703, 1752
. : milestone, 1727,
appsec_no_iast (1.721 ms) : 1698, 1744
. : milestone, 1721,
code_origins (1.687 ms) : 1655, 1720
. : milestone, 1687,
iast (1.521 ms) : 1497, 1546
. : milestone, 1521,
profiling (1.531 ms) : 1505, 1557
. : milestone, 1531,
tracing (1.483 ms) : 1459, 1507
. : milestone, 1483,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~f618cc6762, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section baseline
no_agent (382.401 µs) : 362, 403
. : milestone, 382,
iast (515.907 µs) : 493, 539
. : milestone, 516,
iast_FULL (732.221 µs) : 710, 754
. : milestone, 732,
iast_GLOBAL (565.179 µs) : 542, 588
. : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (511.816 µs) : 490, 533
. : milestone, 512,
iast_INACTIVE (461.669 µs) : 440, 483
. : milestone, 462,
iast_TELEMETRY_OFF (502.983 µs) : 481, 525
. : milestone, 503,
tracing (457.779 µs) : 437, 479
. : milestone, 458,
section candidate
no_agent (385.663 µs) : 366, 405
. : milestone, 386,
iast (513.922 µs) : 492, 536
. : milestone, 514,
iast_FULL (735.683 µs) : 714, 758
. : milestone, 736,
iast_GLOBAL (559.837 µs) : 538, 582
. : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (509.734 µs) : 488, 531
. : milestone, 510,
iast_INACTIVE (465.6 µs) : 444, 487
. : milestone, 466,
iast_TELEMETRY_OFF (504.429 µs) : 482, 527
. : milestone, 504,
tracing (463.484 µs) : 441, 486
. : milestone, 463,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~f618cc6762, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section baseline
no_agent (15.265 s) : 15265000, 15265000
. : milestone, 15265000,
appsec (14.86 s) : 14860000, 14860000
. : milestone, 14860000,
iast (18.702 s) : 18702000, 18702000
. : milestone, 18702000,
iast_GLOBAL (17.737 s) : 17737000, 17737000
. : milestone, 17737000,
profiling (15.094 s) : 15094000, 15094000
. : milestone, 15094000,
tracing (15.249 s) : 15249000, 15249000
. : milestone, 15249000,
section candidate
no_agent (15.23 s) : 15230000, 15230000
. : milestone, 15230000,
appsec (15.143 s) : 15143000, 15143000
. : milestone, 15143000,
iast (19.092 s) : 19092000, 19092000
. : milestone, 19092000,
iast_GLOBAL (17.975 s) : 17975000, 17975000
. : milestone, 17975000,
profiling (15.605 s) : 15605000, 15605000
. : milestone, 15605000,
tracing (14.921 s) : 14921000, 14921000
. : milestone, 14921000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~f618cc6762, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section baseline
no_agent (1.466 ms) : 1455, 1477
. : milestone, 1466,
appsec (2.334 ms) : 2290, 2377
. : milestone, 2334,
iast (2.109 ms) : 2054, 2164
. : milestone, 2109,
iast_GLOBAL (2.15 ms) : 2095, 2205
. : milestone, 2150,
profiling (1.95 ms) : 1907, 1994
. : milestone, 1950,
tracing (1.953 ms) : 1911, 1995
. : milestone, 1953,
section candidate
no_agent (1.471 ms) : 1459, 1482
. : milestone, 1471,
appsec (2.327 ms) : 2284, 2370
. : milestone, 2327,
iast (2.101 ms) : 2046, 2156
. : milestone, 2101,
iast_GLOBAL (2.154 ms) : 2098, 2210
. : milestone, 2154,
profiling (2.424 ms) : 2184, 2663
. : milestone, 2424,
tracing (1.939 ms) : 1897, 1981
. : milestone, 1939,
|
sezen-datadog
approved these changes
Mar 5, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Collect system-tests logs on test failures, which is when we need them the most.
Motivation
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]