8000 Add new config for debugger upload interval by jpbempel · Pull Request #8959 · DataDog/dd-trace-java · GitHub
[go: up one dir, main page]
Skip to content

Add new config for debugger upload interval #8959

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Add new config for debugger upload interval #8959

wants to merge 1 commit into from

Conversation

jpbempel
Copy link
Member
@jpbempel jpbempel commented Jun 11, 2025 •
edited by jira bot
Loading

What Does This Do

Add dynamic.instrumentation.upoad.interval.seconds config parameter that takes float in seconds

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-4003

@jpbempel
Add new config for debugger upload interval
552c788 
Add dynamic.instrumentation.upoad.interval.seconds config parameter
that takes float in seconds
@jpbempel jpbempel requested review from a team as code owners June 11, 2025 08:17
@jpbempel jpbempel removed the request for review from a team June 11, 2025 08:17
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Jun 11, 2025
@jpbempel jpbempel requested review from shatzi and dougqh June 11, 2025 08:17
@pr-commenter
Copy link
pr-commenter bot commented Jun 11, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1749630515 1749630888
end_time 2025-06-11T08:29:56 2025-06-11T08:36:09
git_branch master jpbempel/upload-interval-seconds
git_commit_sha 6dbac83 552c788
start_time 2025-06-11T08:28:36 2025-06-11T08:34:49
See matching parameters
Baseline Candidate
ci_job_id 976277985 976277985
ci_pipeline_id 67416602 67416602
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1749629739 1749629739

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+349.474µs; +493.454µs] or [+3.416%; +4.823%]		 worse
[+349.337µs; +515.640µs] or [+3.362%; +4.963%]		 worse
[+306.624µs; +486.065µs] or [+2.926%; +4.638%]		 worse
[+272.232µs; +648.713µs] or [+2.530%; +6.028%]		 worse
[-5.188op/s; -2.640op/s] or [-5.448%; -2.772%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-23.725µs; +36.053µs] or [-8.557%; +13.004%]		 unstable
[-32.457µs; +51.412µs] or [-10.249%; +16.235%]		 unstable
[-41.258µs; +62.173µs] or [-12.460%; +18.776%]		 unstable
[-236.873µs; +22.527µs] or [-22.239%; +2.115%]		 same
scenario:basic same same same unstable
[-31.322µs; +163.699µs] or [-4.099%; +21.422%]		 unstable
[-168.960op/s; +168.960op/s] or [-7.096%; +7.096%]
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (316.676 µs) : 290, 343
.   : milestone, 317,
basic (321.817 µs) : 313, 331
.   : milestone, 322,
loop (10.391 ms) : 10286, 10495
.   : milestone, 10391,
section candidate
noprobe (326.154 µs) : 276, 376
.   : milestone, 326,
basic (320.311 µs) : 308, 332
.   : milestone, 320,
loop (10.823 ms) : 10791, 10855
.   : milestone, 10823,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 316.676 µs [289.917 µs, 343.436 µs]
basic 321.817 µs [312.803 µs, 330.832 µs]
loop 10.391 ms [10.286 ms, 10.495 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 326.154 µs [276.442 µs, 375.866 µs]
basic 320.311 µs [308.397 µs, 332.224 µs]
loop 10.823 ms [10.791 ms, 10.855 ms]

@pr-commenter
Copy link
pr-commenter bot commented Jun 11, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/upload-interval-seconds
git_commit_date 1749628981 1749629739
git_commit_sha 6dbac83 552c788
release_version 1.50.0-SNAPSHOT~6dbac83f3a 1.50.0-SNAPSHOT~552c7882c9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749632316 1749632316
ci_job_id 976277976 976277976
ci_pipeline_id 67416602 67416602
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2ousnmcz-project-304-concurrent-1-f6p5pwqc 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2ousnmcz-project-304-concurrent-1-f6p5pwqc 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 14 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~552c7882c9, baseline=1.50.0-SNAPSHOT~6dbac83f3a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1021035
Total [baseline] (11.18 s) : 0, 11179998
Agent [candidate] (1.025 s) : 0, 1024980
Total [candidate] (11.175 s) : 0, 11174553
section appsec
Agent [baseline] (1.161 s) : 0, 1160600
Total [baseline] (11.304 s) : 0, 11303734
Agent [candidate] (1.163 s) : 0, 1163407
Total [candidate] (11.266 s) : 0, 11266297
section iast
Agent [baseline] (1.165 s) : 0, 1164656
Total [baseline] (11.379 s) : 0, 11378911
Agent [candidate] (1.153 s) : 0, 1153031
Total [candidate] (11.368 s) : 0, 11367959
section profiling
Agent [baseline] (1.264 s) : 0, 1264073
Total [baseline] (11.439 s) : 0, 11438998
Agent [candidate] (1.266 s) : 0, 1266211
Total [candidate] (11.509 s) : 0, 11508509
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.161 s 139.565 ms (13.7%)
Agent iast 1.165 s 143.621 ms (14.1%)
Agent profiling 1.264 s 243.038 ms (23.8%)
Total tracing 11.18 s -
Total appsec 11.304 s 123.737 ms (1.1%)
Total iast 11.379 s 198.913 ms (1.8%)
Total profiling 11.439 s 259.0 ms (2.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.163 s 138.426 ms (13.5%)
Agent iast 1.153 s 128.051 ms (12.5%)
Agent profiling 1.266 s 241.231 ms (23.5%)
Total tracing 11.175 s -
Total appsec 11.266 s 91.743 ms (0.8%)
Total iast 11.368 s 193.406 ms (1.7%)
Total profiling 11.509 s 333.955 ms (3.0%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~552c7882c9, baseline=1.50.0-SNAPSHOT~6dbac83f3a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.877 ms) : 0, 681877
BytebuddyAgent [candidate] (684.318 ms) : 0, 684318
GlobalTracer [baseline] (240.693 ms) : 0, 240693
GlobalTracer [candidate] (240.88 ms) : 0, 240880
AppSec [baseline] (56.621 ms) : 0, 56621
AppSec [candidate] (56.45 ms) : 0, 56450
Debugger [baseline] (6.93 ms) : 0, 6930
Debugger [candidate] (6.186 ms) : 0, 6186
Remote Config [baseline] (731.939 µs) : 0, 732
Remote Config [candidate] (724.029 µs) : 0, 724
Telemetry [baseline] (10.529 ms) : 0, 10529
Telemetry [candidate] (12.774 ms) : 0, 12774
section appsec
BytebuddyAgent [baseline] (698.554 ms) : 0, 698554
BytebuddyAgent [candidate] (700.666 ms) : 0, 700666
GlobalTracer [baseline] (237.09 ms) : 0, 237090
GlobalTracer [candidate] (237.843 ms) : 0, 237843
AppSec [baseline] (176.446 ms) : 0, 176446
AppSec [candidate] (176.251 ms) : 0, 176251
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (5.972 ms) : 0, 5972
Remote Config [baseline] (627.616 µs) : 0, 628
Remote Config [candidate] (629.584 µs) : 0, 630
Telemetry [baseline] (7.373 ms) : 0, 7373
Telemetry [candidate] (7.403 ms) : 0, 7403
IAST [baseline] (21.938 ms) : 0, 21938
IAST [candidate] (21.941 ms) : 0, 21941
section iast
BytebuddyAgent [baseline] (812.923 ms) : 0, 812923
BytebuddyAgent [candidate] (803.664 ms) : 0, 803664
GlobalTracer [baseline] (233.321 ms) : 0, 233321
GlobalTracer [candidate] (231.132 ms) : 0, 231132
AppSec [baseline] (49.607 ms) : 0, 49607
AppSec [candidate] (54.351 ms) : 0, 54351
Debugger [baseline] (5.981 ms) : 0, 5981
Debugger [candidate] (6.038 ms) : 0, 6038
Remote Config [baseline] (595.7 µs) : 0, 596
Remote Config [candidate] (605.068 µs) : 0, 605
Telemetry [baseline] (8.041 ms) : 0, 8041
Telemetry [candidate] (7.919 ms) : 0, 7919
IAST [baseline] (30.45 ms) : 0, 30450
IAST [candidate] (25.703 ms) : 0, 25703
section profiling
ProfilingAgent [baseline] (102.149 ms) : 0, 102149
ProfilingAgent [candidate] (103.018 ms) : 0, 103018
BytebuddyAgent [baseline] (674.85 ms) : 0, 674850
BytebuddyAgent [candidate] (675.514 ms) : 0, 675514
GlobalTracer [baseline] (359.922 ms) : 0, 359922
GlobalTracer [candidate] (360.326 ms) : 0, 360326
AppSec [baseline] (61.647 ms) : 0, 61647
AppSec [candidate] (61.733 ms) : 0, 61733
Debugger [baseline] (6.096 ms) : 0, 6096
Debugger [candidate] (6.057 ms) : 0, 6057
Remote Config [baseline] (634.598 µs) : 0, 635
Remote Config [candidate] (656.088 µs) : 0, 656
Telemetry [baseline] (8.016 ms) : 0, 8016
Telemetry [candidate] (8.038 ms) : 0, 8038
Profiling [baseline] (102.173 ms) : 0, 102173
Profiling [candidate] (103.042 ms) : 0, 103042
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~552c7882c9, baseline=1.50.0-SNAPSHOT~6dbac83f3a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1025847
Total [baseline] (8.59 s) : 0, 8589677
Agent [candidate] (1.023 s) : 0, 1023111
Total [candidate] (8.517 s) : 0, 8516605
section iast
Agent [baseline] (1.158 s) : 0, 1157813
Total [baseline] (9.228 s) : 0, 9228260
Agent [candidate] (1.157 s) : 0, 1157267
Total [candidate] (9.22 s) : 0, 9219684
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.166 s) : 0, 1165761
Total [baseline] (9.23 s) : 0, 9230370
Agent [candidate] (1.149 s) : 0, 1149279
Total [candidate] (9.135 s) : 0, 9134573
section iast_TELEMETRY_OFF
Agent [baseline] (1.158 s) : 0, 1158296
Total [baseline] (9.269 s) : 0, 9269050
Agent [candidate] (1.146 s) : 0, 1146035
Total [candidate] (9.224 s) : 0, 9224398
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.158 s 131.966 ms (12.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.166 s 139.914 ms (13.6%)
Agent iast_TELEMETRY_OFF 1.158 s 132.449 ms (12.9%)
Total tracing 8.59 s -
Total iast 9.228 s 638.583 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.23 s 640.693 ms (7.5%)
Total iast_TELEMETRY_OFF 9.269 s 679.373 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.157 s 134.156 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.149 s 126.168 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.146 s 122.924 ms (12.0%)
Total tr 8000 acing 8.517 s -
Total iast 9.22 s 703.079 ms (8.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.135 s 617.968 ms (7.3%)
Total iast_TELEMETRY_OFF 9.224 s 707.793 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~552c7882c9, baseline=1.50.0-SNAPSHOT~6dbac83f3a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.649 ms) : 0, 683649
BytebuddyAgent [candidate] (682.85 ms) : 0, 682850
GlobalTracer [baseline] (240.854 ms) : 0, 240854
GlobalTracer [candidate] (240.252 ms) : 0, 240252
AppSec [baseline] (57.94 ms) : 0, 57940
AppSec [candidate] (57.688 ms) : 0, 57688
Debugger [baseline] (6.188 ms) : 0, 6188
Debugger [candidate] (6.859 ms) : 0, 6859
Remote Config [baseline] (714.793 µs) : 0, 715
Remote Config [candidate] (743.304 µs) : 0, 743
Telemetry [baseline] (12.859 ms) : 0, 12859
Telemetry [candidate] (11.222 ms) : 0, 11222
section iast
BytebuddyAgent [baseline] (806.206 ms) : 0, 806206
BytebuddyAgent [candidate] (807.558 ms) : 0, 807558
GlobalTracer [baseline] (233.043 ms) : 0, 233043
GlobalTracer [candidate] (231.545 ms) : 0, 231545
IAST [baseline] (28.138 ms) : 0, 28138
IAST [candidate] (26.245 ms) : 0, 26245
AppSec [baseline] (52.153 ms) : 0, 52153
AppSec [candidate] (53.712 ms) : 0, 53712
Debugger [baseline] (6.055 ms) : 0, 6055
Debugger [candidate] (6.011 ms) : 0, 6011
Remote Config [baseline] (597.808 µs) : 0, 598
Remote Config [candidate] (605.672 µs) : 0, 606
Telemetry [baseline] (8.109 ms) : 0, 8109
Telemetry [candidate] (7.998 ms) : 0, 7998
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (813.745 ms) : 0, 813745
BytebuddyAgent [candidate] (800.377 ms) : 0, 800377
GlobalTracer [baseline] (233.101 ms) : 0, 233101
GlobalTracer [candidate] (230.509 ms) : 0, 230509
IAST [baseline] (29.611 ms) : 0, 29611
IAST [candidate] (26.323 ms) : 0, 26323
AppSec [baseline] (50.804 ms) : 0, 50804
AppSec [candidate] (54.033 ms) : 0, 54033
Debugger [baseline] (6.034 ms) : 0, 6034
Debugger [candidate] (5.992 ms) : 0, 5992
Remote Config [baseline] (602.521 µs) : 0, 603
Remote Config [candidate] (616.889 µs) : 0, 617
Telemetry [baseline] (8.094 ms) : 0, 8094
Telemetry [candidate] (7.929 ms) : 0, 7929
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (807.405 ms) : 0, 807405
BytebuddyAgent [candidate] (798.338 ms) : 0, 798338
GlobalTracer [baseline] (232.351 ms) : 0, 232351
GlobalTracer [candidate] (230.988 ms) : 0, 230988
IAST [baseline] (27.642 ms) : 0, 27642
IAST [candidate] (27.755 ms) : 0, 27755
AppSec [baseline] (52.624 ms) : 0, 52624
AppSec [candidate] (50.361 ms) : 0, 50361
Debugger [baseline] (6.022 ms) : 0, 6022
Debugger [candidate] (5.934 ms) : 0, 5934
Remote Config [baseline] (609.793 µs) : 0, 610
Remote Config [candidate] (598.069 µs) : 0, 598
Telemetry [baseline] (7.873 ms) : 0, 7873
Telemetry [candidate] (7.814 ms) : 0, 7814
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-11T08:41:12 2025-06-11T08:46:31
git_branch master jpbempel/upload-interval-seconds
git_commit_date 1749628981 1749629739
git_commit_sha 6dbac83 552c788
release_version 1.50.0-SNAPSHOT~6dbac83f3a 1.50.0-SNAPSHOT~552c7882c9
start_time 2025-06-11T08:38:58 2025-06-11T08:45:43
See matching parameters
Baseline Candidate
application petclinic petclinic
ci_job_date 1749631591 1749631591
ci_job_id 976277977 976277977
ci_pipeline_id 67416602 67416602
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-66eemyw1-project-304-concurrent-1-jvr23reg 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-66eemyw1-project-304-concurrent-1-jvr23reg 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant appsec appsec

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 0 metrics, 10 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:appsec unstable
[+62.693ms; +65.383ms] or [+756.133%; +788.576%]		 worse
[-539.097op/s; -511.150op/s] or [-90.973%; -86.256%]		 72.329ms 67.469op/s 8.291ms 592.593op/s
scenario:load:petclinic:no_agent unstable
[+44.748ms; +46.299ms] or [+574.596%; +594.505%]		 worse
[-554.363op/s; -520.870op/s] or [-88.005%; -82.688%]		 53.311ms 92.305op/s 7.788ms 629.921op/s
scenario:load:petclinic:profiling unstable
[+56.012ms; +58.175ms] or [+668.326%; +694.137%]		 worse
[-529.271op/s; -507.624op/s] or [-89.314%; -85.662%]		 65.474ms 74.145op/s 8.381ms 592.593op/s
scenario:load:petclinic:tracing unstable
[+50.037ms; +51.790ms] or [+630.548%; +652.634%]		 worse
[-552.840op/s; -521.876op/s] or [-89.145%; -84.152%]		 58.849ms 82.797op/s 7.936ms 620.155op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~552c7882c9, baseline=1.50.0-SNAPSHOT~6dbac83f3a
    dateFormat X
    axisFormat %s
section baseline
no_agent (7.788 ms) : 7766, 7810
.   : milestone, 7788,
appsec (8.291 ms) : 8265, 8318
.   : milestone, 8291,
appsec_no_iast (10.211 ms) : 10156, 10267
.   : milestone, 10211,
code_origins (38.201 ms) : 37862, 38540
.   : milestone, 38201,
iast (31.793 ms) : 31491, 32096
.   : milestone, 31793,
profiling (8.381 ms) : 8352, 8410
.   : milestone, 8381,
tracing (7.936 ms) : 7909, 7962
.   : milestone, 7936,
section candidate
no_agent (53.311 ms) : 52293, 54330
.   : milestone, 53311,
appsec (72.329 ms) : 70562, 74097
.   : milestone, 72329,
appsec_no_iast (76.225 ms) : 74016, 78434
.   : milestone, 76225,
code_origins (86.695 ms) : 82036, 91354
.   : milestone, 86695,
iast (82.441 ms) : 79337, 85546
.   : milestone, 82441,
profiling (65.474 ms) : 64053, 66895
.   : milestone, 65474,
tracing (58.849 ms) : 57698, 60001
.   : milestone, 58849,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 7.788 ms [7.766 ms, 7.81 ms] -
appsec 8.291 ms [8.265 ms, 8.318 ms] 503.477 µs (6.5%)
appsec_no_iast 10.211 ms [10.156 ms, 10.267 ms] 2.424 ms (31.1%)
code_origins 38.201 ms [37.862 ms, 38.54 ms] 30.413 ms (390.5%)
iast 31.793 ms [31.491 ms, 32.096 ms] 24.006 ms (308.2%)
profiling 8.381 ms [8.352 ms, 8.41 ms] 593.08 µs (7.6%)
tracing 7.936 ms [7.909 ms, 7.962 ms] 147.713 µs (1.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 53.311 ms [52.293 ms, 54.33 ms] -
appsec 72.329 ms [70.562 ms, 74.097 ms] 19.018 ms (35.7%)
appsec_no_iast 76.225 ms [74.016 ms, 78.434 ms] 22.914 ms (43.0%)
code_origins 86.695 ms [82.036 ms, 91.354 ms] 33.384 ms (62.6%)
iast 82.441 ms [79.337 ms, 85.546 ms] 29.13 ms (54.6%)
profiling 65.474 ms [64.053 ms, 66.895 ms] 12.163 ms (22.8%)
tracing 58.849 ms [57.698 ms, 60.001 ms] 5.538 ms (10.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/upload-interval-seconds
git_commit_date 1749628981 1749629739
git_commit_sha 6dbac83 552c788
release_version 1.50.0-SNAPSHOT~6dbac83f3a 1.50.0-SNAPSHOT~552c7882c9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749631951 1749631951
ci_job_id 976277980 976277980
ci_pipeline_id 67416602 67416602
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qrcmbjps-project-304-concurrent-3-aqfinmqg 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qrcmbjps-project-304-concurrent-3-aqfinmqg 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~552c7882c9, baseline=1.50.0-SNAPSHOT~6dbac83f3a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (2.399 ms) : 2350, 2447
.   : milestone, 2399,
iast (2.191 ms) : 2130, 2253
.   : milestone, 2191,
iast_GLOBAL (2.23 ms) : 2169, 2292
.   : milestone, 2230,
profiling (2.037 ms) : 1988, 2086
.   : milestone, 2037,
tracing (1.987 ms) : 1940, 2034
.   : milestone, 1987,
section candidate
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (2.392 ms) : 2344, 2441
.   : milestone, 2392,
iast (2.182 ms) : 2121, 2243
.   : milestone, 2182,
iast_GLOBAL (2.233 ms) : 2171, 2294
.   : milestone, 2233,
profiling (2.022 ms) : 1972, 2071
.   : milestone, 2022,
tracing (2.014 ms) : 1966, 2061
.   : milestone, 2014,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.492 ms] -
appsec 2.399 ms [2.35 ms, 2.447 ms] 917.765 µs (62.0%)
iast 2.191 ms [2.13 ms, 2.253 ms] 710.283 µs (48.0%)
iast_GLOBAL 2.23 ms [2.169 ms, 2.292 ms] 749.488 µs (50.6%)
profiling 2.037 ms [1.988 ms, 2.086 ms] 556.317 µs (37.6%)
tracing 1.987 ms [1.94 ms, 2.034 ms] 506.487 µs (34.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.47 ms, 1.493 ms] -
appsec 2.392 ms [2.344 ms, 2.441 ms] 910.974 µs (61.5%)
iast 2.182 ms [2.121 ms, 2.243 ms] 700.939 µs (47.3%)
iast_GLOBAL 2.233 ms [2.171 ms, 2.294 ms] 751.536 µs (50.7%)
profiling 2.022 ms [1.972 ms, 2.071 ms] 540.177 µs (36.5%)
tracing 2.014 ms [1.966 ms, 2.061 ms] 532.291 µs (35.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~552c7882c9, baseline=1.50.0-SNAPSHOT~6dbac83f3a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
appsec (14.771 s) : 14771000, 14771000
.   : milestone, 14771000,
iast (18.162 s) : 18162000, 18162000
.   : milestone, 18162000,
iast_GLOBAL (18.007 s) : 18007000, 18007000
.   : milestone, 18007000,
profiling (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
tracing (14.788 s) : 14788000, 14788000
.   : milestone, 14788000,
section candidate
no_agent (15.521 s) : 15521000, 15521000
.   : milestone, 15521000,
appsec (14.67 s) : 14670000, 14670000
.   : milestone, 14670000,
iast (18.482 s) : 18482000, 18482000
.   : milestone, 18482000,
iast_GLOBAL (17.959 s) : 17959000, 17959000
.   : milestone, 17959000,
profiling (15.101 s) : 15101000, 15101000
.   : milestone, 15101000,
tracing (14.809 s) : 14809000, 14809000
.   : milestone, 14809000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.93 s [14.93 s, 14.93 s] -
appsec 14.771 s [14.771 s, 14.771 s] -159.0 ms (-1.1%)
iast 18.162 s [18.162 s, 18.162 s] 3.232 s (21.6%)
iast_GLOBAL 18.007 s [18.007 s, 18.007 s] 3.077 s (20.6%)
profiling 15.018 s [15.018 s, 15.018 s] 88.0 ms (0.6%)
tracing 14.788 s [14.788 s, 14.788 s] -142.0 ms (-1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.521 s [15.521 s, 15.521 s] -
appsec 14.67 s [14.67 s, 14.67 s] -851.0 ms (-5.5%)
iast 18.482 s [18.482 s, 18.482 s] 2.961 s (19.1%)
iast_GLOBAL 17.959 s [17.959 s, 17.959 s] 2.438 s (15.7%)
profiling 15.101 s [15.101 s, 15.101 s] -420.0 ms (-2.7%)
tracing 14.809 s [14.809 s, 14.809 s] -712.0 ms (-4.6%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@evanchooly evanchooly evanchooly approved these changes

@shatzi shatzi Awaiting requested review from shatzi shatzi is a code owner automatically assigned from DataDog/debugger-java

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: debugger Dynamic Instrumentation type: refactoring
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jpbempel @evanchooly
0