10000 Move ClassName filtering initialization by jpbempel · Pull Request #8507 · DataDog/dd-trace-java · GitHub
[go: up one dir, main page]
Skip to content

Move ClassName filtering initialization #8507

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

Move ClassName filtering initialization #8507

wants to merge 1 commit into from

Conversation

jpbempel
Copy link
Member
@jpbempel jpbempel commented Mar 4, 2025

What Does This Do

move the the classname filtering when actual feature are enabled because it adds some overhead at startup to read and parse the third-party list

Motivation

startup perf

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jpbempel
Move ClassName filtering initialization
184a2e1 
move the the classname filtering when actual feature are enabled
because it adds some overhead at startup to read and parse the
third-party list
@jpbempel jpbempel requested a review from a team as a code owner March 4, 2025 17:33
@jpbempel jpbempel requested review from ojung and removed request for a team March 4, 2025 17:33
@github-actions GitHub Actions
Copy link
Contributor
github-actions bot commented Mar 4, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added comp: debugger Dynamic Instrumentation type: refactoring tag: no release notes Changes to exclude from release notes labels Mar 4, 2025
@pr-commenter
Copy link
pr-commenter bot commented Mar 4, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1741109740 1741110122
end_time 2025-03-04T17:36:58 2025-03-04T17:43:19
git_branch master jpbempel/fix-init-class-filter
git_commit_sha 9966995 184a2e1
start_time 2025-03-04T17:35:41 2025-03-04T17:42:03
See matching parameters
Baseline Candidate
ci_job_id 832327900 832327900
ci_pipeline_id 57680266 57680266
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1741109133 1741109133

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 5 metrics, 5 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop better
[-545.432µs; -484.428µs] or [-5.170%; -4.592%]		 better
[-580.749µs; -481.884µs] or [-5.412%; -4.491%]		 better
[-559.504µs; -419.477µs] or [-5.175%; -3.880%]		 better
[-958.539µs; -234.626µs] or [-8.461%; -2.071%]		 better
[+3.377op/s; +5.528op/s] or [+3.664%; +5.997%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-31.209µs; +19.079µs] or [-11.275%; +6.893%]		 unstable
[-43.353µs; +31.744µs] or [-13.669%; +10.009%]		 unstable
[-59.426µs; +42.615µs] or [-17.797%; +12.762%]		 unstable
[-109.285µs; +91.017µs] or [-17.927%; +14.930%]		 same
scenario:basic unsure
[-12.884µs; -0.669µs] or [-4.527%; -0.235%]		 unsure
[-20.426µs; -0.304µs] or [-6.483%; -0.097%]		 same unstable
[-112.418µs; -8.162µs] or [-19.492%; -1.415%]		 same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (317.164 µs) : 278, 357
.   : milestone, 317,
basic (315.057 µs) : 303, 327
.   : milestone, 315,
loop (10.73 ms) : 10675, 10785
.   : milestone, 10730,
section candidate
noprobe (311.36 µs) : 280, 343
.   : milestone, 311,
basic (304.692 µs) : 298, 311
.   : milestone, 305,
loop (10.199 ms) : 10164, 10234
.   : milestone, 10199,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 317.164 µs [277.581 µs, 356.747 µs]
basic 315.057 µs [302.692 µs, 327.422 µs]
loop 10.73 ms [10.675 ms, 10.785 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 311.36 µs [279.829 µs, 342.89 µs]
basic 304.692 µs [298.334 µs, 311.05 µs]
loop 10.199 ms [10.164 ms, 10.234 ms]

@pr-commenter
Copy link
pr-commenter bot commented Mar 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-init-class-filter
git_commit_date 1741108009 1741109133
git_commit_sha 9966995 184a2e1
release_version 1.47.0-SNAPSHOT~9966995dd4 1.47.0-SNAPSHOT~184a2e10dd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741111733 1741111733
ci_job_id 832327894 832327894
ci_pipeline_id 57680266 57680266
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-3sscnlvm-project-304-concurrent-2-49izfhdt 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-3sscnlvm-project-304-concurrent-2-49izfhdt 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 11 performance improvements and 1 performance regressions! Performance is the same for 54 metrics, 5 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Debugger better
[-14.490ms; -12.490ms] or [-17.325%; -14.933%]		 70.148ms 83.638ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Debugger better
[-14.102ms; -11.970ms] or [-16.880%; -14.328%]		 70.509ms 83.546ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Debugger better
[-13.931ms; -12.472ms] or [-16.773%; -15.016%]		 69.856ms 83.058ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config better
[-43.744µs; -13.348µs] or [-8.275%; -2.525%]		 500.075µs 528.621µs
scenario:startup:insecure-bank:tracing:Debugger better
[-14.324ms; -12.589ms] or [-15.062%; -13.237%]		 81.643ms 95.099ms
scenario:startup:petclinic:appsec:Debugger better
[-14.469ms; -12.772ms] or [-17.204%; -15.186%]		 70.483ms 84.103ms
scenario:startup:petclinic:appsec:Remote Config better
[-83.353µs; -48.791µs] or [-13.161%; -7.704%]		 567.246µs 633.318µs
scenario:startup:petclinic:appsec:Telemetry better
[-912.342µs; -486.805µs] or [-7.414%; -3.956%]		 11.606ms 12.305ms
scenario:startup:petclinic:iast:Debugger better
[-14.880ms; -13.797ms] or [-17.736%; -16.445%]		 69.558ms 83.896ms
scenario:startup:petclinic:profiling:Debugger better
[-14.106ms; -12.115ms] or [-16.071%; -13.803%]		 74.661ms 87.772ms
scenario:startup:petclinic:tracing:Debugger better
[-14.553ms; -12.266ms] or [-15.373%; -12.957%]		 81.256ms 94.666ms
scenario:startup:petclinic:tracing:Remote Config worse
[+13.834µs; +57.324µs] or [+2.415%; +10.006%]		 608.469µs 572.890µs
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.137 s) : 0, 1137480
Total [baseline] (9.266 s) : 0, 9266382
Agent [candidate] (1.13 s) : 0, 1129601
Total [candidate] (9.224 s) : 0, 9224351
section iast
Agent [baseline] (1.266 s) : 0, 1266458
Total [baseline] (9.879 s) : 0, 9879376
Agent [candidate] (1.255 s) : 0, 1254746
Total [candidate] (9.848 s) : 0, 9847555
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.258 s) : 0, 1258356
Total [baseline] (9.835 s) : 0, 9835351
Agent [candidate] (1.259 s) : 0, 1259150
Total [candidate] (9.815 s) : 0, 9815201
section iast_TELEMETRY_OFF
Agent [baseline] (1.252 s) : 0, 1252096
Total [baseline] (9.851 s) : 0, 9851287
Agent [candidate] (1.239 s) : 0, 1239440
Total [candidate] (9.804 s) : 0, 9803519
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.137 s -
Agent iast 1.266 s 128.978 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.258 s 120.876 ms (10.6%)
Agent iast_TELEMETRY_OFF 1.252 s 114.616 ms (10.1%)
Total tracing 9.266 s -
Total iast 9.879 s 612.994 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.835 s 568.969 ms (6.1%)
Total iast_TELEMETRY_OFF 9.851 s 584.905 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.13 s -
Agent iast 1.255 s 125.145 ms (11.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.259 s 129.549 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.239 s 109.839 ms (9.7%)
Total tracing 9.224 s -
Total iast 9.848 s 623.204 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.815 s 590.85 ms (6.4%)
Total iast_TELEMETRY_OFF 9.804 s 579.168 ms (6.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.52 ms) : 0, 718520
BytebuddyAgent [candidate] (722.115 ms) : 0, 722115
GlobalTracer [baseline] (240.45 ms) : 0, 240450
GlobalTracer [candidate] (241.823 ms) : 0, 241823
AppSec [baseline] (55.492 ms) : 0, 55492
AppSec [candidate] (56.346 ms) : 0, 56346
Debugger [baseline] (95.099 ms) : 0, 95099
Debugger [candidate] (81.643 ms) : 0, 81643
Remote Config [baseline] (595.673 µs) : 0, 596
Remote Config [candidate] (592.286 µs) : 0, 592
Telemetry [baseline] (12.371 ms) : 0, 12371
Telemetry [candidate] (11.971 ms) : 0, 11971
section iast
BytebuddyAgent [baseline] (838.467 ms) : 0, 838467
BytebuddyAgent [candidate] (844.449 ms) : 0, 844449
GlobalTracer [baseline] (230.322 ms) : 0, 230322
GlobalTracer [candidate] (232.157 ms) : 0, 232157
AppSec [baseline] (57.119 ms) : 0, 57119
AppSec [candidate] (57.371 ms) : 0, 57371
Debugger [baseline] (83.638 ms) : 0, 83638
Debugger [candidate] (70.148 ms) : 0, 70148
Remote Config [baseline] (520.245 µs) : 0, 520
Remote Config [candidate] (499.642 µs) : 0, 500
Telemetry [baseline] (18.286 ms) : 0, 18286
Telemetry [candidate] (12.064 ms) : 0, 12064
IAST [baseline] (23.117 ms) : 0, 23117
IAST [candidate] (23.013 ms) : 0, 23013
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (835.103 ms) : 0, 835103
BytebuddyAgent [candidate] (847.055 ms) : 0, 847055
GlobalTracer [baseline] (230.399 ms) : 0, 230399
GlobalTracer [candidate] (232.726 ms) : 0, 232726
AppSec [baseline] (57.399 ms) : 0, 57399
AppSec [candidate] (57.788 ms) : 0, 57788
Debugger [baseline] (83.546 ms) : 0, 83546
Debugger [candidate] (70.509 ms) : 0, 70509
Remote Config [baseline] (520.916 µs) : 0, 521
Remote Config [candidate] (492.57 µs) : 0, 493
Telemetry [baseline] (13.516 ms) : 0, 13516
Telemetry [candidate] (12.045 ms) : 0, 12045
IAST [baseline] (22.943 ms) : 0, 22943
IAST [candidate] (23.433 ms) : 0, 23433
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (832.945 ms) : 0, 832945
BytebuddyAgent [candidate] (832.624 ms) : 0, 832624
GlobalTracer [baseline] (229.544 ms) : 0, 229544
GlobalTracer [candidate] (230.174 ms) : 0, 230174
AppSec [baseline] (55.85 ms) : 0, 55850
AppSec [candidate] (57.094 ms) : 0, 57094
Debugger [baseline] (83.058 ms) : 0, 83058
Debugger [candidate] (69.856 ms) : 0, 69856
Remote Config [baseline] (528.621 µs) : 0, 529
Remote Config [candidate] (500.075 µs) : 0, 500
Telemetry [baseline] (12.012 ms) : 0, 12012
Telemetry [candidate] (11.821 ms) : 0, 11821
IAST [baseline] (23.157 ms) : 0, 23157
IAST [candidate] (22.385 ms) : 0, 22385
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.136 s) : 0, 1135780
Total [baseline] (11.475 s) : 0, 11475144
Agent [candidate] (1.12 s) : 0, 1120022
Total [candidate] (11.372 s) : 0, 11371967
section appsec
Agent [baseline] (1.276 s) : 0, 1276340
Total [baseline] (11.656 s) : 0, 11656161
Agent [candidate] (1.258 s) : 0, 1258291
Total [candidate] (11.676 s) : 0, 11676030
section iast
Agent [baseline] (1.262 s) : 0, 1262357
Total [baseline] (11.959 s) : 0, 11959435
Agent [candidate] (1.244 s) : 0, 1244106
Total [candidate] (12.03 s) : 0, 12030424
section profiling
Agent [baseline] (1.376 s) : 0, 1376034
Total [baseline] (11.769 s) : 0, 11769086
Agent [candidate] (1.366 s) : 0, 1366470
Total [candidate] (11.844 s) : 0, 11844059
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.136 s -
Agent appsec 1.276 s 140.56 ms (12.4%)
Agent iast 1.262 s 126.577 ms (11.1%)
Agent profiling 1.376 s 240.254 ms (21.2%)
Total tracing 11.475 s -
Total appsec 11.656 s 181.018 ms (1.6%)
Total iast 11.959 s 484.292 ms (4.2%)
Total profiling 11.769 s 293.942 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.12 s -
Agent appsec 1.258 s 138.269 ms (12.3%)
Agent iast 1.244 s 124.085 ms (11.1%)
Agent profiling 1.366 s 246.449 ms (22.0%)
Total tracing 11.372 s -
Total appsec 11.676 s 304.063 ms (2.7%)
Total iast 12.03 s 658.457 ms (5.8%)
Total profiling 11.844 s 472.092 ms (4.2%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.546 ms) : 0, 717546
BytebuddyAgent [candidate] (716.203 ms) : 0, 716203
GlobalTracer [baseline] (240.012 ms) : 0, 240012
GlobalTracer [candidate] (239.271 ms) : 0, 239271
AppSec [baseline] (55.661 ms) : 0, 55661
AppSec [candidate] (55.64 ms) : 0, 55640
Debugger [baseline] (94.666 ms) : 0, 94666
Debugger [candidate] (81.256 ms) : 0, 81256
Remote Config [baseline] (572.89 µs) : 0, 573
Remote Config [candidate] (608.469 µs) : 0, 608
Telemetry [baseline] (12.385 ms) : 0, 12385
Telemetry [candidate] (12.013 ms) : 0, 12013
section appsec
BytebuddyAgent [baseline] (738.811 ms) : 0, 738811
BytebuddyAgent [candidate] (736.762 ms) : 0, 736762
GlobalTracer [baseline] (237.073 ms) : 0, 237073
GlobalTracer [candidate] (236.346 ms) : 0, 236346
AppSec [baseline] (177.619 ms) : 0, 177619
AppSec [candidate] (176.825 ms) : 0, 176825
Debugger [baseline] (84.103 ms) : 0, 84103
Debugger [candidate] (70.483 ms) : 0, 70483
Remote Config [baseline] (633.318 µs) : 0, 633
Remote Config [candidate] (567.246 µs) : 0, 567
Telemetry [baseline] (12.305 ms) : 0, 12305
Telemetry [candidate] (11.606 ms) : 0, 11606
IAST [baseline] (21.446 ms) : 0, 21446
IAST [candidate] (21.333 ms) : 0, 21333
section iast
BytebuddyAgent [baseline] (837.14 ms) : 0, 837140
BytebuddyAgent [candidate] (836.079 ms) : 0, 836079
GlobalTracer [baseline] (230.894 ms) : 0, 230894
GlobalTracer [candidate] (231.068 ms) : 0, 231068
AppSec [baseline] (57.109 ms) : 0, 57109
AppSec [candidate] (57.139 ms) : 0, 57139
Debugger [baseline] (83.896 ms) : 0, 83896
Debugger [candidate] (69.558 ms) : 0, 69558
Remote Config [baseline] (512.155 µs) : 0, 512
Remote Config [candidate] (506.693 µs) : 0, 507
Telemetry [baseline] (14.847 ms) : 0, 14847
Telemetry [candidate] (11.951 ms) : 0, 11951
IAST [baseline] (22.976 ms) : 0, 22976
IAST [candidate] (22.849 ms) : 0, 22849
section profiling
BytebuddyAgent [baseline] (708.067 ms) : 0, 708067
BytebuddyAgent [candidate] (709.741 ms) : 0, 709741
GlobalTracer [baseline] (348.915 ms) : 0, 348915
GlobalTracer [candidate] (351.302 ms) : 0, 351302
AppSec [baseline] (54.92 ms) : 0, 54920
AppSec [candidate] (54.978 ms) : 0, 54978
Debugger [baseline] (87.772 ms) : 0, 87772
Debugger [candidate] (74.661 ms) : 0, 74661
Remote Config [baseline] (612.992 µs) : 0, 613
Remote Config [candidate] (610.941 µs) : 0, 611
Telemetry [baseline] (12.488 ms) : 0, 12488
Telemetry [candidate] (12.257 ms) : 0, 12257
ProfilingAgent [baseline] (122.888 ms) : 0, 122888
ProfilingAgent [candidate] (122.63 ms) : 0, 122630
Profiling [baseline] (122.91 ms) : 0, 122910
Profiling [candidate] (122.653 ms) : 0, 122653
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-04T17:34:53 2025-03-04T17:42:48
git_branch master jpbempel/fix-init-class-filter
git_commit_date 1741108009 1741109133
git_commit_sha 9966995 184a2e1
release_version 1.47.0-SNAPSHOT~9966995dd4 1.47.0-SNAPSHOT~184a2e10dd
start_time 2025-03-04T17:34:38 2025-03-04T17:42:34
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741110576 1741110576
ci_job_id 832327895 832327895
ci_pipeline_id 57680266 57680266
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-3sscnlvm-project-304-concurrent-3-03ewm1lh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-3sscnlvm-project-304-concurrent-3-03ewm1lh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.355 ms) : 1335, 1375
.   : milestone, 1355,
appsec (1.737 ms) : 1713, 1761
.   : milestone, 1737,
appsec_no_iast (1.731 ms) : 1707, 1754
.   : milestone, 1731,
code_origins (1.672 ms) : 1638, 1707
.   : milestone, 1672,
iast (1.516 ms) : 1492, 1541
.   : milestone, 1516,
profiling (1.518 ms) : 1493, 1543
.   : milestone, 1518,
tracing (1.492 ms) : 1468, 1516
.   : milestone, 1492,
section candidate
no_agent (1.373 ms) : 1354, 1393
.   : milestone, 1373,
appsec (1.734 ms) : 1710, 1758
.   : milestone, 1734,
appsec_no_iast (1.711 ms) : 1686, 1736
.   : milestone, 1711,
code_origins (1.692 ms) : 1659, 1726
.   : milestone, 1692,
iast (1.508 ms) : 1483, 1533
.   : milestone, 1508,
profiling (1.527 ms) : 1503, 1551
.   : milestone, 1527,
tracing (1.499 ms) : 1475, 1523
.   : milestone, 1499,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.355 ms [1.335 ms, 1.375 ms] -
appsec 1.737 ms [1.713 ms, 1.761 ms] 382.114 µs (28.2%)
appsec_no_iast 1.731 ms [1.707 ms, 1.754 ms] 375.872 µs (27.7%)
code_origins 1.672 ms [1.638 ms, 1.707 ms] 317.382 µs (23.4%)
iast 1.516 ms [1.492 ms, 1.541 ms] 161.435 µs (11.9%)
profiling 1.518 ms [1.493 ms, 1.543 ms] 162.866 µs (12.0%)
tracing 1.492 ms [1.468 ms, 1.516 ms] 137.339 µs (10.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.373 ms [1.354 ms, 1.393 ms] -
appsec 1.734 ms [1.71 ms, 1.758 ms] 360.58 µs (26.3%)
appsec_no_iast 1.711 ms [1.686 ms, 1.736 ms] 337.557 µs (24.6%)
code_origins 1.692 ms [1.659 ms, 1.726 ms] 318.683 µs (23.2%)
iast 1.508 ms [1.483 ms, 1.533 ms] 134.532 µs (9.8%)
profiling 1.527 ms [1.503 ms, 1.551 ms] 153.17 µs (11.2%)
tracing 1.499 ms [1.475 ms, 1.523 ms] 125.373 µs (9.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.345 µs) : 364, 405
.   : milestone, 384,
iast (528.6 µs) : 506, 551
.   : milestone, 529,
iast_FULL (734.963 µs) : 713, 757
.   : milestone, 735,
iast_GLOBAL (570.649 µs) : 547, 594
.   : milestone, 571,
iast_HARDCODED_SECRET_DISABLED (519.534 µs) : 496, 543
.   : milestone, 520,
iast_INACTIVE (472.46 µs) : 451, 494
.   : milestone, 472,
iast_TELEMETRY_OFF (507.961 µs) : 485, 531
.   : milestone, 508,
tracing (459.71 µs) : 439, 480
.   : milestone, 460,
section candidate
no_agent (380.404 µs) : 361, 400
.   : milestone, 380,
iast (514.876 µs) : 493, 537
.   : milestone, 515,
iast_FULL (731.907 µs) : 710, 754
.   : milestone, 732,
iast_GLOBAL (558.716 µs) : 537, 580
.   : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (514.328 µs) : 493, 536
.   : milestone, 514,
iast_INACTIVE (464.372 µs) : 443, 486
.   : milestone, 464,
iast_TELEMETRY_OFF (502.732 µs) : 481, 525
.   : milestone, 503,
tracing (460.22 µs) : 439, 481
.   : milestone, 460,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.345 µs [363.516 µs, 405.173 µs] -
iast 528.6 µs [506.154 µs, 551.045 µs] 144.255 µs (37.5%)
iast_FULL 734.963 µs [712.674 µs, 757.252 µs] 350.618 µs (91.2%)
iast_GLOBAL 570.649 µs [547.266 µs, 594.032 µs] 186.304 µs (48.5%)
iast_HARDCODED_SECRET_DISABLED 519.534 µs [496.204 µs, 542.863 µs] 135.189 µs (35.2%)
iast_INACTIVE 472.46 µs [450.648 µs, 494.272 µs] 88.115 µs (22.9%)
iast_TELEMETRY_OFF 507.961 µs [485.276 µs, 530.647 µs] 123.617 µs (32.2%)
tracing 459.71 µs [438.977 µs, 480.443 µs] 75.365 µs (19.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.404 µs [360.815 µs, 399.993 µs] -
iast 514.876 µs [493.071 µs, 536.68 µs] 134.472 µs (35.3%)
iast_FULL 731.907 µs [709.691 µs, 754.123 µs] 351.503 µs (92.4%)
iast_GLOBAL 558.716 µs [537.307 µs, 580.126 µs] 178.312 µs (46.9%)
iast_HARDCODED_SECRET_DISABLED 514.328 µs [492.547 µs, 536.109 µs] 133.924 µs (35.2%)
iast_INACTIVE 464.372 µs [442.868 µs, 485.877 µs] 83.968 µs (22.1%)
iast_TELEMETRY_OFF 502.732 µs [480.837 µs, 524.627 µs] 122.329 µs (32.2%)
tracing 460.22 µs [439.02 µs, 481.42 µs] 79.816 µs (21.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-init-class-filter
git_commit_date 1741108009 1741109133
git_commit_sha 9966995 184a2e1
release_version 1.47.0-SNAPSHOT~9966995dd4 1.47.0-SNAPSHOT~184a2e10dd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741111237 1741111237
ci_job_id 832327896 832327896
ci_pipeline_id 57680266 57680266
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-njn2trh-project-304-concurrent-2-di4htf11 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-njn2trh-project-304-concurrent-2-di4htf11 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.342 ms) : 2299, 2386
.   : milestone, 2342,
iast (2.114 ms) : 2059, 2169
.   : milestone, 2114,
iast_GLOBAL (2.177 ms) : 2121, 2234
.   : milestone, 2177,
profiling (1.969 ms) : 1925, 2012
.   : milestone, 1969,
tracing (1.942 ms) : 1900, 1984
.   : milestone, 1942,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (2.348 ms) : 2304, 2391
.   : milestone, 2348,
iast (2.12 ms) : 2065, 2175
.   : milestone, 2120,
iast_GLOBAL (2.161 ms) : 2106, 2217
.   : milestone, 2161,
profiling (1.97 ms) : 1927, 2013
.   : milestone, 1970,
tracing (1.935 ms) : 1893, 1977
.   : milestone, 1935,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.342 ms [2.299 ms, 2.386 ms] 866.081 µs (58.7%)
iast 2.114 ms [2.059 ms, 2.169 ms] 637.499 µs (43.2%)
iast_GLOBAL 2.177 ms [2.121 ms, 2.234 ms] 701.006 µs (47.5%)
profiling 1.969 ms [1.925 ms, 2.012 ms] 492.196 µs (33.3%)
tracing 1.942 ms [1.9 ms, 1.984 ms] 465.808 µs (31.6%)
  • candidate results
Execution Time [CI 0.99]
Variant Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 2.348 ms [2.304 ms, 2.391 ms] 870.125 µs (58.9%)
iast 2.12 ms [2.065 ms, 2.175 ms] 642.636 µs (43.5%)
iast_GLOBAL 2.161 ms [2.106 ms, 2.217 ms] 684.054 µs (46.3%)
profiling 1.97 ms [1.927 ms, 2.013 ms] 492.411 µs (33.3%)
tracing 1.935 ms [1.893 ms, 1.977 ms] 457.43 µs (31.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.414 s) : 15414000, 15414000
.   : milestone, 15414000,
appsec (14.894 s) : 14894000, 14894000
.   : milestone, 14894000,
iast (18.562 s) : 18562000, 18562000
.   : milestone, 18562000,
iast_GLOBAL (17.983 s) : 17983000, 17983000
.   : milestone, 17983000,
profiling (15.432 s) : 15432000, 15432000
.   : milestone, 15432000,
tracing (15.061 s) : 15061000, 15061000
.   : milestone, 15061000,
section candidate
no_agent (15.517 s) : 15517000, 15517000
.   : milestone, 15517000,
appsec (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,
iast (18.13 s) : 18130000, 18130000
.   : milestone, 18130000,
iast_GLOBAL (17.829 s) : 17829000, 17829000
.   : milestone, 17829000,
profiling (15.016 s) : 15016000, 15016000
.   : milestone, 15016000,
tracing (14.78 s) : 14780000, 14780000
.   : milestone, 14780000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.414 s [15.414 s, 15.414 s] -
appsec 14.894 s [14.894 s, 14.894 s] -520.0 ms (-3.4%)
iast 18.562 s [18.562 s, 18.562 s] 3.148 s (20.4%)
iast_GLOBAL 17.983 s [17.983 s, 17.983 s] 2.569 s (16.7%)
profiling 15.432 s [15.432 s, 15.432 s] 18.0 ms (0.1%)
tracing 15.061 s [15.061 s, 15.061 s] -353.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.517 s [15.517 s, 15.517 s] -
appsec 15.054 s [15.054 s, 15.054 s] -463.0 ms (-3.0%)
iast 18.13 s [18.13 s, 18.13 s] 2.613 s (16.8%)
iast_GLOBAL 17.829 s [17.829 s, 17.829 s] 2.312 s (14.9%)
profiling 15.016 s [15.016 s, 15.016 s] -501.0 ms (-3.2%)
tracing 14.78 s [14.78 s, 14.78 s] -737.0 ms (-4.7%)

@jpbempel
Copy link
Member Author

supersede by #8587

@jpbempel jpbempel closed this Mar 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ojung ojung Awaiting requested review from ojung ojung is a code owner automatically assigned from DataDog/debugger-java

Assignees
No one assigned
Labels
comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes type: refactoring
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@jpbempel
0