8000 Cluster overwhelm countermeasures by neunhoef · Pull Request #13108 · arangodb/arangodb · GitHub
[go: up one dir, main page]
Skip to content

Cluster overwhelm countermeasures #13108

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 106 commits into from
Dec 11, 2020
Merged

Cluster overwhelm countermeasures #13108

Changes from 1 commit
Commits
Show all changes
106 commits
Select commit Hold shift + click to select a range
91377a8
Configurable parameter for synchronous replication timeout and better…
Oct 30, 2020
42356c1
Some experiments
Nov 9, 2020
28c856e
Merge remote-tracking branch 'origin/devel' into feature/prevent-clus…
neunhoef Nov 9, 2020
3b48bb6
Take out misuse of set_symmetric_difference.
neunhoef Nov 12, 2020
677337e
Introduce _onGoing counter.
neunhoef Nov 12, 2020
f14b515
Merge remote-tracking branch 'origin/devel' into feature/prevent-clus…
neunhoef Nov 13, 2020
a57773b
Add metrics and implement throttle on coordinators.
neunhoef Nov 13, 2020
2d1def6
Fix atomicity of metrics.
neunhoef Nov 13, 2020
ec55028
Fix metrics atomics.
neunhoef Nov 16, 2020
64c2c8b
fixed gauge assignment operatorsd
kvahed Nov 16, 2020
d3a52a8
tests
kvahed Nov 17, 2020
aa854ed
tiny
kvahed Nov 17, 2020
578a0e3
fixed metrics for correct floating point atomics
kvahed Nov 17, 2020
349840b
Merge remote-tracking branch 'origin/devel' into feature/prevent-clus…
neunhoef Nov 18, 2020
8a1f00d
devel merge
kvahed Nov 19, 2020
44f45d1
better testing
kvahed Nov 25, 2020
1b8ddc5
Scheduler revamp, lots of other changes.
neunhoef Nov 27, 2020
12ef863
Essentially get rid of synchronous replication timeout.
neunhoef Nov 27, 2020
2b2a95a
Take out unnecessary option.
neunhoef Nov 27, 2020
d437b6b
Replication of commit and abort transaction on high prio queue.
neunhoef Nov 27, 2020
59c96ff
Merge remote-tracking 8000 branch 'origin/devel' into feature/prevent-clus…
neunhoef Nov 27, 2020
ee23e9d
Trigger RocksDB throttle earlier.
neunhoef Nov 27, 2020
2f54ff5
Take out lots of debugging output.
neunhoef Dec 1, 2020
fc180c8
Merge branch 'devel' into feature/prevent-cluster-overwhelm2
Dec 1, 2020
dab1d46
Merge remote-tracking branch 'origin/devel' into feature/prevent-clus…
neunhoef Dec 2, 2020
6280342
Do not change RocksDB write buffer number after all.
neunhoef Dec 2, 2020
7582e38
Do not touch RocksDB throttle for now.
neunhoef Dec 2, 2020
a5f5020
Some cleanup w.r.t. ongoing throtteling.
neunhoef Dec 2, 2020
d354ab1
Permute some definitions, more like devel.
neunhoef Dec 2, 2020
c0a0cb0
Take out inflight again.
neunhoef Dec 2, 2020
7cf76e2
Remove unused code.
neunhoef Dec 2, 2020
7b82262
Whitespacing.
neunhoef Dec 2, 2020
c42fe2c
Rearrange stuff in SupervisedScheduler.
neunhoef Dec 2, 2020
5231dbc
More rearranging.
neunhoef Dec 2, 2020
6e1980f
Transaction time limit down to 10s again.
neunhoef Dec 2, 2020
e119ae9
Restore startLocalCluster.sh
neunhoef Dec 2, 2020
c19a9bb
Adjust a comment.
neunhoef Dec 2, 2020
400c1fb
Adjust lower limit for replication timeout.
neunhoef Dec 2, 2020
aff9c2d
CHANGELOG.
neunhoef Dec 2, 2020
9d466a1
Try to fix Windows compilation.
neunhoef Dec 2, 2020
4f1bc5e
Merge branch 'feature/prevent-cluster-overwhelm2' of github.com:arang…
Dec 2, 2020
45acdb1
Merge branch 'devel' into feature/prevent-cluster-overwhelm2
Dec 2, 2020
3d5e9b8
Prepare for merge.
Dec 3, 2020
893783e
Merge other branch
Dec 3, 2020
dc8159a
Fix Mac compilation.
Dec 3, 2020
215831e
Move AQL continuations to new lane
Dec 3, 2020
0c1437f
Actually move to new lane
Dec 3, 2020
e463e39
Remove synchronous commit from document handler
Dec 3, 2020
1048caa
Merge branch 'devel' into feature/prevent-cluster-overwhelm2
Dec 4, 2020
ac5a331
Revert temporary workaround for issue that should be fixed elsewhere
Dec 4, 2020
d9b9da2
Ensure max is at least min
Dec 4, 2020
467822d
Make ongoing task accounting clearer
Dec 4, 2020
dea468d
Clarification
Dec 4, 2020
fc97d24
Fix plurality for consistency
Dec 4, 2020
5fe4b0d
Address review comment
Dec 4, 2020
70c6692
Fix compilation
Dec 4, 2020
92fbaf8
Update arangod/Replication/ReplicationMetricsFeature.cpp
Dec 4, 2020
cff195d
Update arangod/Replication/ReplicationMetricsFeature.cpp
Dec 4, 2020
983c57c
Update arangod/Scheduler/SchedulerFeature.cpp
Dec 4, 2020
d44c59b
Update arangod/Scheduler/SchedulerFeature.cpp
Dec 4, 2020
f1cfcbe
Cleanup new parameters
Dec 4, 2020
d5957f4
Update arangod/Scheduler/SupervisedScheduler.cpp
Dec 4, 2020
dc4bf54
Fix atomic ordering for gauge
Dec 4, 2020
c02ac9f
Merge branch 'feature/prevent-cluster-overwhelm2' of github.com:arang…
Dec 4, 2020
359fb16
Add introduced for new flag
Dec 4, 2020
bea1b10
Update arangod/Scheduler/SupervisedScheduler.h
Dec 4, 2020
21f4215
Update arangod/Scheduler/SupervisedScheduler.cpp
Dec 4, 2020
fb354cf
Update arangod/Scheduler/SupervisedScheduler.cpp
Dec 4, 2020
01d9f45
Update arangod/Scheduler/SupervisedScheduler.cpp
Dec 4, 2020
03b3d27
Update arangod/Scheduler/SupervisedScheduler.cpp
Dec 4, 2020
5f3999a
Rename some variables
Dec 4, 2020
43593e8
Merge branch 'feature/prevent-cluster-overwhelm2' of github.com:arang…
Dec 4, 2020
363ef2c
Add introduced for new parameter
Dec 4, 2020
dab2218
Deredundify some wording
Dec 4, 2020
df74bce
Set another introduced flag
Dec 4, 2020
acf47a0
Update arangod/Scheduler/SupervisedScheduler.cpp
Dec 4, 2020
db009e1
Save map lookup
Dec 4, 2020
6872713
Merge branch 'feature/prevent-cluster-overwhelm2' of github.com:arang…
Dec 4, 2020
c73af0d
Merge branch 'devel' into bug-fix/gauge-assignment-opera
neunhoef Dec 7, 2020
685ea8b
Address review comment about integral efficiency
Dec 7, 2020
6a2ff56
Revert some changes to metrics that are covered in another PR.
Dec 7, 2020
7f1293f
Merge branch 'devel' into feature/prevent-cluster-overwhelm2
jsteemann Dec 7, 2020
1a8bd32
Fix Windows and Mac compilation
Dec 7, 2020
1407d37
Merge branch 'feature/prevent-cluster-overwhelm2' of github.com:arang…
Dec 7, 2020
3171aec
relaxed precision on tests
kvahed Dec 8, 2020
a861533
keep memory order as default
kvahed Dec 8, 2020
186c045
Merge branch 'devel' into bug-fix/gauge-assignment-opera
neunhoef Dec 8, 2020
161410a
Merge remote-tracking branch 'origin/devel' into feature/prevent-clus…
neunhoef Dec 8, 2020
3934fb4
Merge remote-tracking branch 'origin/bug-fix/gauge-assignment-opera' …
neunhoef Dec 8, 2020
1f16b99
Fix compilation.
neunhoef Dec 8, 2020
056d0f0
Add missing headers
Dec 8, 2020
e2d8d67
Address some review comments
Dec 8, 2020
7ce9059
Merge branch 'devel' into feature/prevent-cluster-overwhelm2
Dec 8, 2020
825ed38
Fix some issues
Dec 8, 2020
c12a833
Fix a dependency
Dec 8, 2020
f54d0bb
Fix feature dependency in mock
Dec 8, 2020
9398260
Fix feature re-add
Dec 8, 2020
65badf8
fix ubsan issues
jsteemann Dec 8, 2020
f27e69c
speed up shortest path unit tests
jsteemann Dec 8, 2020
2938056
fix MSVC compile warning
jsteemann Dec 8, 2020
ab6ce5b
Merge branch 'devel' of github.com:arangodb/arangodb into feature/clu…
jsteemann Dec 8, 2020
449877b
Merge branch 'devel' of github.com:arangodb/arangodb into feature/pre…
jsteemann Dec 9, 2020
0af7ff7
fix potential nullptr access
jsteemann Dec 9, 2020
12f0e70
make APIs of network::Response safer to use
jsteemann Dec 9, 2020
5a10472
Merge branch 'devel' of github.com:arangodb/arangodb into feature/pre…
jsteemann Dec 9, 2020
24d3d0c
Merge branch 'devel' into feature/prevent-cluster-overwhelm2
jsteemann Dec 11, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
better testing
  • Loading branch information
@kvahed
kvahed committed Nov 25, 2020
commit 44f45d1693ef0caec46b2a01f9f47bc709934573
9 changes: 4 additions & 5 deletions tests/Metrics/MetricsTest.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -291,9 +291,9 @@ template<typename T> void gauge_test() {
i.wait();
}
if constexpr (std::is_same<T,float>::value) {
ASSERT_TRUE(1.f - g.load() < 1.e-6f);
ASSERT_TRUE(std::abs(1.f - g.load()) < 1.e-6f);
} else {
ASSERT_TRUE(1. - g.load() < 1.e-15);
ASSERT_DOUBLE_EQ(1., g.load());
}

g = one;
Expand All @@ -310,12 +310,11 @@ template<typename T> void gauge_test() {
i.wait();
}
if constexpr (std::is_same<T,float>::value) {
ASSERT_TRUE(1.f - g.load() < 1.e-6f);
ASSERT_TRUE(std::abs(1.f - g.load()) < 1.e-6f);
} else {
ASSERT_TRUE(1. - g.load() < 1.e-15);
ASSERT_DOUBLE_EQ(1., g.load());
}


g = zero;
ASSERT_DOUBLE_EQ(g.load(), zero);
g += zdo;
Expand Down
0