[go: up one dir, main page]
Page MenuHomePhabricator
Create Task
Maniphest T350567

Migrate Cassandra to Java 11
Closed, ResolvedPublic
Actions

Description

For Buster and Bullseye Java 8 is being provided in a component/jdk8 for applications relying on Java 8 (the default JRE in Bullseye is Java 11).

Since we have upgraded to Cassandra 4 by now (which supports Java 11), we should also move to Java 11.

Since Cassandra uses profile::java, this should be as simple as changing profile::java::java_packages in Hiera on a per-cluster basis along with service restarts.

  • aqs
  • cassandra-dev
  • ml-cache
  • restbase
  • sessionstore
Also requires removing openjdk-8 packages (ala dpkg --remove openjdk-8-jdk openjdk-8-jre openjdk-8-jdk-headless openjdk-8-jre-headless)

Details

SubjectRepoBranchLines +/-
sessionstore: Upgrade to Java 11operations/puppetproduction+1 -1
restbase: upgrade cluster to Java 11operations/puppetproduction+1 -4
restbase1028: Upgrade to Java 11operations/puppetproduction+3 -0
aqs: Upgrade cluster to Java 11operations/puppetproduction+1 -4
cassandra: alternate logging hostname definitionoperations/puppetproduction+1 -1
aqs: Upgrade aqs1010 to Java 11 (canary)operations/puppetproduction+3 -0
cassandra-dev: upgrade to Java 11operations/puppetproduction+1 -4
cassandra-dev2001: upgrade to Java 11operations/puppetproduction+3 -0
Customize query in gerrit

Related Objects

Event Timeline

MoritzMuehlenhoff created this task.Nov 6 2023, 9:06 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 6 2023, 9:06 AM
Eevans triaged this task as Medium priority.Feb 22 2024, 5:44 PM
Eevans moved this task from Backlog to Next on the Cassandra board.May 15 2024, 9:10 PM
gerritbot added a comment.Jun 6 2024, 6:45 PM

Change #1039813 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] cassandra-dev2001: upgrade to Java 11

https://gerrit.wikimedia.org/r/1039813

gerritbot added a project: Patch-For-Review.Jun 6 2024, 6:45 PM
gerritbot added a comment.Jun 6 2024, 7:38 PM

Change #1039813 merged by Eevans:

[operations/puppet@production] cassandra-dev2001: upgrade to Java 11

https://gerrit.wikimedia.org/r/1039813

Eevans added a comment.Jun 6 2024, 7:47 PM

cassandra-dev2001-{a,b} have been upgraded to Java 11 (canaries).

Maintenance_bot removed a project: Patch-For-Review.Jun 6 2024, 8:31 PM
gerritbot added a comment.Jun 7 2024, 2:30 PM

Change #1040188 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] cassandra-dev: upgrade to Java 11

https://gerrit.wikimedia.org/r/1040188

gerritbot added a project: Patch-For-Review.Jun 7 2024, 2:30 PM
elukey subscribed.Jun 7 2024, 2:30 PM
gerritbot added a comment.Jun 7 2024, 2:48 PM

Change #1040188 merged by Eevans:

[operations/puppet@production] cassandra-dev: upgrade to Java 11

https://gerrit.wikimedia.org/r/1040188

Eevans added a comment.Jun 7 2024, 3:15 PM
In T350567#9868944, @Eevans wrote:

cassandra-dev2001-{a,b} have been upgraded to Java 11 (canaries).

And now all of cassandra-dev.

Maintenance_bot removed a project: Patch-For-Review.Jun 7 2024, 3:31 PM
gerritbot added a comment.Jun 10 2024, 2:33 PM

Change #1041138 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] aqs: Upgrade aqs1010 to Java 11 (canary)

https://gerrit.wikimedia.org/r/1041138

gerritbot added a project: Patch-For-Review.Jun 10 2024, 2:33 PM
gerritbot added a comment.Jun 10 2024, 2:44 PM

Change #1041138 merged by Eevans:

[operations/puppet@production] aqs: Upgrade aqs1010 to Java 11 (canary)

https://gerrit.wikimedia.org/r/1041138

Stashbot added a comment.Jun 10 2024, 2:47 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-10T14:47:56Z] <urandom> aqs1010: restarting cassandra to apply upgrade to Java 11 — T350567

Maintenance_bot removed a project: Patch-For-Review.Jun 10 2024, 3:31 PM
Eevans added a comment.Jun 11 2024, 3:14 PM

24 hours(ish) on and the aqs1010-{a,b} upgrade to Java 11 is fairly anticlimactic. The only real difference I can see is in the heap utilization graph (and it's an improvement).

image.png (837×1 px, 573 KB)
aqs1010-a (java-11) vs aqs1016-b (java-8)
Eevans claimed this task.Jun 11 2024, 3:15 PM
Eevans updated the task description. (Show Details)
Eevans updated the task description. (Show Details)
gerritbot added a comment.Jun 12 2024, 1:09 PM

Change #1042234 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] aqs: Upgrade cluster to Java 11

https://gerrit.wikimedia.org/r/1042234

gerritbot added a project: Patch-For-Review.Jun 12 2024, 1:09 PM
MoritzMuehlenhoff added a comment.Jun 12 2024, 1:18 PM

Can you please uninstall openjdk-8-* on the migrated clusters? (simply run dpkg --remove openjdk-8-jdk openjre-8-jre openjdk-8-jdk-headless openjre-8-jre-headless via Cumin). This avoids confusion the next time we roll out new Java security updates.

Stashbot added a comment.Jun 12 2024, 1:18 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-12T13:18:24Z] <eevans@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on aqs1010.eqiad.wmnet with reason: Troubleshooting remote logging — T350567

ops-monitoring-bot added a comment.Jun 12 2024, 1:18 PM

Icinga downtime and Alertmanager silence (ID=36667e14-e2ab-458d-af49-c424df72a544) set by eevans@cumin1002 for 1 day, 0:00:00 on 1 host(s) and their services with reason: Troubleshooting remote logging — T350567

aqs1010.eqiad.wmnet
Stashbot added a comment.Jun 12 2024, 1:18 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-12T13:18:38Z] <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on aqs1010.eqiad.wmnet with reason: Troubleshooting remote logging — T350567

gerritbot added a comment.Jun 12 2024, 2:28 PM

Change #1042273 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] cassandra: alternate logging hostname definition

https://gerrit.wikimedia.org/r/1042273

Eevans added a comment.Jun 12 2024, 3:08 PM
In T350567#9884253, @MoritzMuehlenhoff wrote:

Can you please uninstall openjdk-8-* on the migrated clusters? (simply run dpkg --remove openjdk-8-jdk openjre-8-jre openjdk-8-jdk-headless openjre-8-jre-headless via Cumin). This avoids confusion the next time we roll out new Java security updates.

Yup, will do!

Eevans updated the task description. (Show Details)Jun 12 2024, 3:14 PM
gerritbot added a comment.Jun 12 2024, 9:08 PM

Change #1042273 merged by Eevans:

[operations/puppet@production] cassandra: alternate logging hostname definition

https://gerrit.wikimedia.org/r/1042273

gerritbot added a comment.Jun 13 2024, 7:22 PM

Change #1042234 merged by Eevans:

[operations/puppet@production] aqs: Upgrade cluster to Java 11

https://gerrit.wikimedia.org/r/1042234

Stashbot added a comment.Jun 13 2024, 7:28 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-13T19:28:32Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching A:aqs-codfw: Upgrade to Java 11 — T350567 - eevans@cumin1002

Maintenance_bot removed a project: Patch-For-Review.Jun 13 2024, 7:31 PM
Stashbot added a comment.Jun 13 2024, 8:55 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-13T20:55:47Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:aqs-codfw: Upgrade to Java 11 — T350567 - eevans@cumin1002

Stashbot added a comment.Jun 13 2024, 9:33 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-13T21:33:52Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching A:aqs-eqiad: Upgrade to Java 11 — T350567 - eevans@cumin1002

Stashbot added a comment.Jun 13 2024, 11:02 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-13T23:02:38Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:aqs-eqiad: Upgrade to Java 11 — T350567 - eevans@cumin1002

Eevans updated the task description. (Show Details)Jun 14 2024, 1:30 PM
Eevans moved this task from Next to In-Progress on the Cassandra board.Jun 14 2024, 7:56 PM
Eevans mentioned this in T310226: Investigate logback HOSTNAME property assignment in Cassandra >= 3.11.13.Jun 14 2024, 8:18 PM
gerritbot added a comment.Jun 17 2024, 2:38 PM

Change #1046695 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] restbase1028: Upgrade to Java 11

https://gerrit.wikimedia.org/r/1046695

gerritbot added a project: Patch-For-Review.Jun 17 2024, 2:38 PM
gerritbot added a comment.Jun 17 2024, 2:59 PM

Change #1046695 merged by Eevans:

[operations/puppet@production] restbase1028: Upgrade to Java 11

https://gerrit.wikimedia.org/r/1046695

Maintenance_bot removed a project: Patch-For-Review.Jun 17 2024, 3:31 PM
gerritbot added a comment.Jun 18 2024, 1:46 PM

Change #1047087 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] restbase: upgrade cluster to Java 11

https://gerrit.wikimedia.org/r/1047087

gerritbot added a project: Patch-For-Review.Jun 18 2024, 1:46 PM
gerritbot added a comment.Jun 18 2024, 4:18 PM

Change #1047087 merged by Eevans:

[operations/puppet@production] restbase: upgrade cluster to Java 11

https://gerrit.wikimedia.org/r/1047087

Stashbot added a comment.Jun 18 2024, 4:22 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-18T16:22:58Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching A:restbase-codfw: Upgrade to Java 11 — T350567 - eevans@cumin1002

Maintenance_bot removed a project: Patch-For-Review.Jun 18 2024, 4:30 PM
Stashbot added a comment.Jun 18 2024, 6:29 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-18T18:29:42Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:restbase-codfw: Upgrade to Java 11 — T350567 - eevans@cumin1002

Stashbot added a comment.Jun 18 2024, 6:49 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-18T18:49:52Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching A:restbase-eqiad: Upgrade to Java 11 — T350567 - eevans@cumin1002

Eevans updated the task description. (Show Details)Jun 18 2024, 7:25 PM
Stashbot added a comment.Jun 18 2024, 8:59 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-18T20:59:53Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:restbase-eqiad: Upgrade to Java 11 — T350567 - eevans@cumin1002

Eevans updated the task description. (Show Details)Jun 18 2024, 11:36 PM
gerritbot added a comment.Jun 20 2024, 1:16 PM

Change #1047990 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] sessionstore: Upgrade to Java 11

https://gerrit.wikimedia.org/r/1047990

gerritbot added a project: Patch-For-Review.Jun 20 2024, 1:16 PM
gerritbot added a comment.Jun 20 2024, 2:09 PM

Change #1047990 merged by Eevans:

[operations/puppet@production] sessionstore: Upgrade to Java 11

https://gerrit.wikimedia.org/r/1047990

Stashbot added a comment.Jun 20 2024, 2:22 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-20T14:22:40Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching sessionstore2004.codfw.wmnet: Upgrade to Java 11 — T350567 - eevans@cumin1002

Stashbot added a comment.Jun 20 2024, 2:29 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-20T14:29:00Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching sessionstore2004.codfw.wmnet: Upgrade to Java 11 — T350567 - eevans@cumin1002

Stashbot added a comment.Jun 20 2024, 2:30 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-20T14:30:14Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching sessionstore200[5-6].codfw.wmnet: Upgrade to Java 11 — T350567 - eevans@cumin1002

Maintenance_bot removed a project: Patch-For-Review.Jun 20 2024, 2:33 PM
Stashbot added a comment.Jun 20 2024, 2:42 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-20T14:42:24Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching sessionstore200[5-6].codfw.wmnet: Upgrade to Java 11 — T350567 - eevans@cumin1002

Stashbot added a comment.Jun 20 2024, 2:46 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-20T14:46:14Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching sessionstore100[4-6].eqiad.wmnet: Upgrade to Java 11 — T350567 - eevans@cumin1002

Stashbot added a comment.Jun 20 2024, 3:04 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-20T15:04:26Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching sessionstore100[4-6].eqiad.wmnet: Upgrade to Java 11 — T350567 - eevans@cumin1002

Eevans closed this task as Resolved.Jun 20 2024, 3:09 PM
Eevans updated the task description. (Show Details)

Done!

macro-deployed

MoritzMuehlenhoff added a comment.Jun 24 2024, 11:53 AM

Very nice!

Eevans mentioned this in T357791: Cassandra upgrades to Debian Bookworm.Jun 26 2024, 6:04 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits