Page MenuHomePhabricator

Jclark-ctr (John Clark)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Jul 24 2019, 8:11 PM (244 w, 13 h)
Availability
Available
LDAP User
Jclark-ctr
MediaWiki User
Jclark-ctr [ Global Accounts ]

Recent Activity

Wed, Mar 20

Jclark-ctr closed T359632: install (2) 1.92TB SSDs from decom into prometheus100[56] as Resolved.

drives installed

Wed, Mar 20, 1:41 PM · ops-eqiad, SRE, procurement

Tue, Mar 19

Jclark-ctr added a comment to T359049: hw troubleshooting: /dev/sdg disk not working properly in cloudcephosd1017.eqiad.wmnet.

@dcaro server is out of warranty i did replace disk with an extra one we had on hand in eqiad please confirm fixed issue and close ticket

Tue, Mar 19, 7:41 PM · DC-Ops, Cloud-VPS, cloud-services-team
Jclark-ctr closed T360468: Degraded RAID on dumpsdata1006 as Resolved.
Tue, Mar 19, 7:34 PM · SRE, ops-eqiad
Jclark-ctr claimed T360468: Degraded RAID on dumpsdata1006.

no disk issues it is rebuilding

Tue, Mar 19, 7:34 PM · SRE, ops-eqiad
Jclark-ctr closed T359702: Degraded RAID on dumpsdata1007 as Resolved.

replaced disk 7 with onhand disk will put replacement into extra storage when it arrives

Tue, Mar 19, 7:34 PM · Data-Engineering, SRE, ops-eqiad
Jclark-ctr added a comment to T359702: Degraded RAID on dumpsdata1007.

Replaced disk 5.

Tue, Mar 19, 7:26 PM · Data-Engineering, SRE, ops-eqiad

Mon, Mar 18

Jclark-ctr triaged T360356: Request access to servers Dcops group as Medium priority.
Mon, Mar 18, 5:37 PM · SRE, Infrastructure-Foundations
Jclark-ctr created T360356: Request access to servers Dcops group.
Mon, Mar 18, 5:35 PM · SRE, Infrastructure-Foundations

Wed, Mar 13

Jclark-ctr added a comment to T359940: hw troubleshooting: Unidentified for db1246.eqiad.wmnet.

Followed dell troubleshooting steps. updated firmware for Bios ,idrac already most recent multiple bios firmwares versions have come out flagged as urgent

Wed, Mar 13, 2:13 PM · DBA, SRE, ops-eqiad, DC-Ops

Tue, Mar 12

Jclark-ctr added a comment to T359702: Degraded RAID on dumpsdata1007.

Ticket canceled by dell SR186677718 with no reason 14 hours after creating request.

Tue, Mar 12, 9:20 AM · Data-Engineering, SRE, ops-eqiad

Mon, Mar 11

Jclark-ctr added a comment to T359702: Degraded RAID on dumpsdata1007.

ticket submitted

Mon, Mar 11, 10:48 AM · Data-Engineering, SRE, ops-eqiad
Jclark-ctr claimed T359702: Degraded RAID on dumpsdata1007.
Mon, Mar 11, 10:28 AM · Data-Engineering, SRE, ops-eqiad

Fri, Mar 8

Jclark-ctr added a comment to T348643: cloudcephosd1021-1034: hard drive sector errors increasing.

@dcaro thanks for the notes much more productive meeting. although nothing popped out for the engineer he also admitted he did not know what to look for on the logs for Debian linux. I will spend some time researching today/tonight while traveling to see what I can find also.

Fri, Mar 8, 3:16 PM · cloud-services-team (FY2023/2024-Q3-Q4), SRE, ops-eqiad, DC-Ops, Cloud-VPS
Jclark-ctr added a comment to T359632: install (2) 1.92TB SSDs from decom into prometheus100[56].

@RobH i have plenty of 1.92tb ssd i have pulled 10x ssd and will put a few away as spares if needed later

Fri, Mar 8, 3:09 PM · ops-eqiad, SRE, procurement

Wed, Mar 6

Jclark-ctr added a comment to T358727: Reclaim recently-decommed CP host for WDQS (see T352253).

@bking was puppet and site.pp updated? unfortunately me and Valerie do not have access to push updates and has become a process for sre owner to do with procurement ticket

Wed, Mar 6, 10:33 PM · Discovery-Search (Current work), Data-Platform-SRE (2024.03.04 - 2024.03.24), Wikidata, wmde-wikidata-tech, SRE, ops-eqiad

Mon, Mar 4

Jclark-ctr added a comment to T358763: hw move: GPU from stat1005 to stat1010.

Removed gpu from stat1005
found power plug has changed between 730xd to 740xd.

Mon, Mar 4, 5:30 PM · SRE, ops-eqiad, DC-Ops

Fri, Mar 1

Jclark-ctr added a comment to T355353: Q3:rack/setup/install dbprov100[56].

@jcrespo are the Raid instructions backwards os is usually on ssd's RAID 0?

Fri, Mar 1, 6:00 PM · Patch-For-Review, SRE, Data-Persistence, ops-eqiad, DC-Ops
Jclark-ctr closed T313463: eqiad: upgrade row C and D uplinks from 4x10G to 1x40G as Resolved.

disconnected and removed from netbox

Fri, Mar 1, 5:26 PM · netops, SRE-Sprint-Week-Sustainability-March2023, ops-eqiad, Infrastructure-Foundations
Jclark-ctr closed T313463: eqiad: upgrade row C and D uplinks from 4x10G to 1x40G, a subtask of T291627: Packet Drops on Eqiad ASW -> CR uplinks, as Resolved.
Fri, Mar 1, 5:26 PM · SRE, Infrastructure-Foundations, netops
Jclark-ctr closed T358812: PowerSupplyFailure as Resolved.

Duplicate ticket for T358787

Fri, Mar 1, 5:15 PM · SRE, ops-eqiad
Jclark-ctr added a comment to T358763: hw move: GPU from stat1005 to stat1010.

@BTullis I will be available monday 10am (est) if that works for you

Fri, Mar 1, 5:11 PM · SRE, ops-eqiad, DC-Ops

Thu, Feb 29

Jclark-ctr moved T358727: Reclaim recently-decommed CP host for WDQS (see T352253) from Backlog to Racking Tasks on the ops-eqiad board.
Thu, Feb 29, 5:12 PM · Discovery-Search (Current work), Data-Platform-SRE (2024.03.04 - 2024.03.24), Wikidata, wmde-wikidata-tech, SRE, ops-eqiad
Jclark-ctr added a comment to T358763: hw move: GPU from stat1005 to stat1010.

@BTullis would you like to do before or after sre summit?

Thu, Feb 29, 5:12 PM · SRE, ops-eqiad, DC-Ops
Jclark-ctr moved T358763: hw move: GPU from stat1005 to stat1010 from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Thu, Feb 29, 5:11 PM · SRE, ops-eqiad, DC-Ops
Jclark-ctr moved T355353: Q3:rack/setup/install dbprov100[56] from Racking Tasks to Remote Work on the ops-eqiad board.
Thu, Feb 29, 5:10 PM · Patch-For-Review, SRE, Data-Persistence, ops-eqiad, DC-Ops

Tue, Feb 27

Jclark-ctr closed T355700: Q#:rack/setup/install logging-hd100[123] as Resolved.
Tue, Feb 27, 6:58 PM · SRE, SRE Observability, ops-eqiad, DC-Ops
Jclark-ctr closed T355269: Q3:rack/setup/install es10[35-40] as Resolved.
Tue, Feb 27, 4:26 PM · Data-Persistence, SRE, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T355269: Q3:rack/setup/install es10[35-40].
Tue, Feb 27, 4:25 PM · Data-Persistence, SRE, ops-eqiad, DC-Ops

Feb 26 2024

Jclark-ctr updated the task description for T355269: Q3:rack/setup/install es10[35-40].
Feb 26 2024, 5:46 PM · Data-Persistence, SRE, ops-eqiad, DC-Ops

Feb 22 2024

Jclark-ctr claimed T355700: Q#:rack/setup/install logging-hd100[123].
Feb 22 2024, 8:19 PM · SRE, SRE Observability, ops-eqiad, DC-Ops

Feb 21 2024

Jclark-ctr updated the task description for T355571: Q#:rack/setup/install an-redacteddb1001.
Feb 21 2024, 5:45 PM · Data-Platform-SRE (2024.02.12 - 2024.03.03), SRE, ops-eqiad, DC-Ops
Jclark-ctr reassigned T355571: Q#:rack/setup/install an-redacteddb1001 from VRiley-WMF to BTullis.

@BTullis this is a custom configuration and i am not having any luck with imaging 20 disk raid10. if you can asisst thank you

Feb 21 2024, 5:45 PM · Data-Platform-SRE (2024.02.12 - 2024.03.03), SRE, ops-eqiad, DC-Ops
Jclark-ctr closed T353408: Cloudvirt1063.eqiad.wmnet overheating as Resolved.

closing ticket 7 days no faults

Feb 21 2024, 5:18 PM · Cloud-VPS, cloud-services-team (Hardware), SRE, ops-eqiad
Jclark-ctr closed T353408: Cloudvirt1063.eqiad.wmnet overheating, a subtask of T352595: NodeDown, as Resolved.
Feb 21 2024, 5:17 PM · cloud-services-team
Jclark-ctr closed T353408: Cloudvirt1063.eqiad.wmnet overheating, a subtask of T353406: NodeDown cloudvirt1063, as Resolved.
Feb 21 2024, 5:17 PM · cloud-services-team
Jclark-ctr reassigned T358046: decommission cloudelastic100[1-4].wikimedia.org from Jclark-ctr to VRiley-WMF.
Feb 21 2024, 5:15 PM · SRE, ops-eqiad, decommission-hardware
Jclark-ctr moved T357790: decommission ms-be10[44-50].eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 21 2024, 4:46 PM · SRE-swift-storage, SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr moved T358046: decommission cloudelastic100[1-4].wikimedia.org from Backlog to Decommission on the ops-eqiad board.
Feb 21 2024, 4:45 PM · SRE, ops-eqiad, decommission-hardware

Feb 20 2024

Jclark-ctr moved T355571: Q#:rack/setup/install an-redacteddb1001 from Racking Tasks to Remote Work on the ops-eqiad board.
Feb 20 2024, 11:41 PM · Data-Platform-SRE (2024.02.12 - 2024.03.03), SRE, ops-eqiad, DC-Ops

Feb 16 2024

Jclark-ctr updated the task description for T355571: Q#:rack/setup/install an-redacteddb1001.
Feb 16 2024, 8:51 AM · Data-Platform-SRE (2024.02.12 - 2024.03.03), SRE, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T355571: Q#:rack/setup/install an-redacteddb1001.
Feb 16 2024, 8:47 AM · Data-Platform-SRE (2024.02.12 - 2024.03.03), SRE, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T355571: Q#:rack/setup/install an-redacteddb1001.

Firmware cookbook seems to be broken Manually downgraded firmware on server for Nic.

Feb 16 2024, 8:41 AM · Data-Platform-SRE (2024.02.12 - 2024.03.03), SRE, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T355571: Q#:rack/setup/install an-redacteddb1001.
Feb 16 2024, 8:40 AM · Data-Platform-SRE (2024.02.12 - 2024.03.03), SRE, ops-eqiad, DC-Ops

Feb 15 2024

Jclark-ctr closed T354893: Q3:rack/setup/install restbase10[34-42] as Resolved.
Feb 15 2024, 2:31 AM · SRE, RESTBase, ops-eqiad, DC-Ops

Feb 14 2024

Jclark-ctr added a comment to T348643: cloudcephosd1021-1034: hard drive sector errors increasing.

https://www.minitool.com/lib/uncorrectable-sector-count.html
https://community.wd.com/t/how-to-interpret-following-s-m-a-r-t-values-ata-error-count-offline-uncorrectable/241408

Feb 14 2024, 8:09 PM · cloud-services-team (FY2023/2024-Q3-Q4), SRE, ops-eqiad, DC-Ops, Cloud-VPS
Jclark-ctr added a comment to T348643: cloudcephosd1021-1034: hard drive sector errors increasing.

@dcaro here is an update from dell

Feb 14 2024, 8:07 PM · cloud-services-team (FY2023/2024-Q3-Q4), SRE, ops-eqiad, DC-Ops, Cloud-VPS
Jclark-ctr added a comment to T354893: Q3:rack/setup/install restbase10[34-42].

@Eevans sorry about missing that. kicking of image now

Feb 14 2024, 7:35 PM · SRE, RESTBase, ops-eqiad, DC-Ops
Jclark-ctr claimed T357460: Degraded RAID on an-worker1173.

Submitted Request for replacement 4tb hdd

Feb 14 2024, 6:39 AM · SRE, ops-eqiad
Jclark-ctr moved T357273: decommission db1133.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 14 2024, 6:29 AM · SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr moved T357292: decommission db1146.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 14 2024, 6:29 AM · SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr moved T357275: decommission db1135.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 14 2024, 6:29 AM · SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr moved T357289: decommission db1144.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 14 2024, 6:29 AM · SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr moved T357287: decommission db1139.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 14 2024, 6:29 AM · SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr moved T357288: decommission db1140.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 14 2024, 6:29 AM · SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr moved T357290: decommission db1145.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 14 2024, 6:28 AM · SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr moved T357293: decommission db1149.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Feb 14 2024, 6:28 AM · SRE, ops-eqiad, DC-Ops, decommission-hardware
Jclark-ctr added a comment to T353408: Cloudvirt1063.eqiad.wmnet overheating.

@Andrew following up to see if this has been put back into service?

Feb 14 2024, 6:28 AM · Cloud-VPS, cloud-services-team (Hardware), SRE, ops-eqiad
Jclark-ctr closed T354893: Q3:rack/setup/install restbase10[34-42] as Resolved.
Feb 14 2024, 6:23 AM · SRE, RESTBase, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T354893: Q3:rack/setup/install restbase10[34-42].
Feb 14 2024, 6:23 AM · SRE, RESTBase, ops-eqiad, DC-Ops

Feb 13 2024

Jclark-ctr updated the task description for T354893: Q3:rack/setup/install restbase10[34-42].
Feb 13 2024, 5:38 PM · SRE, RESTBase, ops-eqiad, DC-Ops

Feb 9 2024

Jclark-ctr updated the task description for T354893: Q3:rack/setup/install restbase10[34-42].
Feb 9 2024, 1:01 PM · SRE, RESTBase, ops-eqiad, DC-Ops

Feb 8 2024

Jclark-ctr updated the task description for T354893: Q3:rack/setup/install restbase10[34-42].
Feb 8 2024, 10:46 PM · SRE, RESTBase, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T354893: Q3:rack/setup/install restbase10[34-42].
Feb 8 2024, 10:45 PM · SRE, RESTBase, ops-eqiad, DC-Ops
Jclark-ctr claimed T354893: Q3:rack/setup/install restbase10[34-42].
Feb 8 2024, 10:15 PM · SRE, RESTBase, ops-eqiad, DC-Ops
Jclark-ctr moved T355269: Q3:rack/setup/install es10[35-40] from Backlog to Racking Tasks on the ops-eqiad board.
Feb 8 2024, 2:38 PM · Data-Persistence, SRE, ops-eqiad, DC-Ops
Jclark-ctr moved T356719: Decommission sessionstore100[1-3] from Backlog to Decommission on the ops-eqiad board.
Feb 8 2024, 2:38 PM · SRE, ops-eqiad, Cassandra, decommission-hardware
Jclark-ctr assigned T356719: Decommission sessionstore100[1-3] to VRiley-WMF.
Feb 8 2024, 2:37 PM · SRE, ops-eqiad, Cassandra, decommission-hardware

Feb 7 2024

Jclark-ctr added a comment to T348643: cloudcephosd1021-1034: hard drive sector errors increasing.

@dcaro The same response was sent for each case please advise how you would like me to proceed.

Feb 7 2024, 2:17 PM · cloud-services-team (FY2023/2024-Q3-Q4), SRE, ops-eqiad, DC-Ops, Cloud-VPS

Feb 5 2024

Jclark-ctr added a comment to T354499: Degraded RAID on aqs1013.

performed drive swap. blew out slot with compressed air If fails again we would need to look at possibly backplane swap

Feb 5 2024, 3:53 PM · SRE, ops-eqiad
Jclark-ctr added a comment to T354499: Degraded RAID on aqs1013.

@Eevans Would you mind if swapped it again possibly 3rd times the charm. all bays in server are filled. possibly next if it fails again would be backplane swap

Feb 5 2024, 3:47 PM · SRE, ops-eqiad

Jan 31 2024

Jclark-ctr closed T356033: Disk (sdl) failed in ms-be1068 as Resolved.

received new drive and returned failed drive

Jan 31 2024, 7:08 PM · SRE, SRE-swift-storage, ops-eqiad, DC-Ops

Jan 30 2024

Jclark-ctr added a comment to T354591: db1224 crashed - hardware error.

@Marostegui firmware updates have been completed and is ready to be put back in service

Jan 30 2024, 2:48 PM · SRE, DC-Ops, ops-eqiad, DBA

Jan 29 2024

Jclark-ctr moved T348643: cloudcephosd1021-1034: hard drive sector errors increasing from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Jan 29 2024, 7:14 PM · cloud-services-team (FY2023/2024-Q3-Q4), SRE, ops-eqiad, DC-Ops, Cloud-VPS
Jclark-ctr moved T356033: Disk (sdl) failed in ms-be1068 from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Jan 29 2024, 7:14 PM · SRE, SRE-swift-storage, ops-eqiad, DC-Ops
Jclark-ctr moved T353408: Cloudvirt1063.eqiad.wmnet overheating from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Jan 29 2024, 7:14 PM · Cloud-VPS, cloud-services-team (Hardware), SRE, ops-eqiad
Jclark-ctr moved T354499: Degraded RAID on aqs1013 from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Jan 29 2024, 7:14 PM · SRE, ops-eqiad
Jclark-ctr claimed T356033: Disk (sdl) failed in ms-be1068.
Jan 29 2024, 4:35 PM · SRE, SRE-swift-storage, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T356033: Disk (sdl) failed in ms-be1068.

Started case with dell ordered replacement drive.
You have successfully submitted request SR184210022.

Jan 29 2024, 4:34 PM · SRE, SRE-swift-storage, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T354591: db1224 crashed - hardware error.

Yes that works for me tomorrow just let me know Thanks

Jan 29 2024, 4:09 PM · SRE, DC-Ops, ops-eqiad, DBA
Jclark-ctr added a comment to T354591: db1224 crashed - hardware error.

@Marostegui Dell has requested firmware updates and reseating device NetXtreme BCM5720 Gigabit Ethernet PCIe on bus 4. When is a good time to take server down for reseating and firmware updates?

Jan 29 2024, 4:07 PM · SRE, DC-Ops, ops-eqiad, DBA

Jan 25 2024

Jclark-ctr added a comment to T353408: Cloudvirt1063.eqiad.wmnet overheating.

updated system settings server is back up now

Jan 25 2024, 3:20 PM · Cloud-VPS, cloud-services-team (Hardware), SRE, ops-eqiad
Jclark-ctr added a comment to T348643: cloudcephosd1021-1034: hard drive sector errors increasing.

Submitted all new tsr reports along with smartctl data

Jan 25 2024, 2:50 PM · cloud-services-team (FY2023/2024-Q3-Q4), SRE, ops-eqiad, DC-Ops, Cloud-VPS

Jan 17 2024

Jclark-ctr reassigned T355269: Q3:rack/setup/install es10[35-40] from Jclark-ctr to Marostegui.

If you can update installation instructions and update preseed.yaml, and site.pp if needed Thanks

Jan 17 2024, 10:54 PM · Data-Persistence, SRE, ops-eqiad, DC-Ops
Jclark-ctr added a parent task for T355269: Q3:rack/setup/install es10[35-40]: Unknown Object (Task).
Jan 17 2024, 10:51 PM · Data-Persistence, SRE, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T355269: Q3:rack/setup/install es10[35-40].
Jan 17 2024, 10:51 PM · Data-Persistence, SRE, ops-eqiad, DC-Ops
Jclark-ctr created T355269: Q3:rack/setup/install es10[35-40].
Jan 17 2024, 10:50 PM · Data-Persistence, SRE, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T353408: Cloudvirt1063.eqiad.wmnet overheating.

@Andrew before i change from PerformancePerWatt to PerformanceOptimized do you have any hesitations with that change?

Jan 17 2024, 8:06 PM · Cloud-VPS, cloud-services-team (Hardware), SRE, ops-eqiad

Jan 11 2024

Jclark-ctr claimed T354591: db1224 crashed - hardware error.

Confirmed: Service Request 183160693 was successfully submitted.

Jan 11 2024, 3:23 PM · SRE, DC-Ops, ops-eqiad, DBA
Jclark-ctr closed T354765: InterfaceSpeedError as Resolved.

Replaced cable

Jan 11 2024, 3:06 PM · SRE, ops-eqiad
Jclark-ctr claimed T354854: Degraded RAID on db1157.
Jan 11 2024, 3:03 PM · DBA, SRE, ops-eqiad
Jclark-ctr added a comment to T354854: Degraded RAID on db1157.

@Marostegui Server is out of warranty. Replaced Disk with ssd from recently decom server

Jan 11 2024, 3:00 PM · DBA, SRE, ops-eqiad
Jclark-ctr added a comment to T353408: Cloudvirt1063.eqiad.wmnet overheating.

Updated firmware per Dells Request cleared logs resent new tsr report. waiting for response.

Jan 11 2024, 2:53 PM · Cloud-VPS, cloud-services-team (Hardware), SRE, ops-eqiad

Jan 8 2024

Jclark-ctr added a comment to T348643: cloudcephosd1021-1034: hard drive sector errors increasing.

Self dispatched 8 new drives for cloudcephosd1028

Jan 8 2024, 3:38 PM · cloud-services-team (FY2023/2024-Q3-Q4), SRE, ops-eqiad, DC-Ops, Cloud-VPS
Jclark-ctr claimed T354499: Degraded RAID on aqs1013.
Jan 8 2024, 3:13 PM · SRE, ops-eqiad
Jclark-ctr assigned T353913: PDU sensor over limit to VRiley-WMF.
Jan 8 2024, 3:11 PM · SRE, ops-eqiad
Jclark-ctr added a comment to T353482: decommission wdqs10[09-10].eqiad.wmnet.

@RKemper unsure if this is ready for dcops?

Jan 8 2024, 3:09 PM · SRE, ops-eqiad, decommission-hardware
Jclark-ctr added a comment to T353408: Cloudvirt1063.eqiad.wmnet overheating.

Reopened Ticket with Dell

Jan 8 2024, 3:08 PM · Cloud-VPS, cloud-services-team (Hardware), SRE, ops-eqiad
Jclark-ctr closed T354143: Degraded RAID on dumpsdata1006 as Resolved.

Replaced Failed Drive

Jan 8 2024, 3:04 PM · SRE, ops-eqiad

Jan 3 2024

Jclark-ctr claimed T354251: Degraded RAID on ganeti1031.
Jan 3 2024, 2:49 PM · SRE, ops-eqiad

Jan 2 2024

Jclark-ctr closed T351862: InterfaceSpeedError as Resolved.

Replaced Cable

Jan 2 2024, 6:27 PM · observability, SRE, ops-eqiad