Host => wdqs2007.eqiad.wmnet
(Purchased 2019-12-12 so should be in warranty)
- - If other than a hard drive issue, please depool the machine (and confirm that it’s been depooled) for us to work on it. If not, please provide time frame for us to take the machine down.
- - Put system into a failed state in Netbox: https://netbox.wikimedia.org/dcim/devices/2396/
- - Urgency: High We don't maintain a lot of capacity in codfw wdqs (only 4 hosts) so having one offline is pretty painful
- - Host keeps entering ssh unreachable state. The host was found to be unreachable, I powercycled it which successfully got ssh working again, and then a few hours later it dropped back into ssh unreachability.
- - Assign correct project tag and appropriate owner (based on above). Also, please ensure the service owners of the host(s) are added as subscribers to provide any additional input.
racadm>>racadm getsel Record: 1 Date/Time: 12/12/2019 11:05:12 Source: system Severity: Ok Description: Log cleared. ------------------------------------------------------------------------------- Record: 2 Date/Time: 02/20/2020 15:56:09 Source: system Severity: Critical Description: Power supply redundancy is lost. ------------------------------------------------------------------------------- Record: 3 Date/Time: 02/20/2020 15:56:11 Source: system Severity: Critical Description: The power input for power supply 1 is lost. ------------------------------------------------------------------------------- Record: 4 Date/Time: 02/20/2020 15:56:15 Source: system Severity: Ok Description: The power supplies are redundant. ------------------------------------------------------------------------------- Record: 5 Date/Time: 02/20/2020 15:56:16 Source: system Severity: Ok Description: The input power for power supply 1 has been restored. ------------------------------------------------------------------------------- Record: 6 Date/Time: 02/20/2020 15:56:49 Source: system Severity: Critical Description: The power input for power supply 2 is lost. ------------------------------------------------------------------------------- Record: 7 Date/Time: 02/20/2020 15:56:55 Source: system Severity: Critical Description: Power supply redundancy is lost. ------------------------------------------------------------------------------- Record: 8 Date/Time: 02/20/2020 15:57:00 Source: system Severity: Ok Description: The power supplies are redundant. ------------------------------------------------------------------------------- Record: 9 Date/Time: 02/20/2020 15:57:04 Source: system Severity: Ok Description: The input power for power supply 2 has been restored. ------------------------------------------------------------------------------- Record: 10 Date/Time: 02/20/2020 16:01:19 Source: system Severity: Critical Description: The power input for power supply 2 is lost. ------------------------------------------------------------------------------- Record: 11 Date/Time: 02/20/2020 16:01:24 Source: system Severity: Ok Description: The input power for power supply 2 has been restored. ------------------------------------------------------------------------------- Record: 12 Date/Time: 02/20/2020 16:02:55 Source: system Severity: Critical Description: Power supply redundancy is lost. ------------------------------------------------------------------------------- Record: 13 Date/Time: 02/20/2020 16:02:56 Source: system Severity: Critical Description: The power input for power supply 1 is lost. ------------------------------------------------------------------------------- Record: 14 Date/Time: 02/20/2020 16:03:00 Source: system Severity: Ok Description: The power supplies are redundant. ------------------------------------------------------------------------------- Record: 15 Date/Time: 02/20/2020 16:03:01 Source: system Severity: Ok Description: The input power for power supply 1 has been restored. ------------------------------------------------------------------------------- Record: 16 Date/Time: 02/11/2021 17:33:57 Source: system Severity: Critical Description: The power input for power supply 1 is lost. ------------------------------------------------------------------------------- Record: 17 Date/Time: 02/11/2021 17:34:02 Source: system Severity: Ok Description: The input power for power supply 1 has been restored. ------------------------------------------------------------------------------- Record: 18 Date/Time: 02/11/2021 17:34:15 Source: system Severity: Critical Description: The power input for power supply 2 is lost. ------------------------------------------------------------------------------- Record: 19 Date/Time: 02/11/2021 17:34:16 Source: system Severity: Critical Description: Power supply redundancy is lost. ------------------------------------------------------------------------------- Record: 20 Date/Time: 02/11/2021 17:34:25 Source: system Severity: Ok Description: The input power for power supply 2 has been restored. ------------------------------------------------------------------------------- Record: 21 Date/Time: 02/11/2021 17:34:26 Source: system Severity: Ok Description: The power supplies are redundant. -------------------------------------------------------------------------------