Log In
Papaul
Papaul (Papaul)
User
Projects (7)
DC-Ops
Group
ops-codfw
Component
ops-eqdfw
Component
ops-eqord
Component
procurement
Component
Calendar
Today
Clear sailing ahead.
Tomorrow
Clear sailing ahead.
Friday
Clear sailing ahead.
User Details
User Since
Dec 18 2014, 3:39 PM (352 w, 6 d)
Availability
Available
LDAP User
Papaul
MediaWiki User
Unknown
Recent Activity
Fri, Sep 10
Papaul updated the task description for T289624: Q1: (Need By: TBD) rack/setup/install centrallog2002.codfw.wmnet​.
Fri, Sep 10, 6:34 PM · SRE, SRE Observability (FY2021/2022-Q1), ops-codfw, DC-Ops
Papaul added a comment to T289624: Q1: (Need By: TBD) rack/setup/install centrallog2002.codfw.wmnet​.
In T289624#7345155, @ops-monitoring-bot wrote:
Completed auto-reimage of hosts:
['puppetmaster2004.codfw.wmnet']
and were ALL successful.
Fri, Sep 10, 6:33 PM · SRE, SRE Observability (FY2021/2022-Q1), ops-codfw, DC-Ops
Papaul closed T289733: Q1: (Need By: TBD) rack/setup/install puppetmaster200[45].codfw.wmnet as Resolved.
This is complete
Fri, Sep 10, 5:30 PM · SRE, Infrastructure-Foundations, ops-codfw, DC-Ops
Papaul updated the task description for T289733: Q1: (Need By: TBD) rack/setup/install puppetmaster200[45].codfw.wmnet​.
Fri, Sep 10, 5:29 PM · SRE, Infrastructure-Foundations, ops-codfw, DC-Ops
Papaul updated subscribers of T289624: Q1: (Need By: TBD) rack/setup/install centrallog2002.codfw.wmnet​.
Bullseye installer giving me "Failed to load ldlinux.c32"
Fri, Sep 10, 4:31 PM · SRE, SRE Observability (FY2021/2022-Q1), ops-codfw, DC-Ops
Papaul updated the task description for T289733: Q1: (Need By: TBD) rack/setup/install puppetmaster200[45].codfw.wmnet​.
Fri, Sep 10, 2:31 PM · SRE, Infrastructure-Foundations, ops-codfw, DC-Ops
Papaul added a comment to T290133: Test Dell switches cabling.
default username is admin and password is YourPaSsWoRd
Fri, Sep 10, 1:54 AM · SRE, ops-codfw
Papaul updated the task description for T289624: Q1: (Need By: TBD) rack/setup/install centrallog2002.codfw.wmnet​.
Fri, Sep 10, 12:01 AM · SRE, SRE Observability (FY2021/2022-Q1), ops-codfw, DC-Ops
Thu, Sep 9
Papaul added a comment to T290133: Test Dell switches cabling.
@ayounsi
I have SONIC on all 4 switches .
Thu, Sep 9, 9:31 PM · SRE, ops-codfw
Papaul updated the task description for T289733: Q1: (Need By: TBD) rack/setup/install puppetmaster200[45].codfw.wmnet​.
Thu, Sep 9, 6:53 PM · SRE, Infrastructure-Foundations, ops-codfw, DC-Ops
Wed, Sep 8
Papaul added a comment to T287762: codfw: Ship back Raritan test PDU.
Shipped out the CPI PDU today
Wed, Sep 8, 6:50 PM · Patch-For-Review, SRE, ops-codfw
Papaul closed T289117: decommission pc2010.codfw.wmnet as Resolved.
complete
Wed, Sep 8, 2:54 PM · SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul updated the task description for T289117: decommission pc2010.codfw.wmnet.
Wed, Sep 8, 2:52 PM · SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul closed T289116: decommission pc2009.codfw.wmnet as Resolved.
complete
Wed, Sep 8, 2:52 PM · SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul closed T289115: decommission pc2008.codfw.wmnet as Resolved.
complete
Wed, Sep 8, 2:51 PM · Patch-For-Review, SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul updated the task description for T289116: decommission pc2009.codfw.wmnet.
Wed, Sep 8, 2:51 PM · SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul updated the task description for T289115: decommission pc2008.codfw.wmnet.
Wed, Sep 8, 2:51 PM · Patch-For-Review, SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul closed T290362: Netbox Errors in codfw as Resolved.
Complete
Wed, Sep 8, 2:37 PM · SRE, ops-codfw, DC-Ops
Papaul closed T290362: Netbox Errors in codfw, a subtask of T283483: Various netbox alerts running for days, as Resolved.
Wed, Sep 8, 2:37 PM · DC-Ops
Tue, Sep 7
Papaul updated the task description for T289115: decommission pc2008.codfw.wmnet.
Tue, Sep 7, 1:58 PM · Patch-For-Review, SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul updated the task description for T289116: decommission pc2009.codfw.wmnet.
Tue, Sep 7, 1:57 PM · SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul closed T290242: mw2264 went down as Resolved.
@Dzahn I checked the server today i have no errors showing on A1 closing this task . IF we have the error again please reopen the task.
Tue, Sep 7, 1:45 PM · SRE, serviceops, ops-codfw
Papaul moved T289115: decommission pc2008.codfw.wmnet from Backlog to Decommission on the ops-codfw board.
Tue, Sep 7, 1:41 PM · Patch-For-Review, SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul moved T289116: decommission pc2009.codfw.wmnet from Backlog to Decommission on the ops-codfw board.
Tue, Sep 7, 1:41 PM · SRE, ops-codfw, DC-Ops, decommission-hardware
Sat, Sep 4
Papaul added a comment to T290362: Netbox Errors in codfw.
@wiki_willy thanks will work on this next week
Sat, Sep 4, 12:21 AM · SRE, ops-codfw, DC-Ops
Fri, Sep 3
Papaul closed T289112: decommission pc2007.codfw.wmnet as Resolved.
Complete
Fri, Sep 3, 3:14 PM · SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul moved T290242: mw2264 went down from Backlog to Hardware Failure / Troubleshoot on the ops-codfw board.
Fri, Sep 3, 3:13 PM · SRE, serviceops, ops-codfw
Papaul moved T290327: codfw: es2021: Correctable memory error rate exceeded for DIMM_A1 from Backlog to Hardware Failure / Troubleshoot on the ops-codfw board.
Fri, Sep 3, 3:13 PM · SRE, DBA, ops-codfw
Papaul added a comment to T290327: codfw: es2021: Correctable memory error rate exceeded for DIMM_A1.
@Marostegui will confirm next week with day and time.
Fri, Sep 3, 3:12 PM · SRE, DBA, ops-codfw
Papaul triaged T290327: codfw: es2021: Correctable memory error rate exceeded for DIMM_A1 as Medium priority.
Fri, Sep 3, 2:56 PM · SRE, DBA, ops-codfw
Papaul created T290327: codfw: es2021: Correctable memory error rate exceeded for DIMM_A1.
Fri, Sep 3, 2:56 PM · SRE, DBA, ops-codfw
Papaul updated the task description for T289112: decommission pc2007.codfw.wmnet.
Fri, Sep 3, 2:38 PM · SRE, ops-codfw, DC-Ops, decommission-hardware
Papaul added a comment to T290242: mw2264 went down.
@Dzahn fist let us swap A1 with B1 and see if we still have the error on A1. Memory swap complete and IDRAC upgrade from 2.50 to 2.80. i will leave the task open for now until next week.
Fri, Sep 3, 2:37 PM · SRE, serviceops, ops-codfw
Thu, Sep 2
Papaul claimed T290242: mw2264 went down.
Thu, Sep 2, 3:13 PM · SRE, serviceops, ops-codfw
Papaul reassigned T290133: Test Dell switches cabling from Papaul to ayounsi.
Thu, Sep 2, 3:12 PM · SRE, ops-codfw
Wed, Sep 1
Papaul added a comment to T290133: Test Dell switches cabling.
Wed, Sep 1, 3:34 PM · SRE, ops-codfw
Tue, Aug 31
Papaul added a comment to T289624: Q1: (Need By: TBD) rack/setup/install centrallog2002.codfw.wmnet​.
@lmata will do
Tue, Aug 31, 7:39 PM · SRE, SRE Observability (FY2021/2022-Q1), ops-codfw, DC-Ops
Thu, Aug 26
Papaul added a comment to T273114: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org.
@cmooney USB in place
Thu, Aug 26, 3:36 PM · netops, Infrastructure-Foundations, SRE, DC-Ops
Aug 23 2021
Papaul closed T281459: Move YubiHSM from auth2001 to pki2001 as Resolved.
@MoritzMuehlenhoff complete
Aug 23 2021, 5:17 PM · SRE, ops-codfw
Papaul closed T281177: (Need By: TBD) rack/setup/install frdb2003.frack.codfw.wmnet as Resolved.
@Jgreen this is complete on my end . Let me know if you have any issues.
Aug 23 2021, 5:06 PM · SRE, fundraising-tech-ops, ops-codfw, DC-Ops
Papaul updated the task description for T281177: (Need By: TBD) rack/setup/install frdb2003.frack.codfw.wmnet​.
Aug 23 2021, 5:05 PM · SRE, fundraising-tech-ops, ops-codfw, DC-Ops
Papaul updated the task description for T281177: (Need By: TBD) rack/setup/install frdb2003.frack.codfw.wmnet​.
Aug 23 2021, 4:49 PM · SRE, fundraising-tech-ops, ops-codfw, DC-Ops
Papaul added a comment to T281177: (Need By: TBD) rack/setup/install frdb2003.frack.codfw.wmnet​.
papaul@fasw-c-codfw# run show interfaces ge-0/0/5 terse Interface Admin Link Proto Local Remote ge-0/0/5 up up ge-0/0/5.0 up up eth-switch
Aug 23 2021, 4:05 PM · SRE, fundraising-tech-ops, ops-codfw, DC-Ops
Aug 19 2021
Papaul closed T288586: codfw: Netbox Error as Resolved.
Have in a temporary cable ID for this. I will remove the serial cable once configuration is done.
Aug 19 2021, 2:47 PM · SRE, ops-codfw, DC-Ops
Papaul closed T289113: maps2005 power suply failure since a week as Resolved.
It was a loose power cord . Fixed
Aug 19 2021, 2:44 PM · SRE, Maps, ops-codfw
Papaul added a comment to T286463: mw2383 is misbehaving .
You welcome
Aug 19 2021, 2:11 PM · SRE, ops-codfw
Papaul added a comment to T286463: mw2383 is misbehaving .
@jijiki it looks like mw2383 is happy now can we close this task ?
Aug 19 2021, 12:26 PM · SRE, ops-codfw
Aug 18 2021
Papaul added a comment to T286463: mw2383 is misbehaving .
@jijiki Please see below for the issue we found. The Power cap was enable setting the cap limits at 128watts below the recommended range of 213-355 watts) which was less then what both CPU's needed. I disable the Power cap limit like on mw2384. We can try to put back the server in production so we can see if this resolve the issue.
thanks
Aug 18 2021, 6:25 PM · SRE, ops-codfw
Papaul moved T289113: maps2005 power suply failure since a week from Backlog to Hardware Failure / Troubleshoot on the ops-codfw board.
Aug 18 2021, 3:28 PM · SRE, Maps, ops-codfw
Papaul added a comment to T286463: mw2383 is misbehaving .
Looking at the log today i have
Aug 18 2021, 2:45 PM · SRE, ops-codfw
Papaul added a comment to T286463: mw2383 is misbehaving .
@jijiki thank you i will open a case with Dell
Aug 18 2021, 2:02 PM · SRE, ops-codfw
Aug 17 2021
Papaul added a comment to T286463: mw2383 is misbehaving .
Thank you
Aug 17 2021, 9:17 PM · SRE, ops-codfw
Papaul added a comment to T288586: codfw: Netbox Error.
@willy I am using a personal Cisco roll over cable that connects the device to the console server . This was done so that the device can be configured. once the configuration done I am planning on removing the cable.
Aug 17 2021, 1:00 PM · SRE, ops-codfw, DC-Ops
Aug 12 2021
Papaul added a comment to T287762: codfw: Ship back Raritan test PDU.
Both test PDU's removed and old PDU"s back in place.
Aug 12 2021, 4:57 PM · Patch-For-Review, SRE, ops-codfw
Aug 11 2021
Papaul added a comment to T287762: codfw: Ship back Raritan test PDU.
I open ticket #2045424 with CY1 to unplug both test PDU's in D8 for tomorrow. We will be putting back the old PDU for now until we received another test PDU.
Aug 11 2021, 6:06 PM · Patch-For-Review, SRE, ops-codfw
Aug 10 2021
Papaul closed T286787: asw-a2-codfw unresponsive as Resolved.
Received the replacement switch. Rack in C1 U43. setup the mgmt password same as the server mgmt password. Update Netbox with new serial number.
CamScanner 08-10-2021 11.13.pdf273 KB
Download
Aug 10 2021, 4:20 PM · Wikimedia-Incident, SRE, netops, ops-codfw, DC-Ops
Aug 6 2021
Papaul added a comment to T285719: Netbox Duplicate Cable IDs & Accounting Discrepancies.
@Jclark-ctr thank you for the update Willy knows already about those. Those are line cards, we can not put asset tags on line cards.
Aug 6 2021, 4:52 PM · SRE, ops-eqiad, DC-Ops
Papaul closed T285809: (Need By: ASAP) rack/setup/install ms-be20[62-65] as Resolved.
@fgiunchedi this is complete
Aug 6 2021, 1:25 AM · Patch-For-Review, SRE, ops-codfw, DC-Ops
Papaul updated the task description for T285809: (Need By: ASAP) rack/setup/install ms-be20[62-65].
Aug 6 2021, 1:25 AM · Patch-For-Review, SRE, ops-codfw, DC-Ops
Aug 5 2021
Papaul updated the task description for T285809: (Need By: ASAP) rack/setup/install ms-be20[62-65].
Aug 5 2021, 5:21 PM · Patch-For-Review, SRE, ops-codfw, DC-Ops
Papaul updated the task description for T285809: (Need By: ASAP) rack/setup/install ms-be20[62-65].
Aug 5 2021, 4:20 PM · Patch-For-Review, SRE, ops-codfw, DC-Ops
Papaul added a comment to T286787: asw-a2-codfw unresponsive.
Your replacement part associated with RMA R200361905 Item # 100 has been successfully shipped. Details of which are provided below.
Aug 5 2021, 1:49 PM · Wikimedia-Incident, SRE, netops, ops-codfw, DC-Ops
Aug 4 2021
Papaul added a comment to T273114: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org.
I as far as i know I removed the old faulty device, replaced it with this on, connected the console, power and network to the device, that's all
Aug 4 2021, 3:54 PM · netops, Infrastructure-Foundations, SRE, DC-Ops
Aug 3 2021
Papaul edited projects for T273114: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org, added: netops; removed ops-codfw.
Aug 3 2021, 8:55 PM · netops, Infrastructure-Foundations, SRE, DC-Ops
Papaul removed a project from T267714: ripe-atlas-codfw is down: ops-codfw.
Aug 3 2021, 8:53 PM · Infrastructure-Foundations, SRE, netops
Papaul lowered the priority of T286463: mw2383 is misbehaving from Medium to Low.
Aug 3 2021, 8:46 PM · SRE, ops-codfw
Papaul closed T286484: (Need By: 2021-08-31) rack/setup/install ganeti-test200[123] as Resolved.
@MoritzMuehlenhoff ready for you
Aug 3 2021, 8:32 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T286484: (Need By: 2021-08-31) rack/setup/install ganeti-test200[123].
Aug 3 2021, 8:31 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T286484: (Need By: 2021-08-31) rack/setup/install ganeti-test200[123].
Aug 3 2021, 5:35 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T286484: (Need By: 2021-08-31) rack/setup/install ganeti-test200[123].
Aug 3 2021, 4:28 PM · SRE, ops-codfw, DC-Ops
Aug 2 2021
Papaul closed T287496: decommission servers logstash202[012].codfw.wmnet​, a subtask of T281266: Decommission old ELK5 Logstash cluster, as Resolved.
Aug 2 2021, 3:48 PM · SRE Observability (FY2021/2022-Q1), Patch-For-Review, SRE
Papaul closed T287496: decommission servers logstash202[012].codfw.wmnet as Resolved.
complete
Aug 2 2021, 3:48 PM · decommission-hardware
Papaul updated the task description for T287496: decommission servers logstash202[012].codfw.wmnet​.
Aug 2 2021, 3:48 PM · decommission-hardware
Papaul closed T286879: lvs2007, lvs2009, lvs2010 should not be on the same row A switch, a subtask of T286881: Audit eqiad & codfw LVS network links, as Resolved.
Aug 2 2021, 3:38 PM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Papaul closed T286879: lvs2007, lvs2009, lvs2010 should not be on the same row A switch as Resolved.
Resolving this task since all 3 links on lvs2010 moved to asw-a4,asw-b4 and asw-c4
Aug 2 2021, 3:38 PM · SRE, Sustainability (Incident Followup), ops-codfw, DC-Ops, Traffic
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
I can set up the interface on asw-a4-codfw
Aug 2 2021, 12:49 PM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
@Vgutierrez do you have time today 10am CT to move only
lvs2010 ens2f1np1 xe-2/0/44 asw-a4-codfw from A2 to a4 xe-4/0/47
Aug 2 2021, 12:40 PM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Jul 30 2021
Papaul updated the task description for T287496: decommission servers logstash202[012].codfw.wmnet​.
Jul 30 2021, 3:47 PM · decommission-hardware
Papaul lowered the priority of T287762: codfw: Ship back Raritan test PDU from Medium to Low.
Jul 30 2021, 2:49 PM · Patch-For-Review, SRE, ops-codfw
Papaul moved T287762: codfw: Ship back Raritan test PDU from Backlog to Non-Urgent on the ops-codfw board.
Jul 30 2021, 2:46 PM · Patch-For-Review, SRE, ops-codfw
Papaul triaged T287762: codfw: Ship back Raritan test PDU as Medium priority.
Jul 30 2021, 2:44 PM · Patch-For-Review, SRE, ops-codfw
Papaul created T287762: codfw: Ship back Raritan test PDU.
Jul 30 2021, 2:44 PM · Patch-For-Review, SRE, ops-codfw
Papaul added a comment to T286463: mw2383 is misbehaving .
@wkandek thank you for the heads up
Jul 30 2021, 2:00 PM · SRE, ops-codfw
Jul 29 2021
Papaul added a comment to T286463: mw2383 is misbehaving .
@jijiki can you try to get the system back again in service? The system has 2 CPU's so it will be difficult to tell which CPU is bad if we do not have any logs telling which CPU is having issues. I will like to have the system back online so i get take a look as well when the the system is having issues. I think Rob did all the firmware upgrade which is great. If we do not find anything I will open a case with DELL
Jul 29 2021, 10:09 PM · SRE, ops-codfw
Papaul claimed T286463: mw2383 is misbehaving .
Jul 29 2021, 10:09 PM · SRE, ops-codfw
Papaul added a comment to T286787: asw-a2-codfw unresponsive.
Dear Juniper Networks Customer,
Jul 29 2021, 9:34 PM · Wikimedia-Incident, SRE, netops, ops-codfw, DC-Ops
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
@Vgutierrez thank you I have all the information needed. I will do my site audit and get back with you next week to setup a day and time to start moving those links
Jul 29 2021, 2:09 PM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
@Vgutierrez thank you. What about lvs2007 ens3f1np1? Actually it is connected to d7 and you want it to be moved to C7 or lvs2007 ens3f0np0 is already connected to C7
Jul 29 2021, 1:19 PM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
In T286881#7242985, @Vgutierrez wrote:
HostRowHost ifaceswitch ifaceswitch name
lvs2007Aens2f0np0xe-2/0/45A2
lvs2008Aens2f1np1xe-7/0/45A7
lvs2009Aens2f1np1xe-2/0/43A2
lvs2010Aens2f1np1Switch A4A4
lvs2007Bens2f1np1xe-7/0/45A7
lvs2008Bens2f0np0xe-2/0/45B2
lvs2009Bens3f0np0xe-2/0/43B2
lvs2010Bens3f0np0Switch B4B4
lvs2007Cens3f0np0xe-7/0/45C7
lvs2008Cens3f0np0xe-2/0/45C2
lvs2009Cens2f0np0xe-2/0/44C2
lvs2010Cens3f1np1Switch C4C4
lvs2007Dens3f1np1xe-7/0/45C7
lvs2008Dens3f1np1Switch D4D4
lvs2009Dens3f1np1Switch D4D4
lvs2010Dens2f0np0xe-2/0/44D2
Jul 29 2021, 3:53 AM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
HostHost ifaceswitch ifaceswitch namechange notesiface on new siwtchComplete
lvs2007ens2f0np0xe-2/0/45asw-a2-codfwno changeno change
lvs2007ens2f1np1xe-7/0/45asw-b7-codfwno changeno change
lvs2007ens3f0np0xe-7/0/45asw-c7-codfwno changeno change
lvs2007ens3f1np1xe-7/0/45asw-d7-codfwno changeno change
lvs2008ens2f0np0xe-2/0/45asw-b2-codfwno changeno change
lvs2008ens2f1np1xe-7/0/45asw-a7-codfwno changeno change
lvs2008ens3f0np0xe-2/0/45asw-c2-codfwno changeno change
lvs2008ens3f1np1xe-2/0/46asw-d4-codfwfrom D2 to D4xe-4/0/47
lvs2009ens2f0np0xe-2/0/44asw-c2-codfwno changeno change
lvs2009ens2f1np1xe-2/0/43asw-a2-codfwno changeno change
lvs2009ens3f0np0xe-2/0/43asw-b2-codfwno changeno change
lvs2009ens3f1np1xe-2/0/43asw-d2-codfwfrom d2 to d4xe-4/0/46
lvs2010ens2f0np0xe-2/0/44asw-d2-codfwno changeno change
lvs2010ens2f1np1xe-2/0/44asw-a4-codfwfrom A2 to a4xe-4/0/47
lvs2010ens3f0np0xe-2/0/44asw-b4-codfwfrom b2 to b4xe-4/0/47
lvs2010ens3f1np1xe-2/0/43asw-c4-codfwfrom c2 to c4xe-4/0/47
Jul 29 2021, 3:48 AM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Jul 27 2021
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
Ok understood. Please provide me with the configuration you want in a table like above for each server which NIC connects to which switch and i can do my site audit on how best to re-route those links.
Jul 27 2021, 1:52 PM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
@Vgutierrez if my understanding is right you want for example lvsX NIC 1 to switch asw-a2 NIC 2 to switch asw-a7 (2 switches in ROW A) and NIC 3 to switch asw-b2 and NIC 4 to swirch asw-b7 (2 switch in ROW B) and so on ?
Jul 27 2021, 1:17 PM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Papaul added a comment to T286881: Audit eqiad & codfw LVS network links.
@Vgutierrez the only limitation i cans see is the number of NIC ports on each server. Each server has 4 NIC's each NIC connected to 1 row on 1 switch. If we do keep the existing configuration then we will have to add another 4 ports NIC in each server so that each server can have 2 connections on each row.
Jul 27 2021, 12:59 PM · Sustainability (Incident Followup), SRE, Traffic, DC-Ops
Jul 26 2021
Papaul updated the task description for T286484: (Need By: 2021-08-31) rack/setup/install ganeti-test200[123].
Jul 26 2021, 5:49 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T285809: (Need By: ASAP) rack/setup/install ms-be20[62-65].
Jul 26 2021, 5:41 PM · Patch-For-Review, SRE, ops-codfw, DC-Ops
Papaul closed T287394: hw troubleshooting: mw2336.codfw.wmnet and its mgmt are down as Resolved.
Reset and upgrade IDRAC. Server is back up online.
Jul 26 2021, 5:37 PM · SRE, ops-codfw, DC-Ops
Papaul added a comment to T287110: cr2-codfw:fpc0 crash.
Shipped out faulty line card today. Tracking information below
Jul 26 2021, 2:44 PM · SRE, Infrastructure-Foundations, netops
Papaul added a comment to T287110: cr2-codfw:fpc0 crash.
FPC0 S/N updated in Netbox
Jul 26 2021, 2:40 PM · SRE, Infrastructure-Foundations, netops
Jul 23 2021
Papaul closed T287112: hw troubleshooting: SSH failure for wdqs2002.mgmt.codfw.wmnet as Resolved.
Reset IDRAC , server is back up
Jul 23 2021, 4:15 PM · SRE, ops-codfw, DC-Ops, Discovery-Search (Current work)
Jul 22 2021
Papaul updated the task description for T287182: db2091 memory errors.
Jul 22 2021, 4:10 PM · SRE, ops-codfw, DBA
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL