SRE/Dc-operations/Common Data center Specifications: Difference between revisions
< SRE | Dc-operations
+{{Navigation Wikimedia infrastructure|expand=dc}} |
m Jobo moved page Dc-operations/Common Datacenter Specifications to SRE/Dc-operations/Common Datacenter Specifications without leaving a redirect |
(No difference)
|
Revision as of 16:02, 22 June 2021
This page will outline our preferred specifications for use in datacenters.
Cabling Specifications
Color | Cable Spec | Network |
---|---|---|
Blue | Cat6 | Production |
Green | Cat5e | Management |
Orange | Cat5e | Serial |
Red | Cat5e | Out of Band Access |
Yellow | 9/125 Singlemode Fiber | All fiber connections |
- Fiber note: LC to LC in rack, SC to LC for peer/transit links.
- Cabling Notes:
- We use pre-made patches in rack (5'/7'/10') for mgmt and production network.
- We use custom on-site assembled patches for serial.
- These are nearly always cross-rack and must be custom measured.
- The pin out differs to work for serial console (cisco/juniper/netapp/sun) without an adapter:
- End Device Side: 568B
- Serial Console Side: pin 4 white-green, pin 5 green, pin 6 blue (remainder immaterial)
Cabling Options
- Gear Mounted Top of Rack
- 12 3M Fiber or 12 10' CAT6 Ethernet Cable
- 24 2M Fiber or 24 7' CAT6 Ethernet Cable
- 5 1M Fiber or 5 5' CAT6 Ethernet Cable
- Gear Mounted Mid-Rack
- 10 1M Fiber or 10 5' CAT6 Ethernet Cable
- 32 2M Fiber or 32 7' CAT6 Ethernet Cable
Power Specifications
CODFW & EQIAD Based Sites
- 208V 3 Phase power @ 30 Amps - Two circuits per enclosure for redundancy.
- Sites in use: eqiad, sdtpa (not all racks redundant power)
- Power connector used for 30AMP 3Phase is NEMA L21-30P(plug) / L21-30R(eceptacle).
- Sites not in use: pmtpa (208V 3 Phase @ 20 Amps, redundant) & ULSFO(redundant).
- Power connector used for 20AMP 3Phase is NEMA NEMA L21-20P(plug) / L21-20R(eceptacle).
- ServerTech 0U SMART PDU
- 42 c13 power ports per feed for a total of 84 ports.
- Model: CS-84VDY-L2130
- Also have to order (2) EMTH-1-1 to have two temp/humidity leads, and one Kit-MB-01 (two button mount kit - can use Rittal equivalent)
- In our present deployments, we use SMART over SWITCHED due to the higher possible rate of failure of the switched power ports over non-switched power ports.
- We have a rack with switched power, due to legacy equipment that could not out of band power cycle; though now none of that hardware is still in service.
- RobH thinks we may need to re-investigate the failure rates on switched power, and possibly use it more, since it can be used to remotely clear service processors out of unrecoverable error states,
- Power cords for servers are c13/c14 type.
Enclosure Specifications
EQIAD Racks
- Depth from front rail to PDU (overall depth for hardware facing the front of the rack): 33"
- Rittal TS-8 Enclosure : Rittal 9962172
- Sheet Steel, 800MM W by 2200MM H by 1050MM D. Sand Texture, Black, Perforated front/rear doors, standard rear wall/door, perforated with 4 round cable entry in roof.
- We have to get three kinds, right side end of row, left side end of row, and enclosures within the row.
- Inner enclosure: partition wall left side : Right end enclosure: partition left, sidewall right :: Left end enclosure: sidewall left
- Rittal TS - External Baying Connector : Rittal 8800490 : One kit gangs together two enclosures
- Rittal Roof Mount Cable Manager for 32" Wide TS Enclosure : Rittal 9970016
- Rittal Button Mount Brackets
- Rittal 9971067
CODFW Racks
- Depth from front rail to PDU (overall depth for hardware facing the front of the rack): 38"
- Racksolutions racks purchased via CyrusOne.
All other sites
- Racks are provided from the vendor in all other datacenter sites.
- This section should still eventually list the "Depth from front rail to PDU (overall depth for hardware facing the front of the rack)" for each site.
Serial Console
- Opengear CM7148 dual PSU model
- 48 port serial console server
- We attach serial to every power strip and every bit of network kit (excluding the rack level mgmt switches)