Environmental requirements
This chapter describes the environmental requirements for IBM z14 TM servers. It also lists the dimensions, weights, power, and cooling requirements that are needed to plan for the installation of an z14 server.
 
Note: Throughout this chapter, “z14” refers to IBM z14 Model M0x (Machine Type 3906) unless otherwise specified.
The following options are available for physically installing the server:
•Air or water cooling
•Installation on a raised floor or non-raised floor
•I/O and power cables can exit under the raised floor or off the top of the server frames
•A high-voltage DC power supply or the usual AC power supply
For more information about physical planning see IBM 3906 Installation Manual for Physical Planning, GC28-6965.
This chapter includes the following topics:
10.1 Power and cooling
The z14 server is always a two-frame system. Frames are shipped separately and then are bolted together during the installation procedure. z14 servers support installation on a raised floor or non-raised floor.
The water-cooling feature can be installed only on a raised floor because water hoses are attached to the server from underneath the raised floor. Standard exit for power and I/O cables is also on the bottom of the server frames unless the following top exit features are installed:
•Top Exit I/O Cabling feature code (FC 7942)
•Top Exit cord DC (FC 8948)
•Top Exit cord Low Voltage, 3 phase (FC 8949)
•Top Exit cord HiV, 3 phase (FC 8951)
These options allow I/O cables and power cables to exit through the top of the server into overhead cabling rails.
10.1.1 Rear cover design for vectored air output
The rear door covers were designed to address data center airflow challenges. You can change the cover (door) fin orientation down or up, as shown in Figure 10-1. This feature allows you to direct the hot air that is exhausted by z14 servers to avoid adversely affecting cooling of other systems on the hot aisle.
Figure 10-1 Rear cover vectored air output
The new rear doors are all the same part. In the installation planning meeting, you can decide in which orientation the IBM Service Support Representative (IBM SSR) should install the covers. For more information about the vectored orientation, see IBM 3906 Installation Manual for Physical Planning, GC28-6965 or contact your IBM SSR.
10.1.2 Power requirements and consumption
This section describes the power requirements and consumption for z14 servers.
Power requirements
The system operates with two fully redundant power supplies. One is in the front, and the other is in the rear of the Z frame. Each power supply has one or two power cords. The number of power cords that is required depends on the system configuration. The total loss of one power supply has no effect on system operation.
Systems with two power cords (one in the front and one in the rear) can be started with one power cord and continue to run.
The larger systems with a minimum of four bulk power regulator (BPR) pairs must have four power cords installed. A system with four power cords can be started with two power cords on the same power supply with sufficient power to keep the system running.
Power cords can be attached to 3-phase, 50/60 Hz, 200 - 480 V AC power, or 380 - 520V DC power.
The High-Voltage Direct Current (HVDC) feature is an option for z14 servers. It enables the direct use of the high voltage (HV) DC distribution. A direct HVDC data center power design improves data center energy efficiency by removing the need for a DC to AC inversion step.
The z14 bulk power supplies were modified to support HVDC; therefore, the only difference in the included hardware to implement this option is the DC power cords. HVDC is a fresh technology with many standards. z14 server supports two of these standards: Ground referenced and dual polarity HVDC supplies, such as +/-190 V, +/-260 V, and +380 V. HVDC brings many advantages.
Beyond the data center uninterruptible power supply and power distribution energy savings, a z14 server that runs on HVDC power draws 1 - 3% less input power. HVDC does not change the number of power cords that a system requires.
For extra equipment, such as the Hardware Management Console (HMC), its display, and Ethernet switch, extra single-phase outlets are required.
The power requirements depend on the installed cooling facility, the number of central processor complex (CPC) drawers, and the number of I/O units.
If you initially need only one power cord pair but you plan to use a second pair in the future, you can order the Line Cord Plan Ahead feature (FC 2000). This feature gives you four power cords at the initial configuration.
Also, Balanced Power Plan Ahead feature (FC 3003) provides an initial configuration of four power cords and 12 BPRs. If the z14 server is configured with the Internal Battery Feature (IBF), Balanced Power Plan Ahead automatically supplies the maximum number of batteries (six IBFs) with the system.
The BPR requirements (depending on the number of CPC drawers and I/O units) are listed in Table 10-1. A second pair of power cords is installed if the number of BPR pairs is four or higher.
Table 10-1 Number of BPRs that are required per side
CPC drawers
 
PCIe I/O drawers
0
1
2
3
4
5
1
21
2a
2a
2a
3a
3a
2
2a
3a
3a
3a
3a
42
3
3b
3b
4b
4b
4b
5b
4
4b
4b
5b
5b
5b
6b
1 Single-line power cord pair.
2 Two-line power cord pair.
The number of power cords that are installed on one power supply (depending on the number of I/O units and the number of CPC drawers) is listed in Table 10-2.
Table 10-2 Number of power cords that are installed per power supply
CPC drawers
PCIe I/O drawers
0
1
2
3
4
5
1
1
1
1
1
1
1
2
1
1
1
1
1
2
3
1
1
2
2
2
2
4
2
2
2
2
2
2
Power consumption
This section describes the maximum power consumption for the air-cooled and water-cooled models.
 
Consideration: Power consumption is lower when in a normal ambient temperature room, and for configurations that feature a lesser number of I/O slots, smaller amount of memory, and fewer processors. Power consumption is also slightly lower for DC input voltage. The numbers that are listed in this section assume that batteries are present and charging.
Power estimation for any configuration, power source, and room condition can be obtained by using the power estimation tool at IBM Resource Link website (authentication required).
On the Resource Link page, click Tools → Power and weight estimation.
The absolute maximum power consumption for the air-cooled models in a warm room (power will be lower for DC input voltage) is listed in Table 10-3.
Table 10-3 Power consumption for air-cooled models (kVA)1
Number PCIe I/O drawers
0
1
2
3
4
5
6.1
7.8
9.5
10.4
N/A
N/A
10.4
12.2
13.9
15.5
17.2
18.9
14.7
16.5
18.3
19.9
21.5
23.2
19.7
21.5
23.2
24.9
26.5
28.2
21.4
23.1
24.9
26.5
28.1
29.8
The absolute maximum power consumption for the water-cooled models in a warm room (power is lower for DC input voltage) is listed in Table 10-4.
Table 10-4 Power consumption for water-cooled models (kVA)2
Number PCIe I/O drawers
0
1
2
3
4
5
5.7
7.4
9.1
10.0
N/A
N/A
9.6
11.5
13.2
14.8
16.4
18.1
13.7
15.5
17.2
18.8
20.5
22.2
17.8
19.6
21.3
23.0
24.6
26.3
19.3
21.1
22.9
24.5
26.1
27.8
10.1.3 Cooling requirements
The z14 cooling system includes with two options: Air-cooling or water-cooling. Single chip modules (SCMs) also are always cooled with an internal water loop, no matter which z14 cooling option is chosen. The liquid in internal water system can be cooled by using a radiator (for air-cooling option) or customer-supplied chilled water supply (for water-cooling option). I/O drawers, PCIe I/O drawers, power enclosures, and CPC drawers are cooled by chilled air with blowers.
z14 servers include a recommended (long-term) ambient temperature range of 18°C (64.4°F) - 27°C (80.6°F). The minimum allowed ambient temperature is 15°C (59°F) and the maximum allowed temperature is 32°C (89.6°F).
For more information about the environmental specifications, see IBM 3906 Installation Manual for Physical Planning, GC28-6965.
Radiator cooling system requirements
The radiator cooling system requires chilled air to fulfill the air-cooling requirements. Normal air exhausts from the front to the rear of the frames. The chilled air is provided through perforated floor panels in front of the system.
Figure 10-2 does not represent any particular server system type, and is intended only to show hot and cold airflow and the arrangement of server aisles.
Figure 10-2 Hot and cold aisles
As shown in Figure 10-2, rows of servers must be placed front-to-front. Chilled air is provided through perforated floor panels that are placed in rows between the fronts of servers (the cold aisles). Perforated tiles generally are not placed in the hot aisles. If your computer room causes the temperature in the hot aisles to exceed a comfortable temperature, add as many perforated tiles as necessary to create a satisfactory comfort level. Heated exhaust air exits the computer room above the computing equipment.
With the standard z14 rear covers (FC #0160), the exiting airflow direction can be customized, which provides you more flexibility in placing z14 servers in your data center. Optional Thin doors (non acoustic, non-vectored) are available also (FC #0161).
For more information about the requirements for air-cooling options, see IBM 3906 Installation Manual for Physical Planning, GC28-6965.
Water-cooling system requirements
The water-cooling system requires a chilled customer building water supply to be supplied to the z14 water-cooling units (WCUs). A z14 server requires four connections to the facility water: Two feeds and two returns.
 
Raised floor: The minimum raised floor height for a water-cooled system is 22.86 cm
(8.6 in.).
These connections are made by using hoses that are fixed to the facility plumbing and are routed up through the front tailgate of the system. They end with quick connect couplings.
Before you install z14 servers with water-cooled option, your facility must meet following requirements:
•Total water hardness must not exceed 200 mg/L of calcium carbonate.
•The pH must be 7 - 9.
•Turbidity must be less than 10 Nephelometric Turbidity Units (NTUs).
•Bacteria must be less than 1000 colony-forming units (CFUs)/ml.
•The water must be as free of particulate matter as feasible.
•The allowable system inlet water temperature range is 6°C - 20°C (43°F - 68°F) by using standard building chilled water. A special water system is typically not required.
•The required flow rate to the frame is 3.7 - 79.4 lpm (1 - 21 gpm), depending on the inlet water temperature and the number of processor drawers in the z13 server. Colder inlet water temperatures require less flow than warmer water temperatures. Fewer processor drawers require less flow than a maximum populated z13 server.
•The minimum water pressure that is required across the IBM hose ends is 0.34 - 2.32 BAR (5 - 33.7 psi), depending on the minimum flow required.
•The maximum water pressure that is supplied at the IBM hose connections to the client’s water supply cannot exceed 6.89 BAR (100 psi).
For more information about the requirements for water-cooling options, see IBM 3906 Installation Manual for Physical Planning, GC28-6965, and see Figure 10-3.
Supply hoses
The z14 water-cooled system includes 4.2 m (13.7 ft) water hoses. The WCU water supply connections are shown in Figure 10-3.
Figure 10-3 WCU water supply connections
The client’s ends of the hoses are left open, which allows you to cut the hose to a custom length. An insulation clamp is provided to secure the insulation and protective sleeving after you cut the hose to the correct length and install it onto your plumbing.
Use shut-off valves in front of the hoses. This configuration allows for the removal of the hoses for a service procedure or relocation. Valves are not included in the order. A stainless steel fitting is available for ordering. The fitting is barbed on one side and has a 2.54 cm (1 in.) male national pipe thread (NPT). For more information about the tools that are needed for the water supply connections, see the IBM 3906 Installation Manual for Physical Planning, GC28-6965.
10.1.4 Internal Battery Feature
In case of power shutdown, the optional Internal Battery Feature (IBF) provides sustained system operations for a relatively short time, which allows a proper z14 server’s shutdown. In addition, an external uninterrupted power supply system can be connected, which allows for longer periods of sustained operation.
The IBF can provide emergency power for the estimated time that is listed in Table 10-5. The number of IFBs depends on the number of BPRs. For the number of BPRs that are installed in relation to I/O units and the number of CPC drawers, see Table 10-5. They are installed in pairs. You can have two, four, or six batteries (odd numbers are not allowed).
Table 10-5 Internal Battery Feature holdup times
CPC drawers
Number of I/O units1
0
1
2
3
4
5
1
19.9 min
13.7 min
10.3 min
8.9 min
13.9 min
12.4 min
2
8.8 min
12.5 min
10.5 min
9.0 min
7.9 min
7.1 min
2
9.6 min
8.3 min
7.4 min
6.6 min
6.1 min
5.0 min
4
6.7 min
6.1 min
5.0 min
4.5 min
4.0 min
3.7 min
1 I/O units = the number of I/O drawers or PCIe I/O drawers.
 
 
 
Consideration: The system holdup times that are listed in Table 10-5 assume that both sides are functional and have fresh batteries under normal room ambient conditions.
Holdup times are greater for configurations that do not have every I/O slot plugged, the maximum installed memory, and are not using the maximum processors.
These holdup times are estimates. Your particular battery holdup time for any specific circumstance might be different.
Holdup times vary depending on the number of BPRs that are installed. As the number of BPRs increases, the holdup time also increases until the maximum number of BPRs is reached. After six BPRs (three per side) are installed, no other batteries are added; therefore, the time decreases from that point.
Holdup times for actual configurations are provided in the power estimation tool at IBM Resource Link website.
On the Resource Link page, click Tools → Machine information, select your IBM Z system, and click Power Estimation Tool.
10.1.5 Emergency power-off switch
An emergency power-off switch is on the front of the A frame. When activated, the switch immediately disconnects utility and battery power from the server. This event results in a loss of all volatile data in the server.
If the server is connected to a room’s emergency power-off switch and the IBF is installed, the batteries take over if the switch is engaged.
To avoid the takeover, connect the room emergency power-off switch to the server power-off switch. Then, when the room emergency power-off switch is engaged, all power is disconnected from the power cords and the IFBs. However, all volatile data in the server is lost.
10.2 Physical specifications
This section describes the weights and dimensions of z14 server. Base overall z14 dimensions are identical with z13 server. The exception is when z14 includes the thin cover option that shortens the system depth by approximately 39.37 cm (15.5 in.) and reduce the system weight by 48.988 kg (108 lbs).
z14 server can be installed on a raised or on a non-raised floor. For more information about weight distribution and floor loading tables, see the IBM 3906 Installation Manual for Physical Planning, GC28-6965. This data is used with the maximum frame weight, frame width, and frame depth to calculate the floor loading.
The maximum system dimensions and weights for the M04/M05 model are listed in Table 10-6. The weight ranges are based on configuration models with five PCIe I/O drawers, IBFs, and with the top exit cable features.
Table 10-6 System dimensions and weights
Maximum
A and Z frames with IBF
(FC 3212)
A and Z frames with IBFs
(FC 3212) and Top Exit Cabling Features (FC 7942 and FC 7901)
Radiator-cooled servers
Weight kg (lbs)
2499 (5508)
2566.7 (5657))
Width mm (in.)
1568 (61.7)
1847 (72.7)
Depth mm (in.)
1869 (73.6)
1806 (71.1)
Height mm (in.)
2015 (79.3)
2154 (84.8)
Height reduction mm (in.)
1803 (71.0)
1803 (71.0)
Water-cooled servers
Weight kg (lbs)
2564 (5653)
2631.7 (5800)
Width mm (in)
1568 (61.7)
1847 (72.7)
Depth mm (in)
1971 (77.7)
1908 (75.1)
Height mm (in)
2015 (79.3)
2154 (84.8)
Height reduction mm (in)
1809 (71.2)
1809 (71.2)
Notes: Consider the following points:
•Weight is based on the maximum system configuration.
•Weight does not include covers. Covers add 67.7 kg (150 lbs) to each frame. Width, depth, and height are also indicated without covers.
•Be certain that the raised floor on which you are installng the server can support the weight.
The power and weight estimation tool for Z servers on Resource Link covers the estimated weight for your designated configuration. It is available on IBM Resource Link website.
On the Resource Link page, click Tools → Power and weight estimation.
10.3 Physical planning
This section describes the floor mounting, power, and I/O cabling options. For more information, see the IBM 3906 Installation Manual for Physical Planning, GC28-6965.
10.3.1 Raised floor or non-raised floor
z14 servers can be installed on a raised or non-raised floor. The water-cooled models require a raised floor.
Raised floor
If the z14 server is installed in a raised floor environment, air-cooled and water-cooled models are supported. You can select top exit features to route I/O cables and power cables from the top frame of the z14 server.
The following top exit options are available for z14 servers:
•Top Exit I/O Cabling feature code (FC 7942)
•Top Exit Line Cord for DC (FC 8948)
•3-phase, Low Voltage Top Exit Line Cord (FC 8949)
•3-phase, High Voltage Top Exit Line Cord (FC 8951)
The top exit feature options of z14 servers in a raised floor environment are shown in Figure 10-4.
Figure 10-4 Raised floor options
 
Note: Top exit feature support is not available for water hoses. Such hoses must go through the system from underneath the raised floor.
Non-raised floor
If you install the z14 server in a non-raised floor environment, you can select only radiator-cooled models. The Non-Raised Floor Support feature code (FC 7998) is required. The Top Exit I/O Cabling feature code (FC 7942) and one of three types of Top Exit Line Cords (FC 8948, FC 8949, FC 8951) also must be ordered. All cables must exit from the top frame of the z14 server, as shown in Figure 10-5.
Figure 10-5 Non-raised floor options
10.3.2 Top Exit Power option
Top Exit Power option is supported with or without Top Exit I/O cabling option. You can route your power cables from the top of the frame, once one of following features is chosen:
•Top Exit Line Cord for DC (FC 8948)
•3-phase, Low Voltage Top Exit Line Cord (FC 8949)
•3-phase, High Voltage Top Exit Line Cord (FC 8951)
The following types of power cords are offered in this feature:
•Cut cords
These cords are 4.3 meter (14 feet) long from the exit point of the frame, with an attached mount bracket that you can use to fix power cords at the top of frame, as shown in Figure 10-5 on page 399.
•Plugged cords
For z14 servers, the fittings are 60A and require much more force to plug in successfully. For the 60A plugs, the “power cord” is a short connection from the power enclosure to the top of the frame. The plug is rigidly fixed to the frame. The client drop must come down to the frame to meet the system input plug.
The difference between cut cords and plugged cords is shown in Figure 10-6.
Figure 10-6 Top Exit Power feature
10.3.3 Top Exit I/O Cabling feature
As with the z13, z14 servers support the Top Exit I/O Cabling feature (FC 7942). This feature routes all coupling links and I/O cables, including 1000BASE-T Ethernet cable from I/O drawers or PCIe I/O drawers, through four more frame extensions out the top of the frame.
The frame extensions (chimneys) that are installed on frame A or on frame Z when the Top Exit I/O Cabling feature (FC 7942) is ordered are shown in Figure 10-7.
Figure 10-7 Top Exit I/O Cabling feature
The Top Exit I/O Cabling feature adds 15 cm (6 in.) to the width of each frame and approximately 95 lbs (43 kg) to the weight.
For z13 servers, the Top Exit I/O Cabling feature (FC 7942) is available for radiator-cooled models and water-cooled models.
10.3.4 Weight distribution plate
The weight distribution plate is designed to distribute the weight of a frame onto two floor panels in a raised-floor installation. As listed in Table 10-6 on page 397, the weight of a frame can be substantial. A concentrated load on a caster or leveling foot can be half of the total frame weight.
In a multiple system installation, one floor panel can have two casters from two adjacent systems on it, which can induce a highly concentrated load on a single floor panel. The weight distribution plate distributes the weight over two floor panels. The weight distribution kit is ordered and delivered by using FC 9970.
Always consult the floor tile manufacturer to determine the load rating of the tile and pedestal structure. More panel support might be required to improve the structural integrity because cable cutouts reduce the floor tile rating.
10.3.5 Bolt-down kit for raised floor
A bolt-down kit for raised floor environments can be ordered for the z14 servers. The kit provides hardware to enhance the ruggedness of the frames and to tie down the frames to a concrete floor beneath a raised floor of 15 cm - 91 cm (5.9 in. - 35.8 in.). The kit is offered in the following configurations:
•The Bolt-Down kit for an air-cooled system (FC 8003) is designed for air-cooled server.It provides frame stabilization and bolt-down hardware for securing the frames to a concrete floor beneath the raised floor.
•The Bolt-Down kit for a water-cooled system (FC 8004) is designed for water-cooled server. It provides frame stabilization and bolt-down hardware for securing the frames to a concrete floor beneath the raised floor.
The kits help secure the frames and their contents from damage when exposed to shocks and vibrations, such as in a seismic event. The frame tie-downs are intended for securing a frame that weighs up to 1632 kg (3600 lbs).
Seismic (earthquake) resistance
In earthquake areas, the z14 server equipped with appropriate earthquake equipment are certified to meet requirements ICC ES AC156 with the test parameters that are listed in Table 10-7. Tests were run for two options of Sds parameter (Sds = 2.5g and Sds = 2.0g).
Table 10-7 Test parameters
 
Test criteria
 
SDS (g)
 
z/h
Horizontal
AFLX-H ARIG-H
Vertical
AFLX-V ARIG-V
ICC-ES
AC156
2.5
1.0
4.00
3.00
1.68
0.68
ICC-ES
AC156
2.0
1.0
3.20
2.40
1.34
0.54
 
Note: The following parameters are used in Table 10-7:
SDS Design spectral response acceleration at short period
z/h                 Quotient of z (height of the structure with respect to attachment point) and h
                      (average building/structure roof height with respect to the base elevation)
AFLX-H Horizontal spectral acceleration calculated for flexible components
ARIG-H Horizontal spectral acceleration calculated for rigid components
AFLX-V Vertical spectral acceleration calculated for flexible components
ARIG-V Vertical spectral acceleration calculated for rigid components
The Sds parameter 2.5g represents the high magnitude covering most of densely populated area in California. For example Sds values for Los Angeles (1.29 g), San Francisco (2.00 g), Santa Barbara (2.00 g), and San Diego (1.60 g).
z14 structure consists of a frame of rack, drawers with central processor units, I/O equipment, memory, and other electronic equipment. The primary function of the frame is to protect critical electronic equipment in two modes. The first mode is during shipping shock and vibration, which provides excitation primary in the vertical direction. The second mode is protecting the equipment during seismic events where horizontal vibration can be significant.
For more information see IBM 3906 Installation Manual for Physical Planning, GC28-6965.
10.3.6 Nonraised floor frame tie-down kit
The nonraised floor frame tie-down kit (FC 8005) is designed for air-cooled server. It helps secure the frames and its contents from damage when it is exposed to vibrations and shocks, such as a seismic event.
10.3.7 Service clearance areas
z14 servers require specific service clearance to ensure the fastest possible repair in the unlikely event that a part must be replaced. Failure to provide enough clearance to open the front and rear covers results in extended service times or outages.
For more information, see IBM 3906 Installation Manual for Physical Planning, GC28-6965.
10.4 Energy management
This section describes the elements of energy management to help you understand the requirements for power and cooling, monitoring and trending, and reducing power consumption. The energy management structure for the server is shown in Figure 10-8.
Figure 10-8 z14 energy management
The hardware components in the z14 server are monitored and managed by the energy management component in the Support Element (SE) and HMC. The graphical user interfaces (GUIs) of the SE and HMC provide views, such as the Monitors Dashboard and Environmental Efficiency Statistics Monitor Dashboard.
The following tools are available to plan and monitor the energy consumption of z14 servers:
•Power estimation tool on Resource Link
•Energy Management task for maximum potential power on HMC and SE
•Monitors Dashboard and Environmental Efficiency Statistics tasks on HMC and SE
10.4.1 Environmental monitoring
This section describes energy monitoring HMC and SE tasks.
Monitor task group
The Monitor task group on the HMC and SE includes monitoring-related tasks for z14 servers, as shown in Figure 10-9.
Figure 10-9 HMC Monitor task group
The Monitors Dashboard task
In z14 servers, the Monitors Dashboard task in the Monitor task group provides a tree-based view of resources. Multiple graphical views exist for displaying data, including history charts. This task monitors processor and channel usage. It produces data that includes power monitoring information, power consumption, and the air input temperature for the server.
An example of the Monitors Dashboard task is shown in Figure 10-10.
Figure 10-10 Monitors Dashboard task
Environmental Efficiency Statistics task
The Environmental Efficiency Statistics task (see Figure 10-11) is part of the Monitor task group. It provides historical power consumption and thermal information for the CPC.
The data is presented in table format and graphical “histogram” format. The data can also be exported to a .csv-formatted file so that the data can be imported into a spreadsheet. For this task, you must use a web browser to connect to an HMC.
Figure 10-11 Environmental Efficiency Statistics
 
1 Input power (kVA) equals heat output (kW).
2 Input power (kVA) equals heat output (kW).
..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.17.167.114