DS8910F 993
DS8910F 993
DS8910F 993
Sherri Brunson
Bert Dufrasne
Peter Kimmel
Redpaper
IBM Redbooks
December 2020
REDP-5566-01
Note: Before using this information and the product it supports, read the information in “Notices” on page v.
This edition applies to IBM DS8910F model 993 storage systems that are available with IBM DS8000
Licensed Machine Code (LMC) 7.9.10 (bundle version 89.10.xx.x), which is referred to as Release 9.1.
Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .v
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vi
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Authors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Now you can become a published author, too . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii
Comments welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii
Stay connected to IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii
Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Other publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Online resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Help from IBM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
This information was developed for products and services offered in the US. This material might be available
from IBM in other languages. However, you may be required to own a copy of the product or product version in
that language in order to access it.
IBM may not offer the products, services, or features discussed in this document in other countries. Consult
your local IBM representative for information on the products and services currently available in your area. Any
reference to an IBM product, program, or service is not intended to state or imply that only that IBM product,
program, or service may be used. Any functionally equivalent product, program, or service that does not
infringe any IBM intellectual property right may be used instead. However, it is the user’s responsibility to
evaluate and verify the operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter described in this document. The
furnishing of this document does not grant you any license to these patents. You can send license inquiries, in
writing, to:
IBM Director of Licensing, IBM Corporation, North Castle Drive, MD-NC119, Armonk, NY 10504-1785, US
This information could include technical inaccuracies or typographical errors. Changes are periodically made
to the information herein; these changes will be incorporated in new editions of the publication. IBM may make
improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time
without notice.
Any references in this information to non-IBM websites are provided for convenience only and do not in any
manner serve as an endorsement of those websites. The materials at those websites are not part of the
materials for this IBM product and use of those websites is at your own risk.
IBM may use or distribute any of the information you provide in any way it believes appropriate without
incurring any obligation to you.
The performance data and client examples cited are presented for illustrative purposes only. Actual
performance results may vary depending on specific configurations and operating conditions.
Information concerning non-IBM products was obtained from the suppliers of those products, their published
announcements or other publicly available sources. IBM has not tested those products and cannot confirm the
accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the
capabilities of non-IBM products should be addressed to the suppliers of those products.
Statements regarding IBM’s future direction or intent are subject to change or withdrawal without notice, and
represent goals and objectives only.
This information contains examples of data and reports used in daily business operations. To illustrate them
as completely as possible, the examples include the names of individuals, companies, brands, and products.
All of these names are fictitious and any similarity to actual people or business enterprises is entirely
coincidental.
COPYRIGHT LICENSE:
This information contains sample application programs in source language, which illustrate programming
techniques on various operating platforms. You may copy, modify, and distribute these sample programs in
any form without payment to IBM, for the purposes of developing, using, marketing or distributing application
programs conforming to the application programming interface for the operating platform for which the sample
programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore,
cannot guarantee or imply reliability, serviceability, or function of these programs. The sample programs are
provided “AS IS”, without warranty of any kind. IBM shall not be liable for any damages arising out of your use
of the sample programs.
The following terms are trademarks or registered trademarks of International Business Machines Corporation,
and might also be trademarks or registered trademarks in other countries.
DS8000® IBM Z® Redbooks®
Easy Tier® IBM z14® Redbooks (logo) ®
Enterprise Storage Server® POWER® System z®
FICON® POWER8® z/OS®
FlashCopy® POWER9™ z15™
IBM® PowerPC®
Other company, product, or service names may be trademarks or service marks of others.
This IBM Redpaper publication presents and positions the DS8910F Model 993 storage
system.
This modular system can be integrated into a 16U contiguous space of an IBM z15™ model
T02 or IBM z14® Model ZR1 with Feature Code 0937 and IBM LinuxONE III model LT2 or
LinuxONE Rockhopper II model LR1 with Feature Code 0938.
The DS8910F Model 993 allows you to take advantage of the performance boost of all-flash
systems and advanced features while limiting data center footprint and power infrastructure
requirements.
Authors
This paper was produced by a team of specialists from around the world:
Sherri Brunson joined IBM in March of 1985 and worked as large system IBM service
representative before becoming a Top Gun in 1990. Sherry is a Top Gun in the Eastern US for
all storage products, Power Systems, and IBM z. She supported and implemented IBM
DS8000® and Scaled out Network Appliance storage products globally and developed and
taught educational classes. She also taught z System classes in the United States.
Bert Dufrasne is an IBM Certified Consulting IT Specialist and Project Leader for IBM
System Storage disk products at the ITSO, San Jose Center. He has worked at IBM in various
IT areas. He has written many IBM publications, and developed and taught technical
workshops. Before Bert joined the ITSO, he worked for IBM Global Services as an Application
Architect. He holds a Master’s degree in Electrical Engineering.
Peter Kimmel is an IT Specialist and the Advanced Technical Skills team lead of the
Enterprise Storage Solutions team at the ESCC in Kelsterbach, Germany. He joined
IBM Storage in 1999, and since then has worked with various IBM Enterprise Storage
Server® and DS8000 generations, with a focus on architecture and performance. He was
involved in the Early Shipment Programs (ESP) of these early installations, and co-authored
several DS8000 IBM® publications. Peter holds a Diploma (MSc) degree in physics from the
University of Kaiserslautern.
Christopher Ciraulo, John Elliott, Nicole Rae, John Torok, George Venech
IBM
Find out more about the residency program, browse the residency index, and apply online at:
ibm.com/redbooks/residencies.html
Comments welcome
Your comments are important to us.
We want our papers to be as helpful as possible. Send us your comments about this paper or
other IBM Redbooks® publications in one of the following ways:
Use the online Contact us review Redbooks form:
ibm.com/redbooks
Send your comments in an email:
[email protected]
Mail your comments:
IBM Corporation, International Technical Support Organization
Dept. HYTD Mail Station P099
2455 South Road
Poughkeepsie, NY 12601-5400
viii IBM DS8910F Model 993 Rack-Mounted Storage System Release 9.1
1
The DS8910F model 993 adds a modular rack-mountable enterprise storage system to the
533x all-flash machine type family. As such, it does not come in its own rack, but can be
integrated into a standard 19-inch wide rack that conforms to EIA 310D specifications. The
standard 19-inch wide rack installation (Feature Code 0939), requires a minimum of 15U
contiguous space to mount the modules, or 16U if the optional 1U KVM is included.
Figure 1-1 shows the DS8910F model 993 with the maximum configuration (two pairs of
High-Performance Flash Enclosure (HPFE) Gen2) that requires 19U contiguous space, not
including the optional KVM.
Figure 1-1 DS8910F model 993 for 19-inch form factor racks (maximum configuration)
The DS8910F model 993 is designed for clients with small capacity requirements who want to
boost performance, in particular in mainframe environments.
The DS8910F Rack Mounted Storage System supports continuous operation, data security,
and data resiliency. For high-availability, the hardware components are redundant.
Figure 1-2 DS8910F model 993 integrated into z15 model T02 or LinuxONE III LT2
Model 993 shares the display a0937 and keyboard of IBM z14, as shown in Figure 1-3.
Figure 1-3 DS8910F model 993 integrated into IBM z14 ZR1 or LinuxONE II LR1
For more information about how to integrate the DS8910F, see Chapter 3, “IBM DS8910F
installation and integration” on page 29.
The DS8910F enables you to take advantage of the DS8900 advanced features and reduces
data center footprint and power infrastructure requirements. The modular system contains
IBM POWER9™ processor nodes, an I/O enclosure, High-Performance Flash Enclosure
Gen2, a management enclosure (which includes the Hardware Management Consoles
(HMCs)), Ethernet Switches, and Rack Power Control [RPCs]).
For more information about the DS8910F architecture, hardware, and components, see
Chapter 2, “IBM DS8910F hardware configuration” on page 7.
The DS8910F provides a mid-level product with the same advanced functions as larger
DS8900 family systems, with support for IBM Z or distributed hosts. It is an ideal replacement
for older IBM Storage systems, small-capacity DS8700, and DS8800 systems with
comparable capacity requirements.
You can use the DS8000 Storage Management GUI and the DS command-line interface (DS
CLI) to manage and logically configure the storage system.
The machine types for the DS8910F specify the service warranty period. The warranty is
used for service entitlement checking when notifications for service are called home. The
DS8910F model 993 reports 2107 as the machine type to attached host systems.
The modular system contains processor nodes, an I/O Enclosure, High-Performance Flash
Enclosure Gen2, and a management enclosure (which includes the Hardware Management
Consoles (HMCs0, Ethernet Switches, and RPCs).
The DS8910F storage system features 8-core processors and supports one
High-Performance Flash Enclosure Gen2 pair with integration into an z15 model T02,
LinuxONE III model LT2, IBM z14 Model ZR1, or LinuxONE II model LR1 rack. It supports up
to two High-Performance Flash Enclosure Gen2 pair with the standard 19-inch wide rack
installation, with up to 96 Flash Tier 0, Flash Tier 1, or Flash Tier 2 drives. It supports up to
512 GB system memory, four zHyperLink adapters, and up to 32 host adapter ports.
The DS8910F consists of six modules with z15 model T02, LinuxONE III model LT2, IBM z14
Model ZR1, or LinuxONE II model LR1 integration and six or eight modules with a standard
conforming 19-inch rack. For more information about installing into a conforming 19-inch rack,
see Chapter 3, “IBM DS8910F installation and integration” on page 29.
Note: Two KVM cables are included with the DS8910F model 993 to connect the HMCs to
the z KVM for sharing the display and keyboard with IBM z14 model ZR1 or LinuxONE II
model LR1.
Figure 2-1 shows the DS8910F eight modules that make up the 19U of contiguous space,
and the order in which they must be installed. An optional 1U display can be added that make
up the 20U of contiguous space.
The two 2U HPFE Gen2 modules are positioned as the upper two modules in the DS8910F.
For more information about the High-Performance Flash Enclosure Gen2, see IBM DS8000
High-Performance Flash Enclosure Gen2 (DS8000 R9.0), REDP-5422.
Figure 2-2 shows views of HPFE Gen2 front (upper) and rear (lower).
Note: Intermix of High-Performance Flash Tier 0 drives with High Capacity Flash Tier 1
and Flash Tier 2 drives is not supported in an HPFE Gen2 pair. All flash drives in DS8910F
are Full Drive Encryption (FDE) capable.
Flash drives are ordered in drives sets of 16. The HPFE Gen2 pair can contain 16, 32, or 48
flash drives (1, 2 or 3 drive sets). All flash drives in an HPFE Gen2 pair must be the same
type. Half the drive set is installed in each enclosure of the pair.
Table 2-2 lists the DS8910F feature codes for flash drive sets for HPFE Gen2.
Table 2-2 DS8910F feature codes for flash-drive sets for HPFE Gen2
Feature code Disk size Drive type RAID support
The fillers ensure sufficient airflow across populated storage. For HPFE Gen2, one filler
feature provides a set of 16 fillers (Feature Code 1699).
The default and preferred RAID type for all drives larger than 1 TB is RAID 6. RAID 5 is not
supported for drives larger than 1 TB, and requires an RPQ.
The I/O adapters in the I/O enclosures can be flash RAID adapters or host adapters. Each I/O
enclosure supports two Flash RAID adapter pairs, and four host adapters pairs (32 ports).
Host adapters are 4-port 16 Gbps or 4-port 32 Gbps (gigabit Fibre Channel (GFC)).
The DS8910F I/O enclosure supports at minimum configuration one pair of flash device
adapter. At maximum configuration, two pairs of flash device adapter are supported. The I/O
enclosure configuration contains the following components:
Up to four pairs of 4-port 16 Gbps or 4-port 32 GFC host adapters
Power control network (PCN) adapter
Redundant power supply units (PSUs)
Redundant fans for enclosure cooling
Up to two pairs of flash device adapter
Four zHyperLink adapters
Figure 2-4 shows the DS8910F I/O enclosure maximum configuration with a flash RAID
adapter pair, and four host adapter pairs.
PCIe connectivity is from the 4-port PCIe adapters in the processor nodes to the base PCIe
I/O expander. A separate PCIe connection to each base is used, which provides redundant
access to each I/O bay and shared access to the flash device and host adapters. Failover
occurs during code load, or during node failure and service actions.
The minimum configuration supports one flash device adapter pair (one adapter in each I/O
bay) and up to four host adapter pairs (four adapters in each I/O bay).
Note: For continued availability during a logical I/O enclosure or a host adapter failure,
ensure that host connectivity has a redundant path to a different host adapter in the other
logical I/O enclosure.
zHyperLink connections
Up to four zHyperLink connections with IBM Z hosts can be used to provide low latency for
random reads and writes. Each zHyperLink connection requires a zHyperLink I/O adapter to
connect the zHyperLink cable to the storage system. Each zHyperLink I/O adapter (Feature
Code 3500) has one port, but you must order them in sets of two. Table 2-4 lists the feature
codes for the available zHyperLink cables.
Figure 2-6 on page 15 shows the zHyperLink adapter locations for connecting to IBM Z host
system. When configuring host connections T3 ports are connected first, then T4 ports.
Device Adapter
FICON / FCP
FICON / FCP
FICON / FCP
FICON / FCP
T T T T T T
1 2 3 4 5 6
DS8900F Unused
Internal zHyperLink
PCIe Fabric Ports
The DS8910F host adapters are 4-port 16 Gbps or 4-port 32 GFC, which is similar to those
adapters in other DS8900 models. The DS8910F host adapters can be longwave or
shortwave.
Note: The 16 Gbps or 32 GFC (Encryption of Data In Flight (EDiF)) Encryption capable
host adapters do not support arbitrated loop topology at any speed.
The DS8910F FC ports can be identified by the physical host adapter port location code and
the FC port ID. Figure 2-8 shows the fiber port IDs for host adapters that are installed in I/O
enclosure 1B3.
Figure 2-8 Fiber port IDs for the host adapters in I/O enclosure 1B3
Figure 2-9 Fibre Channel port IDs for the host adapters in I/O enclosure 1B4
Figure 2-10 shows the FC ports that are displayed from the Storage Manager GUI. The FC
port logical ID, frame number, I/O enclosure, and host adapter slot are shown with other FC
port properties. For example, looking at port ID I0232 and referencing Figure 2-8 on page 16,
the port is in I/O enclosure 1B3 slot 4 port 2.
Figure 2-10 Fibre Channel port IDs from Storage Manager GUI
For more information about DS8910F host adapter and FC cable features, see 3.1.3,
“Planning for host connectivity” on page 34.
The flash RAID adapter has four SAS ports, which provide connectivity from the RAID
adapter to the HPFE Gen2 enclosures.
The flash RAID adapters are installed as a pair, one in each of the logical I/O enclosures. This
installation is known as a device adapter pair (DA pair). Logical configuration should be
balanced across the DA pair for load balancing and the highest throughput.
The redundant DA pair ensures continued availability if a flash RAID adapter or logical I/O
enclosure fails.
The two POWER9 processor-based servers share the load of receiving and moving data
between the attached hosts and the storage arrays. However, they are also redundant, so that
if either server fails, the system operations fail over to the remaining server and continue to
run without any host interruption.
The DS8910F configuration uses two POWER9 processor-based servers (9009-22A), each
with two 4-core Single Chip Modules (3.4 - 3.9 GHz) and 96 GB or 256 GB processor
memory.
The DS8910F processor node is a 2U high enclosure, and features the following
configuration:
DDR4 Registered DIMM (RDIMM) slots
One storage cage with two hard disk drives
Two PCIe x16 Gen3 slots
Four PCIe x8 Gen3 slots
Two power supplies with integrated cooling
The two 2U processor nodes are positioned under the I/O enclosure and the management
enclosure. Figure 2-11 shows the front view of the DS8910F processor node.
For more information about the server hardware that is used in the DS8910F models 993 and
994, see IBM Power Systems S922, S914, and S924 Technical Overview and Introduction,
REDP-5497.
The IBM POWER9 processor that is used in the DS8910F operates in simultaneous
multithreading (SMT) mode, which runs multiple instruction streams in parallel. The number
of simultaneous instruction streams varies according to processor and Licensed Internal
Code (LIC) level. SMT mode enables the POWER9 processor to maximize the throughput of
the processor cores by offering an increase in core efficiency.
Caching is a fundamental technique for reducing I/O latency. As with other modern caches,
the DS8910F processor nodes contain volatile memory that is used as a read and write
cache, and non-volatile dual inline memory module (NVDIMM) that is used to maintain and
back up a second copy of the write cache.
If power is lost, the NVDIMMs are supplied “hold up” power from one Backup Power Module
(IBM BPM). BPMs retain NVDIMM data when electrical power is removed, either from an
unexpected power loss, or from a normal system shutdown. The 2.5-inch Smart BPM is
installed in the vacant drive location D7 (which is inside the CPC cage).
Two cables connect to the system board, which is next to the NVDIMM slots (C22 and C36),
as shown in Figure 2-12.
Figure 2-12 DIBM IBM BPM8910F 2.5-inch Smart BPM location in each processor node
Figure 2-13 DS8910F processor node with two 4-core CPCs and 256 GB of memory
The FSP controls power and cooling for the processor nodes. The FSP performs predictive
failure analysis for installed processor hardware, and performs recovery actions for processor
or memory errors. The FSP monitors the operation of the firmware during the boot process
and can monitor the operating system for loss of control and take corrective actions.
The following adapters are installed in the processor nodes, as shown in Figure 2-14:
Peripheral Component Interconnect Express adapter
Each DS8910F processor node contains two single port PCIe3 adapters. These adapters
allow point-to-point connectivity between the processor nodes and the I/O enclosure and
I/O adapters. Adapters are installed in slots C6 and C12.
Ethernet connections
Each IBM POWER9 processor complex has a single 4-port 1 Gb Ethernet adapter that is
installed in slot C11. The upper two ports connect to the internal network switches, as
described in “Ethernet switches” on page 24. The lower two unused connections are
available for Transparent Cloud Tiering (TCT). These connections are the lower two ports
of the LPAR Ethernet adapter and were the original low-speed TCT connections.
TCT connections
An optional high-speed Ethernet adapter feature can be ordered for TCT, which provides
two 10 Gbps LC connections and two RJ-45 1 Gbps connections. For DS8910 model 993,
the 10 Gbps adapter (Feature Code 3602) is installed in slot C4 of each processor node.
These ports are the two high-speed and two low-speed TCT connections, which are an
optional chargeable hardware feature. In summary, six TCT connections are available: two
low-speed included, and optionally, two high speed and two low speed.
Because the DS8910F system modules can be mounted in any conforming rack, the
management enclosure is designed to create a compact container for all essential system
management components.
Figure 2-15 shows the layout of the components of the management enclosure.
The management enclosure provides internal communications to all of the modules of the
DS8910F system. The management enclosure also provides external connectivity by using
two Ethernet cables from each HMC for remote management. It also provides
keyboard/mouse and video connectivity from each HMC for local management. Cables are
routed from the management consoles to the rear of the management enclosure through a
cable management arm (CMA).
The HMC connects to the customer network and provides access to functions that can be
used to manage the DS8910F. Management functions include logical configuration, problem
notification, Call Home for service, remote service, and Copy Services management.
Management functions can be performed from the DS8000 Storage Management GUI, DS
command-line interface (DS CLI), or other storage management software that supports the
DS8910F.
Clients who use the DS8900 advanced functions, such as Metro Mirror or FlashCopy, can
communicate to the storage system with IBM Copy Services Manager (CSM).
The management console provides connectivity between the DS8910F and Encryption Key
Manager servers, if used.
The management console also provides the functions for remote call home and remote
support connectivity.
Ethernet switches
The DS8910F management enclosure has two 8-port Ethernet switches. The two switches
provide two redundant private management networks. Each processor node includes
connections to each switch to allow each server to access both private networks. These
networks cannot be accessed externally, and no external connections are allowed. External
client network connection to the DS8910F system is through dedicated connections to each
of the management consoles.
Figure 2-19 shows the connections at the rear of the DS8910F management enclosure.
Note: Only DS8910F model 993 enclosures are allowed to be connected to the optional
iPDU pair.
Rack power control is through Ethernet-managed iPDUs and HMC manages system power
state and monitoring.
The standard 19-inch wide rack installation (Feature Code 0939) requires the following power
connections:
15U configuration requires 7x IEC C13 power on two different power distribution units
(PDUs) (total 14). Optional monitor adds a C13 on either PDU.
19U configuration requires 9x IEC C13 power on two different PDUs (total 18) and monitor
adds a C13 on either PDU.
For more information about power input requirements, see 3.1.2, “Planning for power
requirements” on page 32.
IO Bay Pairs 1 2U 1 5U
Display and Keyboard One 19-inch wide rack mounted One 19-inch wide rack mounted
(optional) (optional)
One with z15 model T02 or
LinuxONE III model LT2
integration
Ethernet Switch in 2 2
management enclosure
a. The DS8882F and DS8910F systems, when integrated into IBM z14 model ZR1 or LinuxONE
II model LR1, use 16U contiguous space and share the keyboard display unit that is provided
by IBM Z.
This chapter provides information about installation and integration and includes the following
topics:
3.1, “DS8910F integration” on page 30
3.2, “Integrating the DS8910F into IBM Z entry models” on page 37
3.3, “Integrating the DS8910F into a standard 19-inch rack” on page 45
The first two scenarios are identical from a DS8910F perspective, and can be considered the
same process. For more information about these scenarios, see 3.2, “Integrating the
DS8910F into IBM Z entry models” on page 37.
The third scenario is described in 3.3, “Integrating the DS8910F into a standard 19-inch rack”
on page 45.
This section provides more information about the first two scenarios.
The system must be assembled into the rack that was designated for the DS8910F. The
system must be installed by IBM service representatives.
The designated rack must at minimum have 15U of contiguous dedicated space. The
maximum configuration into a standard 19-inch rack requires 19U of contiguous dedicated
space. An optional KVM (Feature Code 1765) adds 1U to the configuration.
When ordering the DS8910F, a field merge feature code is required to indicate which rack
scenario to use for installing the DS8910F. Feature Code 0937 is the intended installation for
an z15 model T02 or IBM z14 model ZR1, and Feature Code 0938 is for an IBM LinuxONE III
model LT2 or LinuxONE II model LR1. This choice drives a few unique features for this
scenario and excludes others. A minimum of 16U of contiguous space is required. For more
information, see 3.2, “Integrating the DS8910F into IBM Z entry models” on page 37.
Conversely, if Feature Code 0939 is selected, other optional features also are available for
selection. For more information, see 3.3, “Integrating the DS8910F into a standard 19-inch
rack” on page 45. Regardless of which rack scenario is selected for the DS8910F, some
common physical planning requirements must be considered, as described next.
Figure 3-1 shows the six modules that make up the DS8910F and the order that they must be
installed.
42
16U
PDU
8U
22
21
Management Enclosure 6U
14
PDU
Also, each power source must have its own circuit breaker.
If client power distribution units (PDUs) are used, they do not include integrated control or
monitoring. When integrated into the IBM Z rack, DS8910F Model 993 uses the second pair
of IBM Z iPDUs (A3 and A4) in the IBM Z frame. DS8910F KVM in the z15 model T02 or
LinuxONE III model LT2 frame is powered by port 8 of the IBM Z iPDU, A2. IBM z14 model
ZR1 or LinuxONE II model LR1 share the display and keyboard with DS8910F model 993.
Table 3-3 lists the supported three-phase input voltages and frequencies.
Nominal input voltages Nominal input voltages 380, 400, or 415 RMS V AC
System maximum current rating 48 Amps (per PDU cord) 32 Amps (per PDU cord)
Table 3-4 lists the DS8910F power consumption and environmental information.
Table 3-5 Feature codes for D8910F Fibre Channel host adapters
Feature Codea, b Description Receptacle type
For more information about DS8910F host adapters, see Chapter 2, “IBM DS8910F hardware
configuration” on page 7.
Table 3-6 lists the FC cables that are available for order from IBM for the DS8910F.
Table 3-6 Feature codes for Fibre Channel cables for the DS8910F
Feature code Cable type Cable length Compatible FC host
adapter features
For more information about host adapter and FC cable features, see the DS8910F
Introduction and Planning Guide, SC27-9560.
Note: When integrated into IBM Z system rack, it is expected that this system is the host
system that connects to the DS8910F.
However, this connection does not exclude the connectivity to other IBM System z® or
distributed systems that are outside of this rack.
Also, the DS8910F supports connectivity to other DS8000 systems with Copy Services.
Note: A keyboard/mouse and monitor are required for DS8910F installation and
service.
A storage KVM is included with the DS8910F with an integration option into a z15
model T02 or LinuxONE III model LT2 rack.
When integrated in the IBM z14 model ZR1 or LinuxONE II model LR1 rack, the IBM
Z human interface console is shared through the IBM Z KVM switch.
Ethernet connectivity:
– ~900 mm (3 feet) of Ethernet cables are provided for remote connectivity to the
customer networks.
– Two Ethernet cables are available to each HMC.
For more information about keyboard and monitor options for connecting to a z15 model T02
and LinuxONE III model LT2 or IBM z14 model ZR1 and LinuxONE II model LR1, see 3.2,
“Integrating the DS8910F into IBM Z entry models” on page 37.
For more information about keyboard and monitor options for connection to other standard
19-inch wide rack, see 3.3, “Integrating the DS8910F into a standard 19-inch rack” on
page 45.
Ensure that an approved safety appliance is available for installation and service. Table 3-7
lists the safety equipment that can be ordered with the DS8910F.
1102 3 ft. platform ladder for servicing components at a height of 20U or more
The z15 model T02 or LinuxONE III model LT2 is delivered in a 19-inch frame with a lower
cost of entry, and enables you to increase efficiency with a smaller footprint that easily fits into
common data center layouts. The footprint is one tile wide and two floor tiles deep, and
supports operating conditions that are defined in Thermal Guidelines for Data Processing
Environments, Fourth Edition.
16U Reserved Space (Feature Code 0151) reserves EIA locations A23 - A38. This feature is
available with the z15 model T02 and IBM LinuxONE III model LT2. The reserved space is
available for integration of the IBM DS8910F Storage Model 993 only. Using this space for any
other purpose is not permitted. Figure 3-2 shows the z15 model T02 or LinuxONE III model
LT2 rack with the 16U reserved space.
Figure 3-2 z15 model T02 or LinuxONE III LT2 Feature Code 0151 (16U reserved space)
3.2.2 Integrating DS8910F into z15 model T02 or LinuxONE III model LT2
When ordering the DS8910F Model 993 for integration into an existing z15 model T02 or
LinuxONE III model LT2, the correct DS8910F field merge feature must be ordered:
For an existing z15 model T02: Feature Code 0937
For an existing IBM LinuxONE III model LT2: Feature Code 0938
Feature Codes 0937 or 0938 are used as indicator feature codes, and more feature codes are
required to provide the parts that are needed for the integration. The following billable feature
codes are required for field integration of the DS8910F Model 993 order:
Feature Code 0611- z15 model T02 field integration
Feature Code 0621- IBM LinuxONE III model LT2 field integration
All internal and inter-module cables that are required for the DS8910F are included in the
shipping group. Cables must be routed along the spine cable management hardware through
the cable clips or along the sides of the rack to ensure proper airflow.
Two IBM service representatives are required to install the DS8910F into the z15 rack. The
first z15 machine type 8562 that is installed at your site should be provided with a lift tool that
can be used for field integration.
The DS8910F modules and the 1U storage KVM are integrated into 16U contiguous space of
the z15 model T02 or LinuxONE III model LT2 rack (A23-A38).
Figure 3-3 Block diagram of z15 model T02 and LinuxONE III LT2: 16U reserved space and DS8910F
modules
Note: Power cords that are plugged into the IBM Z components cannot be unplugged or
moved except during servicing. Failure to follow this warning might adversely impact the
operation of the z15 machine type 8562, including a possible system outage.
Figure 3-4 z15 model T02 and LinuxONE III LT2 field integration and power connections to DS8910F
The 19-inch rack design opened a new opportunity for IBM Z by enabling the integration of
the DS8910F enterprise storage system into the IBM z14 model ZR1 or LinuxONE II model
LR1 with 16U of reserved space.
Feature Code 0617, 16U reserved space, is required for integration of the DS8910F into the
IBM z14 model ZR1 or LinuxONE II model LR1.
Figure 3-5 shows a block diagram and the front view of an IBM z14 model ZR1 with Feature
Code 0617.
!"#
!"#
!"#
!"#
Figure 3-5 IBM z14 model ZR1/LinuxONE II model LR1: Feature Code 0617 16U reserved space
Figure 3-6 Feature Code 0617 provides the IBM z14 Fibre Channel cable management system
3.2.4 Integrating the DS8910F into the IBM z14 ZR1 or LinuxONE II LR1
The DS8910F modular system can be integrated into 16U contiguous space of an IBM z14
model ZR1 or LinuxONE II model LR1 with Feature Code 0617, 16U reserved space feature.
When ordering the DS8910F to be integrated into an existing IBM z14 model ZR1 or
LinuxONE II model LR1, the correct DS8910F field merge feature must be ordered:
An existing IBM z14 model ZR1: Feature Code 0937
An existing IBM LinuxONE II model LR1: Feature Code 0938
Feature Codes 0937 or 0938 are used as indicator feature codes, and more feature codes are
required to provide the parts that are needed for the integration. The following billable feature
codes are required for field integration of a DS8910F Model 993 order:
Feature Code 0610: IBM z14 model ZR1 field integration
Feature Code 0620: IBM LinuxONE II model LR1 field integration
Feature Code 0610 or 0620 adds two KVM converter cables to the system components.
These cables provide connectivity from each of the DS8910F HMC screens and USB cables
to the IBM Z system KVM switch. These connections allow the DS8910F to share the IBM Z
system keyboard and monitor.
All internal and inter-module cables that are required for the DS8910F are included with the
DS8910F. The cables are organized and routed within the defined 16U of reserved space of
the IBM Z system.
Two IBM service representatives are required to install the DS8910F into the IBM z14 system.
The optional safety equipment that is described in 3.1.5, “Planning for safety and service” on
page 36 is not required.
The first IBM z14 model ZR1 or LinuxONE II model LR1 (machine type 3907) that is installed
at your site should be provided with a universal lift tool that can be used for the field
integration.
Note: Using the service lift tool is allowed only for IBM service personnel.
DS8910F is powered by using the lower set of IBM Z iPDUs (A3 and A4), as shown in
Figure 3-8.
! "#
)ODVK
! "#
)ODVK(QFORVXUH)
)ODVK(QFORVXUH)
$%
,2(QFORVXUHV
$%
$%&
$
&(&(QORVXUH;&
&(&(QFORVXUH;&
$%
$%
'6)
Figure 3-9 Block diagram of IBM z14 ZR1 or LinuxONE II LR1 16U reserved space and DS8910F
modules
When ordering the DS8910F to be integrated into a conforming standard 19-inch wide rack,
the DS8910F field merge Feature Code 0939 must be ordered.
The standard 19-inch wide rack must conform to the following EIA 310D specifications:
19-inch EIA rails
Minimum rail depth of 720 mm
Maximum rail depth of 780 mm
42
16U
I/O Enclosures
PDU
PDU
8U
22
21
Management Enclosure ME1 6U
14
2U
CEC Enclosure XC2
PDU
PDU
42
36
20U
35 Flash Enclosure F05
18U
Flash Enclosure F06
15U Contiguous Space
29 16U
28
Flash Enclosure F07
PDU
PDU
14U
21
12U
10U
I/O Enclosures
15
14
8U
Management Enclosure
PDU
PDU
6U
ME1
8
2U
1 CEC Enclosure XC2
Note: A keyboard/mouse and monitor must be available to install and service the
DS8910F.
The standard 19-inch wide rack installation (Feature Code 0939) supports an optional 1U
keyboard and display (Feature Code 1765). The 15U contiguous space requirement does not
include space for the optional keyboard and display, but they are not required to reside
contiguously with the DS8910F.
For accessibility, the keyboard and display must be mounted at a height of 38 - 117 cm.
(15 - 46 inches). If a keyboard and display is added, ensure that adequate space is provided
to accommodate them. For Feature Code 1765, if no iPDU feature was ordered, customer
PDUs will be used and one IEC C13 power connection is required. The model 993 power
supplies do not include any power output connectors. You must make one available on the
C13 power connection in the rack.
Note: Optional Feature Code 1765 (1U keyboard and display) cannot be added between
modules of the DS8910F in the 15U of contiguous space.
When the DS8910F is integrated into a conforming standard 19-inch wide rack, host
connectivity can be to following components:
Any supported distributed systems that are inside or outside the same rack
IBM Z hosts
Other DS8000 systems through Copy Services
For more information about supported host connectivity, see the DS8910F Introduction and
Planning Guide, SC27-9560.
The DS8910F requires two service representatives to install into the designated rack.
Although the DS8910F can be installed in 15U or 19U of contiguous space at any height in
the rack, consider the position in the rack where it is installed because of the weight of the
components and accessibility for service.
Ensure that an approved safety appliance is available for installation and service. Table 3-7 on
page 36 lists the safety equipment that can be ordered with the DS8910F.
Important: IBM is adopting RCL as the default delivery for DS8000 code upgrades.
RCL is the trusted process of having IBM support personnel securely connect to a DS8000
system, enable the remote acquisition, perform the distribution and activation of Licensed
Internal Code (LIC) bundles, and Install Corrective Service (ICS) images.
The RCL process is concurrent; that is, it can be run without interruptions in the business
operations. This process consists of the following steps, as shown in Figure A-1:
1. IBM Remote Support work with IBM Technical Advisors for the planning of the microcode
update. This process ensures that the client’s environment is considered in the planning
phase.
2. When an RCL is agreed upon and scheduled, an IBM trained resource in the support
center starts a session with the target Hardware Management Console (HMC).
3. During the agreed upon window, IBM directs the HMC to acquire the code images from
the FixCentral repository and prepare for code activation.
4. During the customer maintenance window, IBM starts the activation request, which moves
the HMCs and DS8000 to the new target microcode level.
The publications that are listed in this section are considered suitable for a more detailed
description of the topics that are covered in this paper.
IBM Redbooks
The following IBM Redbooks publications provide more information about the topic in this
document. Some publications that are referenced in this list might be available in softcopy
only:
IBM DS8000 High-Performance Flash Enclosure Gen2 (DS8000 R9.0), REDP-5422
IBM DS8900F Architecture and Implementation, SG24-8456
IBM DS8900F Product Guide, REDP-5554
IBM Power Systems S922, S914, and S924 Technical Overview and Introduction,
REDP-5497
You can search for, view, download, or order these documents and other Redbooks,
Redpapers, web docs, drafts, and other materials, at the following website:
ibm.com/redbooks
Other publications
The following publications are also relevant as further information sources:
Command-Line Interface User's Guide, SC27-8526
DS8882F Introduction and Planning Guide, GC27-9529
IBM 3907 Installation Manual for Physical Planning (IMPP), GC28-6974
IBM 8562 Installation Manual for Physical Planning (IMPP), GC28-7011
IBM DS8000 Host Systems Attachment Guide, SC27-9563
IBM DS8900F Introduction and Planning Guide, SC27-9560
Online resources
The DS8900F IBM Knowledge Center website also is relevant as a further information
source:
https://www.ibm.com/support/knowledgecenter/SSHGBU_9.1.0/
REDP-5566-01
ISBN 0738459232
Printed in U.S.A.
®
ibm.com/redbooks