Welcome to XtremIO Hardware Fundamentals.

Copyright ©2015 EMC Corporation. All Rights Reserved. Published in the USA. EMC believes the information in this publication is accurate as of its publication date. The information is subject to change 
without notice.  

THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.”  EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS 
PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.

Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. The trademarks, logos, and service marks (collectively "Trademarks") appearing in 
this publication are the property of EMC Corporation and other parties. Nothing contained in this publication should be construed as granting any license or right to use any Trademark without the prior 
written permission of the party that owns the Trademark.

EMC, EMC² AccessAnywhere Access Logix, AdvantEdge, AlphaStor, AppSync ApplicationXtender, ArchiveXtender, Atmos, Authentica, Authentic Problems, Automated Resource Manager, AutoStart, 
AutoSwap, AVALONidm, Avamar, Bus‐Tech, Captiva, Catalog Solution, C‐Clip, Celerra, Celerra Replicator, Centera, CenterStage, CentraStar, EMC CertTracker. CIO Connect, ClaimPack,  ClaimsEditor,  
Claralert ,cLARiiON, ClientPak, CloudArray, Codebook Correlation Technology, Common Information Model, Compuset, Compute Anywhere, Configuration Intelligence, Configuresoft, Connectrix, 
Constellation Computing, EMC ControlCenter, CopyCross, CopyPoint, CX, DataBridge , Data Protection Suite. Data Protection Advisor, DBClassify, DD Boost, Dantz, DatabaseXtender, Data Domain, Direct 
Matrix Architecture, DiskXtender,  DiskXtender 2000, DLS ECO,  Document Sciences, Documentum, DR Anywhere, ECS, elnput, E‐Lab, Elastic Cloud Storage, EmailXaminer, EmailXtender , EMC Centera, EMC 
ControlCenter, EMC LifeLine, EMCTV, Enginuity, EPFM. eRoom, Event Explorer, FAST, FarPoint, FirstPass, FLARE, FormWare, Geosynchrony, Global File Virtualization, Graphic Visualization, Greenplum, 
HighRoad, HomeBase, Illuminator , InfoArchive,  InfoMover, Infoscape, Infra, InputAccel, InputAccel Express, Invista, Ionix, ISIS,Kazeon, EMC LifeLine, Mainframe Appliance for Storage, Mainframe Data 
Library, Max Retriever, MCx, MediaStor , Metro, MetroPoint, MirrorView, Multi‐Band Deduplication,Navisphere, Netstorage,  NetWorker, nLayers, EMC OnCourse, OnAlert, OpenScale, Petrocloud, 
PixTools, Powerlink, PowerPath, PowerSnap, ProSphere, ProtectEverywhere, ProtectPoint, EMC Proven, EMC Proven Professional, QuickScan, RAPIDPath, EMC RecoverPoint, Rainfinity, RepliCare, 
RepliStor, ResourcePak, Retrospect, RSA, the RSA logo, SafeLine, SAN Advisor, SAN Copy, SAN Manager, ScaleIO Smarts, EMC Snap, SnapImage, SnapSure, SnapView, SourceOne, SRDF, EMC Storage 
Administrator, StorageScope, SupportMate, SymmAPI, SymmEnabler, Symmetrix, Symmetrix DMX, Symmetrix VMAX, TimeFinder, TwinStrata, UltraFlex, UltraPoint, UltraScale, Unisphere, Universal Data 
Consistency, Vblock, Velocity, Viewlets, ViPR, Virtual Matrix, Virtual Matrix Architecture, Virtual Provisioning, Virtualize Everything, Compromise Nothing, Virtuent, VMAX, VMAXe, VNX, VNXe, Voyence, 
VPLEX, VSAM‐Assist, VSAM I/O PLUS, VSET, VSPEX, Watch4net, WebXtender, xPression, xPresso, Xtrem, XtremCache, XtremSF, XtremSW, XtremIO, YottaYotta, Zero‐Friction Enterprise Storage.

Revision Date: Published 7/2015

Revision Number: MR-7WP-XIOHWFUN

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 1
 This course provides an introduction and description of the EMC XtremIO architecture and models.
Upon successfully completing this course you will be able describe the hardware components and
Field Replaceable Units (FRUs). Before performing any service procedure on a XtremIO All-Flash
Storage Array, you must obtain the latest XtremIO information from the EMC support web site,
https://support.emc.com/.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 2
 This module describes the XtremIO architecture, models, and cluster offerings.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 3
 EMC XtremIO is an all-flash storage array that has been designed from the ground-up to
unlock flash's full performance potential and deliver array-based capabilities that
leverage the unique characteristics of Solid-State drives (SSDs), based on flash media.
XtremIO is a block-based all-Flash storage array that uses industry standard components and
proprietary intelligent software. The basic building block of an XtremIO array is the X-Brick. An
X-Brick is comprised of two storage controllers (SCs), a Battery Backup Unit (BBU), and a Disk
Array Enclosure (DAE).

The storage controllers handle data input/output, data processing and data layout on the array
and Flash media.

The Disk Array Enclosure houses the enterprise Multi-Level Cell (eMLC) SSDs. There four X-Brick
models discussed later.

The Battery Backup Unit is present to provide high availability in case of source power issues.
Each X-Brick in a multi X-Brick cluster requires a BBU. However, a single X-Brick cluster requires
two BBUs. A two X-Brick cluster requires only two BBUs. After the first X-Brick, each X-Brick
only requires one BBU per X-Brick.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 4
 Each storage controller (SC) has multi-core Intel Xeon processors. All SCs have a very large
amount of RAM that is aggregated when the SCs are clustered together using RDMA (Remote
Direct Memory Access) over a highly available InfiniBand network. Each SC uses SAS version 2.0
to communicate and transfer data to and from a Disk Array Enclosure and the Solid State Drives.
With XtremIO 4.0.0-64, the SAS connections between the storage controllers and DAEs are now
active/active. Being a block-only storage array, data connectivity is available only through Fibre
Channel and iSCSI. An X-Brick provides four 10 GbE iSCSI and four 8 Gb/s Fibre Channel front-
end ports for block connectivity to the hosts.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 5
 Each Storage Controller in the X-Brick runs a custom lightweight Linux as a base
platform. The XtremIO Operating System (XIOS), runs on top of the Linux and handles
all activities within a Storage Controller. XIOS is optimized for handling high I/O rates
and manages the system's functional modules, the RDMA over InfiniBand operations,
monitoring and memory pools. XIOS has a proprietary process-scheduling-and-handling
algorithm, which is designed to meet the specific requirements of the content-aware, low
latency, and high performance storage subsystem.

Regardless of which Storage Controller receives an I/O request from a host, multiple
Storage Controllers on multiple X-Bricks cooperate to process the request. The data
layout in the XtremIO cluster ensures that all components inherently share the load and
participate evenly in I/O operations.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 6
 There are four X-Brick models available with or without Encryption*, the 10 TB Starter (5 TB), 10
TB, 20 TB, and the 40 TB:
• 10 TB Starter (5 TB) contain thirteen 400 GB SSDs (Expandable to 10 TB)
• 10 TB with (25) 400 GB SSDs
• 20 TB with (25) 800 GB SSDs Encryption Capable
• 40 TB with (25) 1.6 TB SSDs Encryption Capable

Encryption models use Self Encrypting Drives (SEDs) discussed later in the course. In XtremIO
version 4.0.0-64 the Encryption feature is available by default.

Note: ** Usable capacity is the amount of unique, non-compressible data that can be written
into the array. Effective capacity will typically be much larger due to XtremIO's Inline Data
Reduction.

The 10 TB Starter (5 TB), 10 TB, and the 20 TB use Generation 2 storage controllers. The 40 TB
model uses a Generation 3 SC hardware. More on the hardware generations later.

For more information read the table.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 7
 XtremIO is offered in a Starter, one, two, four, six, and eight X-Brick cluster configurations. A
cluster is created during the last part of the installation process.

All X-Bricks in a cluster must be of the same type either 10 TB with or without Encryption, 20 TB,
with or without Encryption, or the 40 TB with or without Encryption.

Please take a moment and study the table for more information.

Note: “NA” means Not Applicable at the XtremIO v4.0.0-64 release. The 10 TB X-Brick can be
used in 1,2 and 4 X-Brick cluster sizes only. The 20 TB X-Brick can be used in the 1,2,4,6 and 8
X-Brick cluster sizes and is the only X-Brick that can be used in all the clusters sizes except the 10
TB Starter (5 TB). The 40 TB X-Brick presently only can be used in 1,2, and 4 X-Brick cluster sizes
with the 6 and the 8 X-Brick cluster sizes coming soon. The 8-Brick cluster is nicknamed the “The
Beast”!

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 8
 A dispersed (separated) cluster is an XtremIO storage array in which the X-Bricks are installed
and reside in adjacent racks instead of just one. Dispersed Clusters allow customers who currently
have 2 X-Bricks and now needs to expand their cluster with additional X-Bricks but has no
contiguous space in the cabinet or install a new cluster but has space limitations. A dispersed
cluster(s) can be racked in two or three cabinets. The intention is to allow a customer who
wants to expand their cluster or install a new cluster but do not have space in the same
rack. With XtremIO v4.0.0-64 “The Beast” is available in one 44 or 45U rack or as a dispersed
cluster.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 9
 If a dispersed cluster is requested by a customer, certain requirements must be met. Installation
of a dispersed cluster can only be carried out via an RPQ (Request for Product
Qualification/Request Price Quotation), and is subject to EMC’s approval. RPQ approval includes
a diagram identifying the agreed X-Brick/switch locations along with a wiring diagram. These
diagrams should be maintained at the site, preferably within the cabinets containing the X-Bricks.
No deviation from this configuration is supported without EMC’s agreement.

There are specific layout requirements when installing a dispersed cluster. If the cluster is
dispersed over three racks, the InfiniBand Switches must be installed in the middle rack. The two
InfiniBand Switches must always be adjacent to each other in the same rack, with a 1U
placeholder between the switches. X-Bricks can be dispersed in any order within the racks. When
expanding an existing cluster, only the new X-Bricks can be used for a dispersed configuration. A
physical XMS can be placed in any of the racks used to deploy other cluster components. EMC
recommends, for consistency purposes, to place the XMS server at the bottom of the rack which
contains X-Brick one.

The following cable kits are available for installing a dispersed cluster. 2 meter cable kit: Where
the X-Brick is in the same rack as the InfiniBand Switch.

And a 5 meter cable kit: Where the X-Brick is not in the same rack as the InfiniBand Switch.
When more than one rack is to be used, depending on the racks and their cable outing provisions,
the location of the InfiniBand Switches and all X-Bricks within the racks must be designated in
such a way to enable easy connection of the 5 meter cables.

Note: Again, a RPQ must be used if a customer requests a non-supported configuration. There is
a RPQ document that must be completed by a sales person for the customer then submitted for
approval.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 10
 This module describes the hardware components of an XtremIO storage array. The location of
FRUs, LEDs, buttons, and ports are covered.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 11
 Please take a few minutes to view the presentation.

To view this video go to the following URL:

https://edutube.emc.com/Player.aspx?vno=GS4OH+gFHC+rq+8uZOxx4g==&autoplay=t
rue

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 12
 Here is the front view of a Storage Controller. There are 8 drive slots. The slot numbers start with
0, however the drive numbers start with 1. Starting in the lower left corner is Slot 0. It is
populated with an SSD named LocalDisk1. LocalDisk1 is used as a Boot Disk and a Journal.
Moving up is Slot 1 housing LocalDisk2. It is an HDD and used as a Trace Disk. Slots 2 and 3 are
empty. Slot 4 houses LocalDisk5. It is an SSD used as a Journal Disk. Slot 5 with LocalDisk6 is a
HDD used as a Trace Disk. Slots 6 and 7 are empty. Above slot 7 is the Storage Controller
Identification (ID) LED, the NIC Activity LEDs, the SC Status LED, and the Power Button. The
Storage Controller ID LED is used to locate the SC if required and can be activated to blink via the
CLI or GUI. The SC Status LED indicates boot and hardware status.

Next there is a Power Button, however it should not be used to power up the SC except when
instructed to in the XtremIO User Guide under “Powering Up the Storage Controllers”. Always run
the show-storage-controllers CLI command to view all of the SCs in the cluster before pressing
any physical power buttons. For each SC whose Conn-State is not shown “as connected”, power
on the SC(s) manually, by pressing the Power Button.

The Power Button should never be used to power off an SC except when instructed to do so in an
emergency situation explained in the XtremIO User Guide under “Emergency Shutdown”.

Note: If possible, it is recommended to power off the cluster via the XtremIO
Management Station (XMS), as described in the “Planned Shutdown” section of the
XtremIO User Guide.

Note: If the SCs were shut down due to a power outage, they power up automatically
when the Battery Backup Units (BBUs) are powered up.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 13
 Each Storage Controller has two InfiniBand (IB) ports for the internal XtremIO array
communication—named B1 and IB2. When viewing from the rear, IB2 is on the left.

As stated earlier, XtremIO storage arrays provide Fibre Channel (FC) and iSCSI protocol
support. The two 8 Gb/s FC ports are named FC1 and FC2.

The two iSCSI 10 GbE SFP+ ports are located below the two FC ports. They are named iSCSI1
and iSCSI2.

The two 6 Gb/s SAS ports are used to connect to the X-Brick DAE. They are named SAS1 and
SAS2.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 14
 Next, along the bottom, starting on the left are four RJ45 ports. Ports 1,2 and 4 are Ethernet
connections that are activated. These ports are labeled with the standard Ethernet symbol.
Port 1 is used for management of the SC and is named MGMT in the XIOS. This port connects
to the customer’s LAN. Port 2, named TECH. This is for EMC service personnel only and is used
to initially configure the SC. It has a pre-configured IP address of 169.254.254.1/20 (Subnet
mask: 255.255.240.0). It is available for console access through Secure Shell (SSH).

The 3rd RJ45 port is not used, but the 4th RJ45 port, known internally as Eth3 is used for the
dedicated IPMI (Intelligent Platform Management Interface). All of these are 1 Gb/s Ethernet.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 15
 Storage Controllers have two redundant Power Supply Units (PSUs)—named PSU-L and PSU-R.
In the SW these Power Supplies are labeled X(x)-SC(y) PSU-L and PSU-R. The (x) indicates the
Cluster Number, the (y) indicates Storage Controller Number (1 or 2). Each Power Supply (PS)
has a Status LED. The PSs are the only replaceable FRU other than the entire SC itself.

The remaining connections are as follows:

• There is a KVM/VGA connection for a video monitor which can be used for the installation
• A (RJ45) COM port for the BBU serial connection
• Three usable USB connections which can be used for the software installation

Next to the USB ports is a Status LED that is illuminated if a HW issue is detected in the SC.

Next to the Status LED is an Identification LED. A beacon feature can be activated in the GUI
and CLI to force this ID LED to blink. The feature will beacon both the front and rear ID LEDs.

Next, is another RJ45 port labeled MGMT or RMM (Remote Management Module) and is used as
a second IPMI port. Do not confuse this port with the MGMT port mentioned earlier! This
port connects to the other SC’s dedicated IPMI port using a dedicated Ethernet cable. This
keeps the IPMI network private.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 16
 This image illustrates how the XtremIO storage array is connected to both 8 Gb/s Fibre
Channel and 10 GbE iSCSI networks. Again, each X-Brick has four FC and four iSCSI front-end
ports, two on each storage controller. Hosts can use either of the two protocols or both at the
same time. A key feature of XtremIO is that all volumes are accessible via any of these ports
on any X-Brick. Therefore, each port provides high performance access to any data anywhere
in the system. For High-Availability (HA) you should have 2 iSCSI network switches and/or 2
FC SAN network switches.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 17
 From a visual perspective, both Generation 2 and Generation 3 Storage Controllers are identical.
The Gen2 Storage Controllers will continue to be used in the 10 TB, and 20 TB X-Brick
configurations. Note that performance is about the same. The 40 TB X-Brick DAE is populated
with 25 1.6 TB SSDs, providing 40 TB of raw space, 30 TB of usable space and managed by two
Gen3 Storage Controllers.

The increases in size on the Gen3 Storage Controllers are not only for capacity reasons but to
hold the metadata associated with the increased capacity. Logical capacity will still adhere to the
guidelines in place for the previous X-Bricks, up to 6X data reduction. The two 200 GB SSD
SEDs store the XIOS and the journals dump. The two 900 GB SAS2 HDDs contain
the data path IO traces for the last several hours. The Gen3 Storage Controllers can
only be used in a 40 TB X-Brick cluster.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 18
 Please take a few minutes to view the presentation.

To view this video go to the following URL:

https://edutube.emc.com/Player.aspx?vno=Jl7PZsSufJZlKEeMy6q71g==&autoplay=true

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 19
 The DAE is a 2U enclosure and consists of the enclosure, the SDDs, Link Control Cards (LCC),
and the Power Supply Units. The LCCs are also called the DAE Controller Cards.

Supported drives are 400 GB, 800 GB and 1.6 TB Solid State Drives (SSD)/Self-Encrypting
Drives (SEDs). On the DAE between drives 8 and 9 is a DAE ID LED. This LED can be
turned on using the CLI or GUI to and is used to identify the DAE in the rack or data
center. Between drives 16 and 17 is the DAE Status LED. This LED illuminates if a
hardware problem is detected by the DAE firmware. Each SSD have a Data/Status LED
and a Drive ID LED.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 20
 Here is the rear view of the DAE. Starting on the left is the Power Supply Unit Left, X(x)-DAE-
PSU-B. The (x) is the Cluster Number, DAE is for Disk Array Enclosure, Power Supply B. PSU-A
is on the far right. Note that placement of PSU-A is inverted to PSU-B. Each PSU have Status
LEDs next to the Power Inlet Connector. Between the PSUs are two DAE Controllers or LCCs
(Logical Link Cards). LCC-A is on the bottom and LCC-B is on the top.

On each LCC are two 6 Gb/s SAS connectors for connections to/from the SCs. The SAS port
name convention is X<x>-SC<y>-DAE Controller-<A/B>-<L/R>. Where the lower case <x> is
the Cluster Number, the lower case <y> is the storage controller number, DAE Controller
(which is the LCC) <A or B>, and finally the SAS port <L for Left and R for Right>.

The ports are marked with diamonds and dots that will match the keyed SAS cable labeling.

Next are the DAE LCC Status LEDs and the DAE LCC Identification LEDs. There are RJ45
connectors, and 3 seven segment LEDs on each LCC that are not used.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 21
 XtremIO storage arrays use eMLC, enterprise multi-level cell SSDs. These SSDs have been
enhanced to accommodate more write cycles than inexpensive consumer-grade MLC
flash and serve as a compromise between the MLC flash and very expensive single-level
cell (SLC) flash. The sizes presently used are either 400 GB, 800 GB or 1.6 TB with or without
encryption. The drive sizes or types cannot be mixed within a single DAE or the entire cluster. The
drives are made by HGST, Hitachi Global Storage Technologies, which is a subsidiary of Western
Digital. Each drive is assigned a World Wide Name (WWN).
To replace a defective SSD follow the procedure in the appropriate XtremIO Storage Array FRU
Replacement Procedures Guide for the version of XIOS on the array.

In the CLI to view drive information enter the command show-ssds. The SSD name in the form
of a WWN is shown along with it’s drive Index number, the Brick Name and the X-Brick’s Index
Number, the Slot number, the drive Product Make and model, its state and more.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 22
 Data at Rest Encryption (DARE) or (D@RE) is a mandatory requirement established in several
industries, such as health care, banking, and in many government institutions. XtremIO’s
implementation of DARE utilize an inline encryption technique to ensure that all data stored on
the array is unusable if the SSD media is removed. This prevents unauthorized access in the
event of theft or loss during transport, and makes it possible to return/replace failed components
containing sensitive data.

XtremIO uses Self-Encrypting Drive (SED) technology. An SED has dedicated hardware, which is
used to encrypt and decrypt data as it is written to or read from the SSD. This offloads the
encryption task to the SSD and enables XtremIO to maintain the same software architecture
whether encryption is enabled or not on the array.

A unique Data Encryption Key (DEK) is created during the drive manufacturing process. The key
does not leave the drive at any time. It is possible to erase the DEK or change it, but this causes
the data on the drive to become unreadable and no option is provided to retrieve the DEK. In
order to ensure that only authorized hosts can access the data on the SED, the DEK is protected
by an Authentication Key (AK). Without this AK the DEK is encrypted and cannot be used to
encrypt or decrypt data. SEDs are shipped out of the factory in an unlocked state, meaning that
any host can access the drive data. In unlocked drives the data is always encrypted, but the DEK
is always decrypted and no authentication is required.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 23
 Locking the drive is made possible by changing the default drive's AK to a new, private AK and
changing the SED settings so that it remains locked after a boot or power fail (such as when an
SSD is taken out of the array). When an SSD is taken out of the array, it is turned off and will
require the AK upon booting up. Without the correct AK the data on the SSD is unreadable and
safe.

To access the data the hosts must provide the correct AK, a term that is sometimes referred to as
"acquiring" or "taking ownership of " the drive, which unlocks the DEK and enables data access.

Drive acquisition is achieved only upon boot, and the SED remains unlocked for as long as the
array is up. Since data passes through the encryption or decryption hardware in all cases, there is
no performance impact when locking an SED.

The XtremIO All-Flash Array encrypts data on the Data SSDs (where all User Data is stored) and
the Storage Controller SSDs (which may contain User Data journal dumps).

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 24
 XtremIO arrays utilize the Eaton 5P 1550i R Battery Backup Unit as a technology refresh for the
Eaton 1550 Evolution, which has reached EOL. However the Eaton 1550 Evolution still may be
shipped with some warehoused clusters.

Each X-Brick in a multi X-Brick cluster requires a BBU. However, a single X-Brick cluster requires
two BBUs. A two X-Brick cluster requires only two BBUs. After the first X-Brick, each X-Brick
only requires one BBU per X-Brick. Again, only a single X-Brick cluster requires two BBUs
per X-Brick.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 25
 Please take a few minutes to view the presentation.

To view this video go to the following URL:

https://edutube.emc.com/Player.aspx?vno=2DYg4Jj7RihzjESAnPsV/Q==&autoplay=true

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 26
 The BBU LCD provides information on the status of the BBU. The BBU must be charged to at least
70% of full capacity in order for the cluster to start. This information will be displayed on the LCD.
If the LCD display is lit, then the BBU is receiving power.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 27
 This is the rear view of the 5P 1550iR BBU. There needs to be at least two BBUs in every cluster
configuration in order to provide power to the Storage Controllers. The first connector on the left
is COM-L. Next, is the Power Input connector and then COM-R.

Of the six output connections, only two grey managed (programmable) ports are used to connect
to the Storage Controllers. These ports are named Prog1 and Prog2 because they are
programmable. The center gray and all the black power outputs are not used.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 28
 One BBU contains two batteries. It is a rack solution that requires 1U of rack space. Its front
control panel has a two-bar graph. The top one indicates the percent load (power consumed from
BBU), and the bottom one shows the battery charge level. At least three charge indicator LEDs
must be illuminated to indicate that a Battery Backup Unit is sufficiently charged to power up an
XtremIO Storage Controller. The next two LEDs represent the status of the two managed
(programmable) power outlets. Next is the On/Off button for the BBU and outlets. The next three
LEDs are the Load-Protected LED, Downgraded-Operation LED, and the Load-Not-Protected LED.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 29
 All the connections on the 1550 Evolution BBU are in the rear panel. Here we find two COM ports,
the left and right RS232 serial ports named COM-L and COM-R. These ports are used for the
communication connection between the Storage Controllers and the BBU. For these ports, a DB9-
RJ45 cable is used.

• The BBU has the DB9 connecting to it.

• The RJ45 connector plugs into the COM port on the Storage Controller (marked with 1O1O1).

Furthermore, there is the power input connection—AC from the Power Distribution Unit (PDU) in
the rack, as well as power output connections. Of the four output connections, only the two grey
managed (programmable) ports are used to connect to the Storage Controllers. They are named
Prog1 and Prog2. he other two black power outputs are not used. There are no FRUs except
the entire BBU.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 30
 The BBUs have serial ports, power input, and power outputs connections. The power connection
and port names use the component name BBU (BBU1 or BBU2) and then add the port and
number or position. The slide illustrates BBU2 from a Single X-Brick.

• The name for the power input would be X1-BBU2-Input

• The name for the two power outputs named Prog1 and Prog2, the example shows X1-BBU2-
Output1

• The name for the COM ports are L for Left and R for Right, the example shows X1-BBU2-COM-L

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 31
 Please take a few minutes to view the presentation.

To view this video go to the following URL:

https://edutube.emc.com/Player.aspx?vno=BywjgWeSxPtj/rJjdau9dQ==&autoplay=true

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 32
 There are two 40 Gbps InfiniBand (IB) networks for back-end inter-X-Brick connectivity
and communication between the X-Bricks. The reason for two is for redundancy. In a
single X-Brick configuration, the IB ports of the SCs are connected to each other directly.
The InfiniBand network is mainly used for Remote Direct Memory Access (RDMA)
interconnection which allows data and journal information to be moved to or from the
Storage Controllers. The InfiniBand switch has two redundant Power Supply Units, PSU-L and
PSU-R, and also a fan unit. These are the only two FRUs.

The InfiniBand switch requires 1U of rack space. It has 18 ports, which are facing the rear of the
cabinet. This allows for short, easy cabling from the SC ports, which are also facing the rear. Ports
17 and 18 are connected to the 2nd IB switch to provide an interconnect or Inter-Switch
Link (ISL) between the switches.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 33
 In a single X-Brick cluster, the SCs are directly connected to one another without the need of
InfiniBand switches. Multiple X-Bricks can be combined using the InfiniBand switches to form a
single cluster. With two or more X-Bricks, two 18-port Mellanox InfiniBand 40 Gb/s switches are
provided with the system. The switches provide the back-end network that enables RDMA
communication between all storage controllers in the cluster.

By leveraging RDMA, the XtremIO cluster is in essence a single, shared memory space spanning
all storage controllers. Note that the InfiniBand switch is an unmanaged switch, so there is no
configuration or management by EMC or the customer other than connecting the cables.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 34
 Please take a few minutes to view the presentation.

To view this video go to the following URL:

https://edutube.emc.com/Player.aspx?vno=M7pahWDx47SMj1nvQUxQUQ==&autoplay=
true

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 35
 An XtremIO Management Server (XMS) is a required server used to manage an XtremIO storage
cluster(s). It can be deployed on a dedicated physical server, or as a virtual machine on VMware
using an OVA template. It is not supported on Hyper-V. If the physical appliance solution is
chosen, then the XMS requires 1U of rack space. The XMS image and the XMS Xtremapp software
are installed on the physical XMS which include the CLI and GUI. The XMS must access all
management ports on the X-Brick storage controllers, and must be accessible by any GUI/CLI
client host machine. Since all communications use standard TCP/IP connections, the XMS can be
located anywhere that satisfies these requirements. One XMS is required per cluster prior to
version 4.0.0-64 . With XtremIO v4.0.0-64 one XMS can manage up to eight (8) clusters.
XMS provides access to:
• Cluster health, events, and cluster performance
• Performance statistics history database
• Volume management
• Data protection groups operation logic
• Stopping, starting, and restarting of the cluster

The CLI allows cluster administrators and operators to perform supported management
operations. It is pre-installed on the XMS, and can also be accessed using standard SSH
programs.

On the rear panel, you will find two redundant Power Supply Units (PSUs) – Left and Right. Next,
is the MGMT RJ45 Ethernet port that is connected to the customer’s management LAN. This
Ethernet connection allows communication with the XMS via the management LAN. Next is the
TECH port. It is for use by service personal only and is used to install the XMS image and XMS
Xtremapp software. TECH has a factory preconfigured IP address of 169.254.254.1 and a
netmask of 255.255.240 or /20. The next RJ45 ports are not used. Lastly there is a VGA port for
connecting a monitor and three USB ports where a keyboard can be connected to any one. The
other RJ45 port is not used.

If the virtual appliance approach is chosen, an OVA file is used to install the virtual XMS in a
VMware environment.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 36
 This module covers how the hardware is viewed in the graphical user interface.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 37
 In the XtremIO GUI on the Menu bar, select Inventory to view a list of all hardware components.
In the upper right corner, there is an Inventory List view and a Graphical View. Under the
Inventory List the cluster, X-Bricks, Storage Controllers, Data Protection Groups, DAEs, SSD
Targets, and Battery Backup Units are shown. As the items on the left are selected more
information about that item is shown in the right pane. To see images of the cluster(s), click
Graphical View. The clusters appear on the left. If a particular X-Brick is selected on the left, more
information about that X-Brick is shown in the right pane. This is shown on the next slide.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 38
 This is an image of the Graphical View of the hardware under Inventory. If you click items on the
left, more information is presented in the right pane. Shown above an X-Brick was selected in the
left pane and a view of that X-Brick is shown in the right. You can select Show Back and
Customize View. When viewing the back, you can then select Show Cable Connectivity to view all
connections for that X-Brick.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 39
 Here is the front view of an X-Brick cluster in the GUI.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 40
 Here is the rear view of an X-Brick Cluster in the GUI.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 41
 Here is a close-up of the rear view of a Storage Controller as viewed in the GUI. We have already
went through and named the components and are shown here for emphasis.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 42
 Here is the front view of the DAE as viewed in the GUI. We have already went through and named
the components and are shown here for emphasis.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 43
 Here is the rear view of the 2U DAE as viewed in the GUI. We have already went through and
named the components and are shown here for emphasis.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 44
 This module covers the hardware rack. The module includes the rack types, power breakers,
required power specifications, receptacle types and component locations.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 45
 The table above shows the cluster power consumption and heat dissipation. Calculations
are intended to provide the maximum power and heat dissipation. Ensure that the
installation site meets these worst-case requirements.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 46
 EMC factory 44U racks contain four Power Distribution Panels (PDPs) and four Power Distribution
Units (PDUs). The PDPs connect to electricity sources on site and supply power to the PDUs.
Each pair of PDPs in the rack can support a maximum of 24 amps AC current draw from
devices connected to its PDUs.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 47
 Power cables and connectors depend on the type ordered with the XtremIO Storage
Array equipment, and must match the supply receptacles at the site.

Each AC circuit requires a source connection that can support a minimum of 4800 VA of
single phase, 200-240 VAC input power. A six or eight X-Brick cluster configuration
require 9600 VA of single phase, 200-240 VAC input power.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 48
 For high availability, the left and right sides of the rack must receive power from
separate branch feed circuits.

EMC racks require two or four independent AC power sources, depending on the number
of X-Bricks in the cluster configuration. Configurations of four X-Brick clusters or less
require only two of the four available Power Distribution Panels (PDPs) to be connected to
an electricity source, in order to adequately supply power to all four Power Distribution
Units (PDUs) of a standard cluster (supporting loads of up to 4800 VA). A six X-Brick
cluster exceeds this power limitation. Therefore, a standard rack that is intended for a six
X-Brick cluster configuration must be rewired to a “four PDP configuration” in order to
support up to 9600 VA. EMC racks that are intended for six X-Brick cluster configurations
should be rewired prior to the installation of a fifth and sixth X-Brick.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 49
 Cluster configurations of four or less X-Bricks only need power connected to the unpopulated P1
connectors on the four power distribution units (PDUs) within the rack, as shown on the left.

Cluster configurations of six or eight X-Bricks require all four PDUs to be connected to an
electricity source, as shown on the right.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 50
 The PDUs in the 40U rack have On/Off power switches, however they should not be used
till after the cluster is properly shutdown as explained in the XtremIO User’s Guide.

The PDU configuration on the 44U rack does not have a power On/Off switch, however it
does have circuit breakers. Make sure the four circuit breaker switches on each PDU are
UP, in the OFF (0) position until you are ready to supply AC power. Make sure that the
power is OFF before disconnecting X-Brick components from a PDU.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 51
 Please take a few minutes to view the presentation.

To view this video go to the following URL:

https://edutube.emc.com/Player.aspx?vno=oGAU+iPLdRbRtZA/bNb02Q==&autoplay=tru
e

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 52
 XtremIO components use standard IEC 320 C13/C14 computer power cord extensions with C13
male socket connectors on one end and C14 female plugs on the other. To differentiate
between redundant power sources (A and B), power cables are supplied in black and
gray colors. In order to avoid mis-wiring and jeopardizing High Availability (HA), make
sure to use gray power cables for PWR-A on the right facing the rear and black power
cables for PWR-B on the left.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 53
 Storage Controllers' PWR-A and PWR-B power cables are distinguished with a warning label
(attached to the cable), as shown above. Make sure to use only these cables for connecting the
Storage Controllers to the rack PDUs.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 54
 Shown here are the all of cables used in the XtremIO storage array. A BBU cable connector sleeve
is also shown.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 55
 A cable management bracket has been introduced with/after XtremIO version 4.0.0-64.
They are provided to help protect cables attached to the Storage Controllers. They allow
the SCs to be slid out or back in on its rails without disconnecting the cables. The cable
management bracket assists in accessing the components in the SCs.

Some earlier shipments may not include the bracket. Refer to the XtremIO Hardware
Installation and Upgrade Guide for how to install.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 56
 With the XtremIO 4.0.0-64 release all cables are colored to assist in cabling and identifying cable
end points.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 57
 Here are the two recommended component location images for the XtremIO storage
array. For an eight X-Brick cluster in two adjacent racks, the components should be
stacked as shown in the image on the left. For an eight X-Brick cluster in one rack a 44U
rack is used. Also remember that the XtremIO storage array can be dispersed into 3 rack
cabinets.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 58
 This course provided an overview of the hardware components of the EMC XtremIO
storage array. It described the XtremIO X-Brick models, cluster offerings, and dispersed
clusters. The course also showed all hardware components and sub-components. Rack and power
requirements were also discussed.

Copyright 2015 EMC Corporation. All rights reserved. XtremIO Hardware Fundamentals 59