IBM Storage Networking

Cетевые платформы Brocade и IBM

для решений высокой готовности:
FC/FCoE/CEE/Ethernet

Николай Умнов
Региональный менеджер по продажам
Brocade Россия и СНГ
10 сентября 2009
Dynamic Infrastructure Data Center Networking

Highlights of our Partnership with

 Brocade is IBM‟s First SAN Supplier (3/2000) and longest OEM relationship
 Deep History of relationships at INRANGE, CNT, McDATA (now part of Brocade)
 Significant majority share of IBM switch and director market
 IBM Market Share 96% SAN switches and 84% directors (NE IOT Q2/09)

 February 2009 : Brocade FC-HBA‟s come available

– 8G Single/Dual Port HBAs for x-Series Server
– Single Port (46M6049), Dual Port (46M6050)

 April 2009 : IBM DCN Announcements

– CEE/FCoE switches and CNA (Preview)
– Ethernet switches and routers products
NEW

2 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

BROCADE – Extraordinary Networks

 Aug, 1999 IBM exits the networking hardware industry

 Dec, 2008 Brocade acquires the performance leader in the

Ethernet industry: Foundry Networks

+ =

 Apr, 2009 IBM announces to re-enter the networking hardware

industry as vital part of of Dynamic Infrastructure

3 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

The big difference: Integrated networks with IBM

1 GbE
10 GbE L2-3 WAN
m-series 4 Gbps FC

8 Gbps FC

10 GbE
SAN768B SAN
10 GbE L2-3 10 GbE L2-3 Backbone Director
m-series 10 Gbps
s-series 8G FC & 10G CEE/FCoE CEE
L4-7

CEE/FCoE
SAN
Storage
10 Gb CEE ToR Arrays
GbE ToR GbE ToR 10 GbE MoR GbE ToR FCoE/CEE 8000
g-series c-series s-series c-series
8 Gbps FC
Switch / Director
SAN384B
SAN256B
SAN80B-4
SAN40B-4
FC-HBA & NIC CNA – Only !
SAN24B-4

4 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

Today: Before Unified I/O

 Parallel SAN and LAN
 Potentially less optimal use of
LAN SAN A SAN B
networks, but it works
 Four or more connections per
server:
– Higher adapter and cabling
costs
– Adds CapEx and OpEx
– Each connection adds points
of failure
FC HBAs
(FC Traffic)
 Slower server provisioning
NICs  Additional redundancy and
(Ethernet Traffic)
security due to separate physical
infrastructures
 Separate management realms

FC Ethernet FCoE and CEE

5 © 2009 IBM Corporation
June 2009
Dynamic Infrastructure Data Center Networking

General Unified I/O Usage Case

Corporate
“Traditional” LAN FC SAN
 One fabric infrastructure at the
LAN SAN A SAN B server edge for tier 2/3 app servers
and VMs
 FC and CEE L2/L3 multipathing
end-to-end (as standard is
finalized)
CEE/FCoE Switches  Fewer components to deploy
 Leverages existing network and
storage infrastructure
Converged  Lower TCO
Network
Adapters  Disk array, FICON, and tape will
(CNA) require FC for years to come

FC Ethernet FCoE and CEE

6 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

Fibre Channel over Ethernet (FCoE)

 A mechanism to carry Fibre Channel Application

protocol on top of Converged Enhanced Ethernet
Middleware
 Encapsulates FC frames over CEE
 Leverages the rich set of FC fabric services IP HPC FCoE
Stack Stack Stack
for storage connectivity
– Name services, zoning, WWN structure, Converged Enhanced
Ethernet (CEE)
management, multi-pathing
10 GigE Physical
 Preserves investment in SAN infrastructure
 Converged server connectivity through one physical connection

FCoE Traffic 60%

Ethernet
Link HPC 10%
IP 30%
7 © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

Fibre Channel over Ethernet

Encapsulation protocol for transporting FC over Traditional
Ethernet IP Traffic
Ethernet (Lossless Ethernet: CEE)

CEE FC Traffic
IP Traffic

Ethernet Frame, Ethertype = FCoE=8906h

Same as a physical FC frame
Ethernet

Header
Header
Header

FCoE

CRC
EOF
FCS
FC

FC Payload

Control information: version, ordered sets (SOF, EOF)

 FC frame remains intact: FC does not change

 Ethernet needs a larger frame: Larger than 1.5 KB
 Ethernet must become lossless to carry storage data with integrity

8 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

CEE and FCoE Standards Activities

Developing standards, approval expected by late 2009 or early 2010

IEEE T11 ANSI

802.1Qbb Priority Flow FCoE
Control (PFC)
802.1Qaz Enhanced Transmission SPMA FPMA address
Selection (ETS) discovery

DCBX Data Center Bridging

Exchange protocol proposal for IETF
802.1Qaz TRILL - Transparent
Interconnection of Lots of
802.1Qau Congestion Notification Links (multipath)

Implementation Agreement Approved Draft In Development

9 © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

Brocade FCoE/CEE Solutions Today

Early Access Program has already started !

IBM CNA
Feature code : 42C1820
Brocade
1010/1020
Brocade 1010/1020 CNAs
CNA’s for server
CEE Brocade 8000 Top-
of-Rack Switch
10GbE 24 Brocade
Ports DCFM
FC ports 8@
8Gbps
CEE FC
Total 10GbE 240 Gbps ports
ports FC Traffic
Bandwidth

Total FC 64 Gbps IP Traffic Fibre Channel

Bandwidth SAN

LAN FC Traffic

10 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

IBM Converged Switch B32 – “Top of Rack”

Multi-protocol, multi-layer DCF switch

SAN LAN
To
Single Server Cabinet LAN &
SAN
 Simplify cabinet cabling
using Twinax (max. 5m)
or optical cable IBM B32 (ToR)
FCoE Switch
 10GE short reach or
long reach (OM3) Rack
Servers
 Consolidate SAN and
LAN connections
 Lower I/O adapters and
cables count Server Rack

11 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

IBM Converged Switch B32 (3758-B32)

Multi-protocol, multi-layer DCF switch

24 ports 10 GbE CEE + 8 ports 8G FC

 FCoE switching for server-to-storage  1 U form factor, 350W redundant

connect power supply, standard rack width,
 CEE and L2 switching for server-server hot swappable Fan FRUs
& server-LAN connections
 Back to Front Airflow (port side front)
 Cut Through, Non-Blocking Switch
Architecture  24 ports 10 GbE CEE/FCoE
+ 8 ports 1/2/4/8G FC
 Compatible with Brocade FC installed
base & works with FCoE CNAs  Support for SR, LR SFP+ Optics
 Built on Brocade Fabric OSTM  Twinax (Copper - 10GigE only)
v6.1.2_cee

12 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

IBM Converged Switch B32 (3758-B32)

Port Numbering and Serial Number
 There are two sets of ports: CEE and FC
– 24 CEE ports which are numbered 0 – 23 and support a data speed of 10 GbE
– 8 FC ports which are numbered 0 -7 and support data speeds from 1/2/4/8 Gbit/sec

Brocade branded SFP„s only !

The IBM Converged Switch offers the following SFP optical transceivers:
For FC Ports : 8 Gbps SW (#45W0500) and 10 Km LW (#45W1216) SFP
For CEE Ports :10 Gbps SR (#45W2411) and 10 Gbps LR (#45W2420) SFP+
For CEE Ports : Twinax Active 1 m (#45W2398), 3 m (#45W2408), and 5 m (#45W3039)

Transceivers are also available in 8-pack convenience packages:

For FC Ports : 8 Gbps SW (#45W0501) and 10 Km LW (#45W1218) SFP
For CEE Ports : 10 Gbps SR (#45W2414) and 10 Gbps LR (#45W2421) SFP+
For CEE Ports : Twinax Active 1 m (#45W2401), 3 m (#45W2409), and 5 m (#45W3042)
13 © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

IBM Converged Switch B32 (3758-B32)

– CEE Media

Media Type Fibre Type Max Distance

33 m (OM1)
SFP+ SR
Multi Mode Fibre 82 m (OM2)
(Short Reach)
300 m (OM3)
SFP+ LR 2.5Km (CEE)/
Single Mode Fibre
(Long Reach) 10Km (Ethernet)

SFP+ Cu (Twinax) Copper cables 1, 3, 5 m

14 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

IBM Converged Switch B32 (3758-B32)

– FC Media

Maximum Distance
Transceiver Form
Speed Multi- Single
Type Factor
Mode Media Mode
62.5um/20
50um/500 50um/150
0-
MHz 0MHz 9um
500MHz
SWL (OM1) (OM2) (OM3)
(Short SFP 1Gbps 300m 500m 860m -
Wavelength)
SFP/SFP+ 2Gbps 150m 300m 500m -
SFP/SFP+ 4Gbps 70m 150m 380m -
SFP+ 8Gbps 21m 50m 150m -
10 Km LW
(#45W1216) SFP

15 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

IBM Converged Switch B32 (3758-B32) - Features

 Fabric OS v6.1.2_CEEx FC optionally licensed features supported on the B8000:

– ISL Trunking (#45W0528)
– Advanced Performance Monitoring (#45W0527)
– No POD license required ! All ports are available !

 Fabric OS v6.1.2_CEE FC features not supported on the B8000:

– FICON
– Adaptive Networking (Ingress Rate Limiting and QoS)
– Hot code load activation
– Integrated Routing
– Admin Domains
– Extended Fabrics
– Traffic Isolation Zones

16 © 2009 IBM Corporation

Dynamic Infrastructure Data Center Networking

Brocade Converged Network Adapters (CNA)

IBM x-Series GA date June 26, 2009
IBM Feature Code # 42C1820
10Gb FCoE / CEE Adapters Brocade 10Gb CNA for IBM System x

 Dual-port 10 Gigabit Ethernet CEE

 PCIe 2.0 Gen 2 x8 host bus interface:
– Four independent PCI functions
– Wire speed
 SFP+ copper and optical models
 Multifunction capability:
IBM Feature Code # copper & optical
– NIC: Advanced Link Layer Offload: TCP/IP Brocade 10Gb SFP+ SR # 49Y4216
acceleration, RSS, jumbo frames, VLANs,
Twinax Active 1 m # 45W2398
priority, PAUSE, link aggregation Twinax Active 1 m 8-Pack # 45W2401
– Storage: Hardware FCoE offload Twinax Active 3 m # 45W2408
Twinax Active 3 m 8-Pack # 45W2409
Twinax Active 5 m # 45W3039
Twinax Active 5 m 8-Pack # 45W3042
17 © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

Brocade FCoE/CEE Solutions Tomorrow

Expected in Q4/2009

• 24x 10GbE CEE Ports Brocade

1010/1020 CNA’s
• FCoE entity
CEE
•Add to existing
Brocade
chassis without DCFM
disruption Future DCX
FCoE/CEE Blade

IP Traffic
IP Traffic
Fibre Channel
SAN
LAN
FC Traffic

Fibre Channel over Ethernet Switching (FCoE) – Enables server connectivity to storage
FC Features - Standard Brocade 1/2/4/8G FC Switch
18 Standard L2 Ethernet Features and Converged Enhanced Ethernet (CEE) Switching © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

Is Fibre-Channel dead
… the answer is NO !!!
– FCoE is an extension of an existing technology (Fiber Channel) on a new
transport (CEE).
– There is a large installed based of FC storage (>$50Billion US-dollars)
– CEE/FCoE is not completely ratified today !
– BROCADE„s next gen ASIC for 16G-FC is ready !

… what are our Storage OEMs are saying:

– FC continues to be the main interface
– No reason for storage vendors to implement FCoE natively
– Storage vendors slow in bringing new interfaces (iSCSI)
– FICON/Mainframe is a “wait and see mode”

19 © 2009 IBM Corporation

 Dynamic Infrastructure Data Center Networking

IBM System Storage SAN Product Family

The Leading SAN Connectivity Solutions for Open Systems & Mainframe Environments
SAN768B
SAN256B
(2499-384)
(2109-M48) 16 to 384-ports
16 to 384-ports 1, 2, 4, 8, 10Gbps
1, 2, 4, 10 Gbps FC, FICON
FC, FICON
SAN Health NEW
SAN384B
NEW (2499-192)
IBM DCFM 10.1.4 16 to 192-ports
Data Center Fabric Manager 1, 2, 4, 8, 10Gbps
FC, FICON
SAN80B-4
(2498-B80)
4 & 8* Gbps SAN 48, 64, 80-ports NEW
Switch Module 1, 2, 4, 8 Gbps
for IBM BladeCenter® FC, FICON IBM Converged Switch B32 (3758-B32)
1, 2, 4, 8 Gbps FC 24x10GE FCoE + 8x 8G FC
SAN40B-4
NEW (2498-B40)
24, 32, 40-ports
1, 2, 4, 8 Gbps SystemX Brocade FC HBAs
FC, FICON (46M6049 / 46M6050)
8G FC Single and Dual Port
SAN24B-4
(2498-B24)
8, 16, 24-ports
1, 2, 4, 8 Gbps FC NEW
SAN04B-R (2005-R04) CNA FCoE/CEE Adapter (42C1820)
- upgrade license to SAN18B-R 10GE Dual Port CNA
- FICON Accelerator
20 * GA September, 18th © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

Recent IBM Announcements

 SAN384B (IBM 2499-192) - Brocade DCX-4S

 FOS v6.2 ( Virtual Fabrics, AG B40, Temp. License )
 8G ELWL SFPs – 25 km
 DCFM 10.1.4 (Data Center Fabric Mgr)
 IBM Converged Switch B32 (Brocade B8000 CEE ToR Switch)
 IBM CNA (Convered Network Adapter) # 42C1820
 8G Blade Center Switch Module # 44X1920 & 44X1921

 FICON Qualification for FOS v6.2.0e

– Virtual Fabric support for FICON
– Lossless DLS for FICON
– CUP support for up to two VF in the same chassis
– 48 Port Blade support
– SAN384B (IBM 2499-192) support
21 © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

Introduction SAN384B (IBM 2499-192)

High availability design with slots

for four blades

Smaller version of SAN768B – same functions

Backbone-class capabilities:

 Integrated Routing
 Adaptive Networking with QoS
 Virtual Fabrics
 Inter Chassis Link to SAN384/768
 FOS v6.2 required
 Ready for CEE/FCoE !

Also announcing 8 Gbps 25km Extended-distanced Longwave SFP optical

transceiver and OM3 fibre optic cables
22 © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

Brocade 8Gb SAN Switch Module

IBM 8G 10Port FC Switch Module 44X1921
IBM 8G 20Port FC Switch Module 44X1920
Worldwide availability 9/16/09

 Twenty 8Gb Fibre Channel ports (14 internal server

and 6 external fabric ports)
 Zero foot print, hot pluggable design with no additional
fans or power supplies
 Complete-redundancy with up to four switches per
chassis
 Dynamic Ports on Demand and “Pay-as-you-grow”
port upgrades for 10 port configurations
 Heterogeneous SAN fabric interoperability
 Fabric switch or Access Gateway (NPIV) connectivity
 Auto-sensing and speed matching connections to
8/4/2 Gbit/sec to FC devices
The most comprehensive SAN connectivity solution for IBM Bladecenter
May, 2009 Brocade 8Gb SAN Switch Module Overview
23 © 2009 IBM Corporation
Dynamic Infrastructure Data Center Networking

DCFM - Data Center Fabric Mgr. Roadmap

Manageability solutions Data Center
Fabric Manager
Professional Plus
• CNA SMI-S support
• Partner product
• Extended DCX • HBA SMI-S support integration
Family support • Initial FCoE/CEE • New DCFM for
• DCFM • New virtualization support mid-market • CEE L3
Enterprise GA features support • CEE L2 discovery • DCFM for enhancements
• DCFM • Virtual switch and topology support multi-datacenter • Policy-based
Professional GA enabled discovery • FCoE CNA support management management

Q4 DCFM 10.0 Q1 DCFM 10.1 Q3 DCFM 10.3 Q4 DCFM 10.4 Q1 DCFM 10.5
2008 2009 2009 2009 2010

• Additional Advanced • Pure M-EOS • Next-Gen extension • More Next-Gen

• FM and EFCM
Fabric Services discovery support support extension support
Sustaining Mode
• Unified SAN/HBA • Additional FCoE/CEE • Additional HBA
• Host Connectivity support
• Partner management management support partner integration
Manager (HCM)
integration HBA • Unified FC/FCoE • Converged /
management Embedded SMI-S
• Integration into NMS • DCFM HA
(Step 1)

Brocade reserves the

IBM DCFM v10.1.3 right to change these
GA date July, 2009 dates without notice
24 © 2009 IBM Corporation
Спасибо!

© 2009 IBM Corporation