Deployment of Dell M8024k Blade Switch in Simple Mode With Cisco Nexus 5k Switch
Deployment of Dell M8024k Blade Switch in Simple Mode With Cisco Nexus 5k Switch
Deployment of Dell M8024k Blade Switch in Simple Mode With Cisco Nexus 5k Switch
Victor Teeter
THIS TECHNICAL INTEROPERABILITY WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND
MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS
PROVIDED AS IS, WITHOUT EXPRESS OR IMPLIED WARRANTIES OF ANY KIND.
© 2011 Dell Inc. All rights reserved. Reproduction or translation of any part of this work beyond that
permitted by U.S. copyright laws without the written permission of Dell Inc. is unlawful and strictly
forbidden. For more information, contact Dell. Example: Dell, the DELL logo, and the DELL badge,
PowerConnect, EqualLogic, and PowerVault are trademarks of Dell Inc. in the United States and other
countries. Other trademarks and trade names may be used in this document to refer to either the
entities claiming the marks and names or their products. Dell Inc. disclaims any proprietary interest in
trademarks and trade names other than its own.
August 2011
Page | ii
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Contents
Contents .................................................................................................................................................................................................. 1
Summary ................................................................................................................................................................................................. 2
Simple Switch Mode...................................................................................................................................................................... 2
Testing Scenarios ................................................................................................................................................................................ 4
Scenario 1: Plug and Play the Dell PowerConnect M8024-k switch ...................................................................... 4
Configuring the Dell M8024-k Switch.............................................................................................................................. 5
Configuring the Cisco 5020 Switch .................................................................................................................................. 5
Scenario 2: Configuring an untagged VLAN on a single LAG ................................................................................... 6
Configuring the Dell M8024-k Switch.............................................................................................................................. 6
Configuring the Cisco 5020 Switch .................................................................................................................................. 7
Validation ....................................................................................................................................................................................... 8
Scenario 3: Configuring multiple VLANs on a single LAG .......................................................................................... 9
Configuring the Dell M8024-k Switch.............................................................................................................................. 9
Configuring the Cisco 5020 Switch ............................................................................................................................... 10
Validation ..................................................................................................................................................................................... 11
Scenario 4: Configuring multiple LAGs and dedicating specific Uplinks .......................................................... 12
Configuring the Dell M8024-k Switch........................................................................................................................... 12
Command-Line Interface ................................................................................................................................................... 12
Configuring the Cisco 5020 Switch ................................................................................................................................16
Scenario 5: Configuring multiple VLANs on multiple LAGs ..................................................................................... 17
Configuring the Dell M8024-k Switch............................................................................................................................ 17
Configuring the Cisco Nexus 5020 Switch ................................................................................................................. 23
Scenario 6: Configuring a backup LAG for failover ..................................................................................................... 25
Configuring the Dell M8024-k Switch........................................................................................................................... 25
Configuring the Cisco Nexus 5020 Switch ................................................................................................................. 26
Appendix - Network switch Versions ..................................................................................................................................... 28
About Dell ............................................................................................................................................................................................ 28
Page | 1
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Summary
Adding a Dell™ PowerConnect™ blade (M-Series) switch, with a Dell PowerEdge™ M1000e modular
blade enclosure, to an external Cisco Nexus Switch is a straightforward process. The addition of
Simple Switch Mode on the Dell PowerConnect™ Blade switch further simplifies the process, allowing
integration into existing network with minimal effort. This document is part of the Simple Connect
campaign that includes both Simple Connect for SAN and Simple Connect for LANs – both targeted at
today’s FC SAN and Ethernet LAN environments and meant to serve as a supplement guide on how to
interconnect equipment that makes up datacenter.
This document provides an easy to use step-by-step guide on how to configure and deploy DELL M-
Series 10Gbit/s Blade Switch (M8024-k) (see Figure 1) with a Cisco Nexus 5020 Switch
PowerConnect M8024-k
CONSOLE
3
1
4
2
17
18
19
20
Simple Switch Mode, or SSM, allows server administrators, or anyone with very limited expertise in
configuring Ethernet Switches, the ability to deploy a loop-free switching solution without having to
configure the Spanning Tree Protocol (STP) or design its integration into the existing environment.
The primary advantages of deploying SSM are as follows:
Port Aggregation is easy to configure. Simply group internal ports and associate with external
ports, assign VLANs (if required), and it’s ready to go.
SSM automatically configures multiple external ports into a Link Aggregation Control Protocol
(LACP) trunk group.
By using Aggregator Groups, the Simple Switch Mode provides loop-free operation without
using STP.
Port Aggregation is completely interoperable. Dynamic (via LACP) and static link aggregation
is supported on the external ports.
To enable Simple Switch Mode on a Dell PowerConnect M8024-k switch, perform the following steps
via Command Line or Web Interface:
Command-Line Interface:
To enable simple mode on a M8024-k switch, follow the below:
Page | 2
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
console> enable
console# config
config# mode simple
console(config)# exit
console# copy running-config startup-config
console# exit
Later versions of the firmware do not require a reload of the switch, however some earlier
versions do. Reload the switch if requested. Please run the “show run” command to verify you
are in Simple Mode. Look for the following message within the first 5 lines of the running
configuration:
……
!System Operational Mode “Simple”
…….
Web Interface:
Follow the steps below:
Log into the switch.
Select System Operational Mode Configuration.
In the Configuration screen, select Enable in the Simple Mode drop-down menu, and left-click
Apply (see Figure 2).
Page | 3
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Testing Scenarios
The following sections will present an overview of a variety of different network deployment
scenarios and will provide step-by-step set up guidance using configuration tools with screen shots
as a visual guide. The intent of the paper is to show how some of the features of Simple Switch
firmware can be used to easily and quickly configure both equipment to work with each other
without requiring extensive knowledge of network.
Each of the following scenarios in this document assume you are starting with a default
Simple Mode configuration and (by default) ports Te1/0/1 through Te1/0/20 are currently
members of Port Aggregator Group 1.
All scenarios assume the M8024-k is using external ports 17-20 and that no module is installed
providing additional external 10G ports.
This scenario shows a basic network setup between the PowerConnect M8024-k switch and the
Cisco Nexus 5020. Figure 3 shows this connectivity.
By default, all internal ports and the first 4 external ports of a PowerConnect M8024-k are in port-
aggregator group 1. This configuration can be easily changed by the user at any time. All internal and
external ports within the same port aggregator group can communicate with each other. When one
or more cables are plugged into external ports of the same port-aggregator group and in the same
LAG role (primary or secondary) they are automatically joined in a LAG (link aggregation group).
Secondary LAG roles are for backup LAGs in case of LAG failure.
All ports in a port-aggregator group only go to a single destination, which eliminates the
need for STP.
Upstream switches using STP should have port-fast enabled on any links connected to an
external port of an M8024-k while in Simple Mode. Internal ports of an M8024-k are not
active unless there is at least one active external connection.
Page | 4
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Cisco Nexus
SLOT2
PS1
2 6 10 14 18 22 26 30 34 38
5020
STAT
`
3 7 11 15 19 23 27 31 35 39
L1 MGMT 0
PS2
SLOT3
L2 MGMT 1 CONSOLE 200-240v-6A
4 8 12 16 20 24 28 32 36 40 50~60Hz
2 4 CMC1
1
KVM
2
CMC2
iKVM
CMC
CMC
1 3
4 5 6
7 8 9
Gb 1 Gb 2 Gb 1 Gb 2
1 2 3 4 5 6
A1 B1 C1 C2 B2 A2
M8024-K
LAG
20
2 1
19
18
4 3
17
CONSOLE
Nexus5020#config
Nexus5020(config)#feature lacp
Nexus5020(config)#interface ethernet 1/1-4
Nexus5020(config-if-range)#channel-group 1 mode active
Nexus5020(config-if-range)#exit
Nexus5020(config)#exit
Page | 5
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
This scenario shows an overview of configuring VLANs on the internal ports of the Dell
PowerConnect M8024-k switch. Figure 4 shows this connectivity.
VLANs allow for greater granularity and quality of service (QoS) control over simple sub-netting, and
Dell switches with Simple Switch Mode enabled offer a quick and easy VLAN configuration. In this
example we will configure VLANs across the internal ports of the M8024-k and then extend these
VLANs into the external network by configuring the Cisco Nexus switch.
Cisco Nexus
SLOT2
PS1
2 6 10 14 18 22 26 30 34 38
5020
STAT
`
3 7 11 15 19 23 27 31 35 39
L1 MGMT 0
PS2
SLOT3
L2 MGMT 1 CONSOLE 200-240v-6A
4 8 12 16 20 24 28 32 36 40 50~60Hz
2 4 CMC1
1
KVM
2
CMC2
iKVM
CMC
CMC
1 3
4 5 6
7 8 9
Gb 1 Gb 2 Gb 1 Gb 2
1 2 3 4 5 6
A1 B1 C1 C2 B2 A2
20
2 1
19
18
4 3
17
CONSOLE
Untagged VLAN
100
Command-Line Interface:
Command-line interface for configuring the Dell M8024-k switch is as follow:
console(config)#port-aggregator group 1
console(config-portAggr-group-1)#interface tengigabitethernet 1/0/1
console(config-portAggr-if-Te1/0/1)#switchport general allowed vlan add 100 untagged
Warning! This operation changes default vlan of some interface(s).
console(config-portAggr-if-Te1/0/1)#exit
Page | 6
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
console(config-portAggr-group-1)#exit
console(config)#exit config
Web Interface:
Follow the steps below:
Select Switching>Port Aggregator>Internal Port VLAN.
Select any port from the Internal-Port menu. For this example we chose port Te1/0/1.
Enter a VLAN number, i.e. 100, in the Untagged-VLAN field (Figure 5).
Figure 5. Web Interface for the Dell M8024-k Switch for Scenario 2.
Click Apply.
Nexus5020# configure
Enter configuration commands, one per line. End with CNTL/Z.
Nexus5020(config)# feature lacp
Nexus5020(config)# vlan 100
Nexus5020(config-vlan)# exit
Nexus5020(config)# interface ethernet 1/1-4
Page | 7
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Validation
To validate this scenario simply assign an arbitrary IP address to VLAN interface on the Cisco switch
and try to ping that IP address from the server.
As an example, to assign an IP address to VLAN interface on Cisco Nexus use the following
commands:
Page | 8
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
This section provides an overview of configuring multiple VLANs per internal port to connect to a
server NIC with Tagging enabled, which is useful for management of VMs. Figure 6 shows the
connectivity for this scenario.
Adding a tagged or untagged VLAN to an internal port will add the same VLAN (tagged only)
to all external ports that are members of the same port aggregator group as the internal port.
The same VLAN cannot be in multiple aggregator groups on the M8024k.
Cisco Nexus
SLOT2
PS1
2 6 10 14 18 22 26 30 34 38
5020
STAT
`
3 7 11 15 19 23 27 31 35 39
L1 MGMT 0
PS2
SLOT3
L2 MGMT 1 CONSOLE 200-240v-6A
4 8 12 16 20 24 28 32 36 40 50~60Hz
2 4 CMC1
1
KVM
2
CMC2
iKVM
CMC
CMC
1 3
4 5 6
7 8 9
Gb 1 Gb 2 Gb 1 Gb 2
1 2 3 4 5 6
A1 B1 C1 C2 B2 A2
PowerConnect M8024-k
M8024-K
LAG
20
2 1
19
18
4 3
17
CONSOLE
VLAN 102
Command-Line Interface:
Command-line interface for configuring the Dell M8024-k switch is as follow:
console(config)#port-aggregator group 1
console(config-portAggr-group-1)#lacp auto
console(config-portAggr-group-1)#interface tengigabitethernet 1/0/1
console(config-portAggr-if-Te1/0/1)#switchport general allowed vlan add 101-103
console(config-portAggr-if-Te1/0/1)#exit
Page | 9
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
console(config-portAggr-group-1)#exit
console(config)#port-aggregator lag-failover
Warning! Please ensure that lacp mode is ‘auto’ for all groups.
console(config)#exit
Web Interface:
Follow the steps below:
Select Switching > Port Aggregator > Internal Port VLAN.
Select a port from the Internal-Port drop-down menu, i.e. Te1/0/1.
From the Tagged-VLANs list select one or more VLANs, i.e. 101-103 (Figure 7).
Click Apply.
Nexus5020# configure
Enter configuration commands, one per line. End with CNTL/Z.
Nexus5020(config)# feature lacp
Page | 10
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Validation
To validate scenario 3, assign three different IP addresses to each VLAN interfaces on the Cisco switch
and try to ping that IP address from the server.
As an Example, to assign different IP addresses to VLAN interface on Cisco Nexus use the following
commands:
In order to ping from server, make sure to use a correct subnet address and configure the
network on your server correctly.
Page | 11
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
This section will provide an overview of configuring multiple Port Aggregation Groups (LAGs) to
group specific attached blade servers and dedicating specific Uplinks to carry that traffic to the Cisco
Nexus switch network. For this scenario, blade servers in M1000e ports 1 through 8 get configured in
Port Aggregator Group 1, while blade servers in ports 9 through 16 get configures in Port Aggregator
Group 2.
Cisco Nexus 5020
1 5 9 13 17 21 25 29 33 37
Cisco Nexus
SLOT2
PS1
2 6 10 14 18 22 26 30 34 38
5020
STAT
`
3 7 11 15 19 23 27 31 35 39
L1 MGMT 0
PS2
SLOT3
L2 MGMT 1 CONSOLE 200-240v-6A
4 8 12 16 20 24 28 32 36 40 50~60Hz
LAG 1
2 4 CMC1
1
KVM
2
CMC2
iKVM
CMC
CMC
1 3
4 5 6
LAG 2 Gb 1 Gb 2
A1 B1 C1 C2
1
7
2 3
8
4 5
B2
6
9
A2
Gb 1 Gb 2
20
2 1
19
18
4 3
17
CONSOLE
Command-Line Interface:
Command-line interface for configuring the Dell M8024-k switch is as follow:
console#config
console(config)#port-aggregator group 1
Page | 12
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Web Interface:
Follow the steps below:
Select Switching > Port Aggregator > Port Configuration.
Add Group 2 ports:
o Change the group ID of half of the internal ports, i.e Te1/0/9-16 to group 2, while leaving the
first half of the ports in group 1 (Figure 9).
Figure 9. Web Interface for the Dell M8024-k Switch for Scenario 4.
o Change the group ID of the external ports you want to use, i.e. Te1/0/19-20 to group 2
(Figure 10).
Page | 13
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Figure 10. Web Interface for the Dell M8024-k Switch for Scenario 4.
Page | 14
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Figure 11. Web Interface for the Dell M8024-k Switch for Scenario 4.
o Verify the group ID for the first half of the external ports you want to use, i.e. Te1/0/17-18,
remain in group 1 (Figure 12).
Page | 15
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Figure 12. Web Interface for Dell M8024-k Switch for Scenario 4.
Click Apply
Nexus5020# configure
Enter configuration commands, one per line. End with CNTL/Z.
Nexus5020(config)# feature lacp
Nexus5020(config)# interface ethernet 1/1-2
Nexus5020(config-if-range)# channel-group 1 mode active
Nexus5020(config-if-range)# interface ethernet 1/3-4
Nexus5020(config-if-range)# channel-group 2 mode active
Nexus5020(config-if-range)# end
Page | 16
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
This scenario will demonstrate an overview of adding VLANs in a multi-AG configuration, which
combine the advantages of virtual network administration with physical network separation.
LAG 1
Cisco Nexus 5020
1 5 9 13 17 21 25 29 33 37
Cisco Nexus
SLOT2
PS1
2 6 10 14 18 22 26 30 34 38
5020
STAT
`
3 7 11 15 19 23 27 31 35 39
LAG 2
L1 MGMT 0
PS2
SLOT3
L2 MGMT 1 CONSOLE 200-240v-6A
4 8 12 16 20 24 28 32 36 40 50~60Hz
2 4 CMC1
1
KVM
2
CMC2
iKVM
CMC
CMC
1 3
4 5 6
7 8 9
Gb 1 Gb 2 Gb 1 Gb 2
1 2 3 4 5 6
A1 B1 C1 C2 B2 A2
2 1
19
18
4 3
17
CONSOLE
VLAN 105
VLAN 102
Command-Line Interface:
Command-line interface for configuring the Dell M8024-k switch is as follow:
console#config
console(config)#port-aggregator group 1
console(config-portAggr-group-1)#no add interface Tengigabitethernet 1/0/9-16
console(config-portAggr-group-1)#no add interface Tengigabitethernet 1/0/19-20
console(config-portAggr-group-1)#interface Tengigabitethernet 1/0/1
console(config-portAggr-if-Te1/0/1)#switchport general allowed vlan add 101-103
console(config-portAggr-if-Te1/0/1)#exit
Page | 17
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
console(config-portAggr-group-1)#exit
console(config)#port-aggregator group 2
console(config-portAggr-group-2)#add interface Tengigabitethernet 1/0/9-16
console(config-portAggr-group-2)#add interface Tengigabitethernet 1/0/19-20
console(config-portAggr-group-2)#interface Tengigabitethernet 1/0/9
console(config-portAggr-if-Te1/0/9)#switchport general allowed vlan add 104-106
console(config-portAggr-if-Te1/0/9)#exit
console(config-portAggr-group-2)#exit
Web Interface:
Follow the steps below:
Figure 14. Web Interface for the Dell M8024-k Switch for Scenario 5.
Page | 18
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
o Change the group ID of the external ports you want to use to connect to the second Cisco
Nexus, i.e. Te1/0/19-20, to group 2 (Figure 15).
Figure 15. Web Interface for Dell M8024-k Switch for Scenario 5.
Page | 19
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Figure 16. Web Interface for Dell M8024-k Switch for Scenario 5.
o Verify the group ID of the remaining external ports, i.e. Te1/0/17-18, remains in group 1
(the default) (Figure 17).
Page | 20
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Figure 17. Web Interface for Dell M8024-k Switch for Scenario 5.
Click Apply
Follow these next steps to assign internal port VLANs to the two groups.
Page | 21
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Figure 18. Web Interface for Dell M8024-k Switch for Scenario 5.
Click Apply.
Change the Group Id to 2.
Select a port from group 2 using the Internal-Port drop-down menu, i.e. Te1/0/9.
In the Tagged-VLANs menu, select the VLANs, i.e. 104-106, for this port (Figure 19).
Page | 22
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Figure 19. Web Interface for Dell M8024-k Switch for Scenario 5.
Click Apply.
Page | 23
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Nexus5020(config-if-range)# end
Login to the second Nexus and enter the following commands to configure trunking and
multiple VLANs on a port-channel.
Page | 24
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
This section provides an overview of setting up a straight-through topology with LAG failover. Simple
Switch Mode LAG failover allows Dell switches to automatically change from the primary to the
backup LAG in the event of a port failure, reducing potential downtime.
Cisco Nexus
SLOT2
PS1
2 6 10 14 18 22 26 30 34 38
5020
STAT
`
3 7 11 15 19 23 27 31 35 39
L1 MGMT 0
PS2
SLOT3
L2 MGMT 1 CONSOLE 200-240v-6A
4 8 12 16 20 24 28 32 36 40 50~60Hz
Primary LAG
2 4 CMC1
1
KVM
2
CMC2
iKVM
CMC
CMC
1 3
4 5 6
Backup LAG
7 8 9
Gb 1 Gb 2 Gb 1 Gb 2
1 2 3 4 5 6
A1 B1 C1 C2 B2 A2
2 1
19
18
4 3
17
CONSOLE
Command-Line Interface:
Command-line interface for configuring the Dell M8024-k switch is as follow:
console(config)#port-aggregator group 1
console(config-portAggr-group-1)#no add interface Tengigabitethernet 1/0/19-20
console(config-portAggr-group-1)#add interface Tengigabitethernet 1/0/19-20 secondary
console(config-portAggr-group-1)#end
Make sure to add two external 10Gig ports as a Secondary (backup) to group 1. The
Primary LAG is created automatically using Simple Switch Mode. Since it automatically
Page | 25
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
puts all external ports into the Primary LAG, you will need to remove two ports from
Primary and make them Secondary.
Web Interface:
Follow the steps below:
Select Switching > Port Aggregator > Port Configuration
In the Port Configuration screen, verify the Lag Role fields for Te1/0/17 and Te1/0/18 are set to
Primary.
Change the Lag Role of ports Te1/0/19 and Te1/0/20 to Secondary (Figure 21).
Figure 21. Web Interface for Dell M6348 Switch for Scenario 6.
Click Apply.
Nexus5020# configure
Enter configuration commands, one per line. End with CNTL/Z.
Nexus5020(config)# feature lacp
Page | 26
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
Page | 27
Deployment of Dell M8024-k Blade Switch in Simple Mode with Cisco Nexus 5k Switch
About Dell
Dell (NASDAQ: DELL) is a leading technology provider to commercial and public enterprises around
the world.
Page | 28