Application Guide: Ibm System Networking Rackswitch G8124/G8124-E
Application Guide: Ibm System Networking Rackswitch G8124/G8124-E
Application Guide
For IBM Networking OS™ 7.11
Note: Before using this information and the product it supports, read the general information in the Safety information and
Environmental Notices and User Guide documents on the IBM Documentation CD and the Warranty Information document that comes
with the product.
Chapter 7. VLANs . . . . . . . . . . . . . . . . . . . . . . . . 95
VLANs Overview. . . . . . . . . . . . . . . . . . . . . . . . . 96
VLANs and Port VLAN ID Numbers . . . . . . . . . . . . . . . . . 96
VLAN Numbers . . . . . . . . . . . . . . . . . . . . . . . 96
PVID/Native VLAN Numbers . . . . . . . . . . . . . . . . . . 97
VLAN Tagging/Trunk Mode . . . . . . . . . . . . . . . . . . . . 98
VLAN Topologies and Design Considerations . . . . . . . . . . . . . 102
Multiple VLANs with Tagging/Trunk Mode Adapters . . . . . . . . . 102
VLAN Configuration Example . . . . . . . . . . . . . . . . . . 104
Private VLANs . . . . . . . . . . . . . . . . . . . . . . . . . 105
Private VLAN Ports . . . . . . . . . . . . . . . . . . . . . . 105
Configuration Guidelines . . . . . . . . . . . . . . . . . . . . 106
Configuration Example . . . . . . . . . . . . . . . . . . . . . 106
This material is intended to help those new to N/OS products with the basics of
switch management. This part includes the following chapters:
• Chapter 1, “Switch Administration,” describes how to access the G8124 to
configure the switch and view switch information and statistics. This chapter
discusses a variety of manual administration interfaces, including local
management via the switch console, and remote administration via Telnet, a web
browser, or via SNMP.
• Chapter 2, “Initial Setup,” describes how to use the built-in Setup utility to perform
first-time configuration of the switch.
• Chapter 3, “Switch Software Management,” describes how to update the N/OS
software operating on the switch.
Part 5: IP Routing
• Chapter 17, “Basic IP Routing,” describes how to configure the G8124 for IP
routing using IP subnets, BOOTP, and DHCP Relay.
• Chapter 18, “Routed Ports describes how to configure a switch port to forward
Layer 3 traffic.
• Chapter 19, “Internet Protocol Version 6,” describes how to configure the G8124
for IPv6 host management.
• Chapter 20, “IPsec with IPv6,” describes how to configure Internet Protocol
Security (IPsec) for securing IP communications by authenticating and encrypting
IP packets, with emphasis on Internet Key Exchange version 2, and
authentication/confidentiality for OSPFv3.
• Chapter 21, “Routing Information Protocol,” describes how the N/OS software
implements standard Routing Information Protocol (RIP) for exchanging TCP/IP
route information with other routers.
• Chapter 22, “Internet Group Management Protocol,” describes how the N/OS
software implements IGMP Snooping or IGMP Relay to conserve bandwidth in a
multicast-switching environment.
• Chapter 23, “Multicast Listener Discovery,” describes how Multicast Listener
Discovery (MLD) is used with IPv6 to support host users requests for multicast
data for a multicast group.
• Chapter 24, “Border Gateway Protocol,” describes Border Gateway Protocol
(BGP) concepts and features supported in N/OS.
Part 8: Monitoring
• Chapter 33, “Remote Monitoring,” describes how to configure the RMON agent on
the switch, so that the switch can exchange network monitoring data.
• Chapter 34, “sFlow, described how to use the embedded sFlow agent for
sampling network traffic and providing continuous monitoring information to a
central sFlow analyzer.
• Chapter 35, “Port Mirroring,” discusses tools how copy selected port traffic to a
monitor port for network analysis.
Part 9: Appendices
• Appendix A, “Glossary,” describes common terms and concepts used throughout
this guide.
Additional References
Additional information about installing and configuring the G8124 is available in the
following guides:
• RackSwitch G8124 Installation Guide
• IBM Networking OS 7.11 ISCLI Reference Guide
• IBM Networking OS 7.11 BBI Quick Guide
ABC123 This type is used for names of View the readme.txt file.
commands, files, and directories
used within the text.
AaBbCc123 This block type depicts menus, Click the Save button.
buttons, and other controls that
appear in Web browsers and other
graphical interfaces.
The warranty card received with your product provides details for contacting a
customer support representative. If you are unable to locate this information, please
contact your reseller. Before you call, prepare the following information:
• Serial number of the switch unit
• Software release version number
• Brief description of the problem and the steps you have already taken
• Technical support dump information (# show tech-support)
This chapter discusses the various methods that can be used to administer the
switch.
Administration Interfaces
IBM N/OS provides a variety of user-interfaces for administration. These interfaces
vary in character and in the methods used to access them: some are text-based,
and some are graphical; some are available by default, and some require
configuration; some can be accessed by local connection to the switch, and others
are accessed remotely using various client applications. For example,
administration can be performed using any of the following:
• A built-in, text-based command-line interface and menu system for access via
serial-port connection or an optional Telnet or SSH session
• The built-in Browser-Based Interface (BBI) available using a standard
web-browser
• SNMP support for access through network management software such as IBM
Director or HP OpenView
In all cases, administration requires that the switch hardware is properly installed
and turned on. (see the RackSwitch G8124 Installation Guide).
You can establish a connection to the ISCLI in any of the following ways:
• Serial connection via the serial port on the G8124 (this option is always avail-
able)
• Telnet connection over the network
• SSH connection over the network
Browser-Based Interface
The Browser-based Interface (BBI) provides access to the common configuration,
management and operation features of the G8124 through your Web browser.
Remote access using the network requires the accessing terminal to have a valid,
routable connection to the switch interface. The client IP address may be configured
manually, or an IPv4 address can be provided automatically through the switch
using a service such as DHCP or BOOTP relay (see “BOOTP/DHCP Client IP
Address Services” on page 32), or an IPv6 address can be obtained using IPv6
stateless address configuration.
Note: Throughout this manual, IP address is used in places where either an IPv4
or IPv6 address is allowed. IPv4 addresses are entered in dotted-decimal
notation (for example, 10.10.10.1), while IPv6 addresses are entered in
hexadecimal notation (for example, 2001:db8:85a3::8a2e:370:7334). In
places where only one type of address is allowed, IPv4 address or IPv6
address is specified.
RS G8124> enable
RS G8124# configure terminal
• IF 127 supports IPv4 management port A and uses IPv4 default gateway 3.
• IF 128 supports IPv4 management port B and uses IPv4 default gateway 4.
– Using IPv6:
• IF 125 supports IPv6 management port A and uses IPv6 default gateway 3.
• IF 126 supports IPv6 management port B and uses IPv6 default gateway 4.
– If using IPv6, IPv6 gateway 3 is required for IF 125, and IPv4 gateway 4 is
required for IF 126.
Once you configure a management IP address for your switch, you can connect to a
management port and use the Telnet program from an external management station
to access and control the switch. The management port provides out-of-band
management.
RS G8124> enable
RS G8124# configure terminal
RS G8124(config)# interface ip <IP interface number>
Note: Interface 125 through 128 are reserved for out-of-band management (see
“Using the Switch Management Ports” on page 24).
3. Configure the management IP interface/mask.
– Using IPv4:
– Using IPv6:
RS G8124(config-ip-if)# vlan 1
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
– If using IPv6:
Note: IPv4 gateway 1 and 2, and IPv6 gateway 1, are used for in-band data
networks. IPv4 and IPv6 gateways 3 and 4 are reserved for out-of-band
management ports (see “Using the Switch Management Ports” on page 24).
Once you configure the IP address and have a network connection, you can use the
Telnet program from an external management station to access and control the
switch. Once the default gateway is enabled, the management station and your
switch do not need to be on the same IP subnet.
Using Telnet
A Telnet connection offers the convenience of accessing the switch from a
workstation connected to the network. Telnet access provides the same options for
user and administrator access as those available through the console port.
Once the switch is configured with an IP address and gateway, you can use Telnet
to access switch administration from any workstation connected to the management
network.
To establish a Telnet connection with the switch, run the Telnet program on your
workstation and issue the following Telnet command:
You will then be prompted to enter a password as explained “Switch Login Levels”
on page 34.
Two attempts are allowed to log in to the switch. After the second unsuccessful
attempt, the Telnet client is disconnected via TCP session closure.
The switch can do only one session of key/cipher generation at a time. Thus, a
SSH/SCP client will not be able to login if the switch is doing key generation at that
time. Similarly, the system will fail to do the key generation if a SSH/SCP client is
logging in at that time.
IBM Networking OS implements the SSH version 2.0 standard and is confirmed to
work with SSH version 2.0-compliant clients such as the following:
• OpenSSH_5.4p1 for Linux
• Secure CRT Version 5.0.2 (build 1021)
• Putty SSH release 0.60
By default, the SSH feature is disabled. Once the IP parameters are configured and
the SSH service is enabled, you can access the command line interface using an
SSH connection.
To establish an SSH connection with the switch, run the SSH program on your
workstation by issuing the SSH command, followed by the switch IPv4 or IPv6
address:
You will then be prompted to enter a password as explained “Switch Login Levels”
on page 34.
SSH can also be used for switch authentication based on asymmetric cryptography.
Public encryption keys can be uploaded on the switch and used to authenticate
incoming login attempts based on the clients’ private encryption key pairs. After a
predefined number of failed public key login attempts, the switch reverts to
password-based authentication.
2. Import the public key file using SFTP or TFTP for the admin user account::
Note: When prompted to input a username, a valid user account name must be
entered. If no username is entered, the key is stored on the switch, and can be
assigned to a user account later.
Note: A user account can have up to 100 public keys set up on the switch.
3. Configure a maximum number of 3 failed public key authentication attempts
before the system reverts to password-based authentication:
Once the public key is configured on the switch, the client can use SSH to login from
a system where the private key pair is set up:
You can also access the BBI directly from an open Web browser window. Enter the
URL using the IP address of the switch interface (for example, http://<IPv4 or
IPv6 address>).
To disable or re-enable HTTP access to the switch BBI, use the following
commands:
The default HTTP web server port to access the BBI is port 80. However, you can
change the default Web server port with the following command:
To access the BBI from a workstation, open a Web browser window and type in the
URL using the IP address of the switch interface (for example, http://<IPv4 or
IPv6 address>).
The BBI can also be accessed via a secure HTTPS connection over management
and data ports.
1. Enable HTTPS.
By default, BBI access via HTTPS is disabled on the switch. To enable BBI
Access via HTTPS, use the following command:
When a client (such as a web browser) connects to the switch, the client is asked to
accept the certificate and verify that the fields match what is expected. Once BBI
access is granted to the client, the BBI can be used as described in the IBM
Networking OS 7.11 BBI Quick Guide.
Context buttons—These buttons allow you to select the type of action you wish to
perform. The Configuration button provides access to the configuration elements for
the entire switch. The Statistics button provides access to the switch statistics and
state information. The Dashboard button allows you to display the settings and
operating status of a variety of switch features.
For information on using the BBI, refer to the IBM Networking OS 7.11 BBI Quick Guide.
To access the SNMP agent on the G8124, the read and write community strings on
the SNMP manager must be configured to match those on the switch. The default
read community string on the switch is public and the default write community
string is private.
The read and write community strings on the switch can be configured using the
following commands:
The SNMP manager must be able to reach any one of the IP interfaces on the
switch.
For the SNMP manager to receive the SNMPv1 traps sent out by the SNMP agent
on the switch, configure the trap host on the switch with the following commands:
To restrict SNMP access to specific IPv4 subnets, use the following commands:
Note: Subnets allowed for SNMP read-only access must not overlap with subnets
allowed for SNMP read-write access.
For more information on SNMP usage and configuration, see “Simple Network
Management Protocol” on page 409.
The G8124 can function as a relay agent for Bootstrap Protocol (BOOTP) or DHCP.
This allows clients to be assigned an IPv4 address for a finite lease period,
reassigning freed addresses later to other clients.
Acting as a relay agent, the switch can forward a client’s IPv4 address request to up
to five BOOTP/DHCP servers. In addition to the five global BOOTP/DHCP servers,
up to five domain-specific BOOTP/DHCP servers can be configured for each of up
to 10 VLANs.
DHCP is described in RFC 2131, and the DHCP relay agent supported on the
G8124 is described in RFC 1542. DHCP uses UDP as its transport protocol. The
client sends messages to the server on port 67 and the server sends messages to
the client on port 68.
BOOTP and DHCP relay are collectively configured using the BOOTP commands
and menus on the G8124.
Generally, it is best to configure BOOTP for the switch IP interface that is closest to
the client, so that the BOOTP server knows from which IPv4 subnet the newly
allocated IPv4 address will come.
DHCP Option 82
DHCP Option 82 provides a mechanism for generating IP addresses based on the
client device’s location in the network. When you enable the DHCP relay agent
option on the switch, it inserts the relay agent information option 82 in the packet,
and sends a unicast BOOTP request packet to the DHCP server. The DHCP server
uses the option 82 field to assign an IP address, and sends the packet, with the
original option 82 field included, back to the relay agent. DHCP relay agent strips off
the option 82 field in the packet and sends the packet to the DHCP client.
Configuration of this feature is optional. The feature helps resolve several issues
where untrusted hosts access the network. See RFC 3046 for details.
An untrusted interface is a port that is configured to receive packets from outside the
network or firewall. A trusted interface receives packets only from within the
network. By default, all DHCP ports are untrusted.
The DHCP snooping binding table contains the MAC address, IP address, lease
time, binding type, VLAN number, and port number that correspond to the local
untrusted interface on the switch; it does not contain information regarding hosts
interconnected with a trusted interface.
By default, DHCP snooping is disabled on all VLANs. You can enable DHCP
snooping on one or more VLANs. You must enable DHCP snooping globally. To
enable this feature, enter the commands below:
Note: Access to each user level (except admin account) can be disabled by setting
the password to an empty value. To disable admin account, use no access
user administrator-enable command. Admin account can be disabled
only if there is at least one user account enabled and configured with
administrator privilege.
Idle Disconnect
By default, the switch will disconnect your Telnet session after 10 minutes of
inactivity. This function is controlled by the idle timeout parameter, which can be set
from 0 to 60 minutes, where 0 means the session will never timeout.
When in boot strict mode, the switch uses Secure Sockets Layer (SSL)/Transport
Layer Security (TLS) 1.2 protocols to ensure confidentiality of the data to and from
the switch.
The following cipher suites are acceptable (listed in the order of preference) when
the RackSwitch G8124 is in strict mode:
Table 5. List of Acceptable Cipher Suites in Strict Mode
Cipher ID Key Authentication Encryption MAC Cipher Name
Exchange
0xC027 ECDHE RSA AES_128_CBC SHA256 TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256
0xC013 ECDHE RSA AES_128_CBC SHA1 TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA
0xC012 ECDHE RSA 3DES SHA1 SSL_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA
0x0033 DHE RSA AES-128_CBC SHA1 TLS_DHE_RSA_WITH_AES_128_CBC_SHA
0x0067 DHE RSA AES_128_CBC SHA256 TLS_DHE_RSA_WITH_AES_128_CBC_SHA256
0x0016 DHE RSA 3DES SHA1 SSL_DHE_RSA_WITH_3DES_EDE_CBC_SHA
0x002F RSA RSA AES_128_CBC SHA1 TLS_RSA_WITH_AES_128_CBC_SHA
0x003C RSA RSA AES_128_CBC SHA256 TLS_RSA_WITH_AES_128_CBC_SHA256
0x000A RSA RSA 3DES SHA1 SSL_RSA_WITH_3DES_EDE_CBC_SHA
When strict mode is enabled, you will see the following message:
Warning, security strict mode limits the cryptographic algorithms used by secure
protocols on this switch. Please see the documentation for full details, and verify
that peer devices support acceptable algorithms before enabling this mode. The mode
change will take effect after reloading the switch and the configuration will be
wiped during the reload. System will enter security strict mode with default factory
configuration at next boot up.
Do you want SNMPV3 support old default users in strict mode (y/n)?
Warning, disabling security strict mode. The mode change will take effect after
reloading the switch.
You must reboot the switch for the boot strict mode enable/disable to take effect.
Limitations
In IBM N/OS 7.11, consider the following limitation/restrictions if you need to operate
the switch in boot strict mode:
• Power ITEs and High-Availability features do not comply with NIST SP 800-131A
specification.
• The G8124 will not discover Platform agents/Common agents that are not in
strict mode.
• Web browsers that do not use TLS 1.2 cannot be used.
• Limited functions of the switch managing Windows will be available.
Setup can be activated manually from the command line interface any time after
login.
Enter Password:
RackSwitch G8124
18:44:05 Wed Jan 3, 2009
Note: If the default admin login is unsuccessful, or if the administrator Main Menu
appears instead, the system configuration has probably been changed from
the factory default settings. If desired, return the switch to its factory default
configuration.
3. Enter y to begin the initial configuration of the switch, or n to bypass the Setup
facility.
To facilitate switch boot up, the in-band and out-of-band management interfaces are
configured with factory default IP addresses. These are as follows:
• VLAN 1/ Interface 1: 192.168.49.50/24
• Out-of-band Management Port A: 192.168.50.50/24
• Out-of-band Management Port B: 192.168.51.50/24
If you add interface 1 to another VLAN and do not configure any IP address, the
factory default IP address will be automatically assigned to the interface.
We recommend that you disable the factory default IP address configuration after
the switch boot up and configuration is complete. Use the following command:
Restarting Setup
You can restart the Setup utility manually at any time by entering the following
command at the administrator prompt:
RS G8124(config)# setup
System Date:
Enter year [2009]:
Enter the four-digits that represent the year. To keep the current year, press
<Enter>.
3. Enter the month of the current system date at the prompt:
System Date:
Enter month [1]:
Enter the month as a number from 1 to 12. To keep the current month, press
<Enter>.
Enter the date as a number from 1 to 31. To keep the current day, press <Enter>.
The system displays the date and time settings:
System Time:
Enter hour in 24-hour format [18]:
Enter the hour as a number from 00 to 23. To keep the current hour, press
<Enter>.
6. Enter the minute of the current time at the prompt:
Enter the minute as a number from 00 to 59. To keep the current minute, press
<Enter>.
7. Enter the seconds of the current time at the prompt:
Enter the seconds as a number from 00 to 59. To keep the current second, press
<Enter>. The system then displays the date and time settings:
Spanning Tree:
Current Spanning Tree Group 1 setting: ON
Turn Spanning Tree Group 1 OFF? [y/n]
Enter y to turn off Spanning Tree, or enter n to leave Spanning Tree on.
Port Config:
Will you configure VLANs and VLAN Tagging/Trunk-Mode for ports? [y/n]
If you wish to change settings for VLANs, enter y, or enter n to skip VLAN
configuration.
Note: The sample screens that appear in this document might differ slightly from
the screens displayed by your system. Screen content varies based on the
firmware versions and options that are installed.
2. Select the port to configure, or skip port configuration at the prompt:
If you wish to change settings for individual ports, enter the number of the port
you wish to configure. To skip port configuration, press <Enter> without
specifying any port and go to “Setup Part 3: VLANs” on page 46.
3. Configure Gigabit Ethernet port flow parameters.
The system prompts:
Enter rx to enable receive flow control, tx for transmit flow control, both to
enable both, or none to turn flow control off for the port. To keep the current
setting, press <Enter>.
4. Configure Gigabit Ethernet port autonegotiation mode.
If you selected a port that has a Gigabit Ethernet connector, the system prompts:
Port VLAN tagging/trunk mode config (tagged/trunk mode port can be a member of
multiple VLANs)
Current VLAN tagging/trunk mode support: disabled
Enter new VLAN tagging/trunk mode support [d/e]:
Enter d to disable VLAN trunk mode/tagging for the port or enter e to enable
VLAN tagging for the port. To keep the current setting, press <Enter>.
When you are through configuring ports, press <Enter> without specifying any port.
Otherwise, repeat the steps in this section.
VLAN Config:
Enter VLAN number from 2 to 4094, NULL at end:
If you wish to change settings for individual VLANs, enter the number of the
VLAN you wish to configure. To skip VLAN configuration, press <Enter> without
typing a VLAN number and go to “Setup Part 4: IP Configuration” on page 47.
2. Enter the new VLAN name at the prompt:
Entering a new VLAN name is optional. To use the pending new VLAN name,
press <Enter>.
3. Enter the VLAN port numbers:
Enter each port, by port number or port alias, and confirm placement of the port
into this VLAN. When you are finished adding ports to this VLAN, press <Enter>
without specifying any port.
4. Configure Spanning Tree Group membership for the VLAN:
VLAN Config:
Enter VLAN number from 2 to 4094, NULL at end:
Repeat the steps in this section until all VLANs have been configured. When all
VLANs have been configured, press <Enter> without specifying any VLAN.
Although the switch supports both IPv4 and IPv6 networks, the Setup utility permits
only IPv4 configuration. For IPv6 configuration, see “Internet Protocol Version 6” on
page 263|.
IP Interfaces
IP interfaces are used for defining the networks to which the switch belongs.
IP Config:
IP interfaces:
Enter interface number: (1-128)
To keep the current setting, press <Enter>.If configuring VLANs, specify a VLAN
for the interface.
This prompt appears if you selected to configure VLANs back in Part 1:
Current VLAN: 1
Enter new VLAN [1-4094]:
Enter the number for the VLAN to which the interface belongs, or press <Enter>
without specifying a VLAN number to accept the current setting.
Repeat the steps in this section until all IP interfaces have been configured. When
all interfaces have been configured, press <Enter> without specifying any interface
number.
Default Gateways
To set up a default gateway:
1. At the prompt, select an IP default gateway for configuration, or skip default
gateway configuration:
IP default gateways:
Enter default gateway number: (1-4)
Enter the number for the IP default gateway to be configured. To skip default
gateway configuration, press <Enter> without typing a gateway number and go
to “IP Routing” on page 48.
2. At the prompt, enter the IPv4 address for the selected default gateway:
Enter the IPv4 address in dotted decimal notation, or press <Enter> without
specifying an address to accept the current setting.
3. At the prompt, enter y to enable the default gateway, or n to leave it disabled:
Repeat the steps in this section until all default gateways have been configured.
When all default gateways have been configured, press <Enter> without specifying
any number.
IP Routing
When IP interfaces are configured for the various IP subnets attached to your
switch, IP routing between them can be performed entirely within the switch. This
eliminates the need to send inter-subnet communication to an external router
device. Routing on more complex networks, where subnets may not have a direct
presence on the G8124, can be accomplished through configuring static routes or
by letting the switch learn routes dynamically.
Enter y to review the changes made during this session of the Setup utility. Enter
n to continue without reviewing the changes. We recommend that you review the
changes.
3. Next, decide whether to apply the changes at the prompt:
Enter y to save the changes to flash. Enter n to continue without saving the
changes. Changes are normally saved at this point.
5. If you do not apply or save the changes, the system prompts whether to abort
them:
Telnet is enabled by default. To change the setting, use the following command:
Loopback Interfaces
A loopback interface provides an IP address, but is not otherwise associated with a
physical port or network entity. Essentially, it is a virtual interface that is perceived as
being “always available” for higher-layer protocols to use and advertise to the
network, regardless of other connectivity.
In IBM N/OS 7.11, loopback interfaces have been expanded for use with routing
protocols such as OSPF, PIM, and BGP. Loopback interfaces can also be specified
as the source IP address for syslog, SNMP, RADIUS, TACACS+, NTP, and router
IDs.
Loopback interfaces must be configured before they can be used in other features.
Up to five loopback interfaces are currently supported. They can be configured
using the following commands:
• SNMP traps
RS G8124(config)# snmp-server trap-source loopback <1-5>
• RADIUS
RS G8124(config)# ip radius source-interface loopback <1-5>
• NTP
RS G8124(config)# ntp source loopback <1-5>
http://www.ibm.com/support/
To determine the software version currently used on the switch, use the following
switch command:
The typical upgrade process for the software image consists of the following steps:
• Load a new software image and boot image onto an FTP, SFTP or TFTP server
on your network.
• Transfer the new images to your switch.
• Specify the new software image as the one which will be loaded into switch
memory the next time a switch reset occurs.
• Reset the switch.
For instructions on the typical upgrade process using the IBM N/OS ISCLI, or BBI,
see “Loading New Software to Your Switch” on page 54.
CAUTION:
Although the typical upgrade process is all that is necessary in most cases,
upgrading from (or reverting to) some versions of IBM Networking OS
requires special steps prior to or after the software installation process.
Please be sure to follow all applicable instructions in the release notes
document for the specific software release to ensure that your switch
continues to operate as expected after installing new software.
For example, if your active image is currently loaded into image1, you would
probably load the new image software into image2. This lets you test the new
software and reload the original active image (stored in image1), if needed.
CAUTION:
When you upgrade the switch software image, always load the new boot
image and the new software image before you reset the switch. If you do not
load a new boot image, your switch might not boot properly (To recover, see
“Recovering from a Failed Upgrade” on page 56).
To load a new software image to your switch, you will need the following:
• The image and boot software loaded on an FTP, SFTP or TFTP server on your
network.
Note: Be sure to download both the new boot file and the new image file.
When the software requirements are met, use one of the following procedures to
download the new software to your switch. You can use the ISCLI, or the BBI to
download and activate new software.
The exact form of the name will vary by server. However, the file location is
normally relative to the FTP, SFTP or TFTP directory (for example, tftpboot).
4. If required by the FTP, SFTP or TFTP server, enter the appropriate username
and password.
5. The switch will prompt you to confirm your request.
Once confirmed, the software will begin loading into the switch.
The system will then verify which image is set to be loaded at the next reset:
The system prompts you to confirm your request. Once confirmed, the switch will
reboot to use the new software.
You can interrupt the boot process and enter the Boot Management menu from the
serial console port. When the system displays Memory Test, press <Shift B>. The
Boot Management menu appears.
The Boot Management menu allows you to perform the following actions:
• To change the booting image, press 1 and follow the screen prompts.
• To change the configuration block, press 2, and follow the screen prompts.
• To perform an Xmodem download, press 3 and follow the screen prompts.
• To exit the Boot Management menu, press 4. The booting process continues.
5. Press <Enter> to set the system into download accept mode. When the
readiness meter displays (a series of “C” characters), start XModem on your
terminal emulator.
Un-Protected 10 sectors
Writing to Flash.............done
Protected 10 sectors
Un-Protected 44 sectors
Writing to Flash...............................................done
Protected 44 sectors
Un-Protected 8 sectors
Writing to Flash...........done
Protected 8 sectors
7. When you see the following message, change the Serial Port characteristics to
9600 bps:
8. Press the Escape key (<Esc>) to re-display the Boot Management menu.
9. Select 3 to start a new XModem Download. When you see the following
message, change the Serial Port characteristics to 115200 bps:
12. Select the image number to load the new image (1 or 2). It is recommended
that you select 1. A message similar to the following is displayed:
Un-Protected 27 sectors
Writing to Flash..............................done
Protected 27 sectors
13. When you see the following message, change the Serial Port characteristics to
9600 bps:
14. Press the Escape key (<Esc>) to re-display the Boot Management menu.
15. Select 4 to exit and boot the new image.
SSH is a protocol that enables remote administrators to log securely into the G8124
over a network to execute management commands.
SCP is typically used to copy files securely from one machine to another. SCP uses
SSH for encryption of data on the network. On a G8124, SCP is used to download
and upload the switch configuration via secure channels.
Although SSH and SCP are disabled by default, enabling and using these features
provides the following benefits:
• Identifying the administrator using Name/Password
• Authentication of remote administrators
• Authorization of remote administrators
• Determining the permitted actions and customizing service for individual admin-
istrators
• Encryption of management messages
• Encrypting messages between the remote administrator and switch
• Secure copy support
IBM Networking OS implements the SSH version 2.0 standard and is confirmed to
work with SSH version 2.0-compliant clients such as the following:
• OpenSSH_5.4p1 for Linux
• Secure CRT Version 5.0.2 (build 1021)
• Putty SSH release 0.60
Begin a Telnet session from the console port and enter the following command:
Enter the following command from the switch CLI to enable the SCP
putcfg_apply and putcfg_apply_save commands:
Syntax:
Note: The -4 option (the default) specifies that an IPv4 switch address will be
used. The -6 option specifies IPv6.
Example:
Syntax:
Example:
Syntax:
Example:
When loading a configuration file to the switch, the apply and save commands are
still required for the configuration commands to take effect. The apply and save
commands may be entered manually on the switch, or by using SCP commands.
Syntax:
Example:
• The CLI diff command is automatically executed at the end of putcfg to notify
the remote client of the difference between the new and the current
configurations.
• putcfg_apply runs the apply command after the putcfg is done.
• putcfg_apply_save saves the new configuration to the flash after
putcfg_apply is done.
• The putcfg_apply and putcfg_apply_save commands are provided
because extra apply and save commands are usually required after a putcfg;
however, an SCP session is not in an interactive mode.
To Copy the Switch Image and Boot Files to the SCP Host
Syntax:
Example:
Syntax:
Example:
To configure RSA host key, first connect to the G8124 through the console port
(commands are not available via external Telnet connection), and enter the
following command to generate it manually.
When the switch reboots, it will retrieve the host key from the FLASH memory.
Note: The switch will perform only one session of key/cipher generation at a time.
Thus, an SSH/SCP client will not be able to log in if the switch is performing
key generation at that time. Also, key generation will fail if an SSH/SCP client
is logging in at that time.
For example, an administrator can assign a user, who can then log into the switch
and perform operational commands (effective only until the next switch reboot).
Strong Passwords
The administrator can require use of Strong Passwords for users to access the
G8124. Strong Passwords enhance security because they make password
guessing more difficult.
When strong password is enabled, users can still access the switch using the old
password but will be advised to change to a strong password at log-in.
The administrator can choose the number of days allowed before each password
expires. When a strong password expires, the user is allowed to log in one last time
(last time) to change the password. A warning provides advance notice for users to
change the password.
Up to 20 user IDs can be configured. Use the following commands to define any
user name and set the user password at the resulting prompts:
The end user is by default assigned to the user access level (also known as class of
service, or COS). COS for all user accounts have global access to all resources
except for User COS, which has access to view only resources that the user owns.
For more information, see Table 6 on page 71.
An end user account must be enabled before the switch recognizes and permits
login under the account. Once enabled, the switch requires any user to enter both
username and password.
Locking Accounts
To protect the switch from unauthorized access, the account lockout feature can be
enabled. By default, account lockout is disabled. To enable this feature, ensure the
strong password feature is enabled (See “Strong Passwords” on page 66). Then
use the following command:
RS G8124(config)# access user strong-password lockout
After multiple failed login attempts, the switch locks the user account if lockout has
been enabled on the switch.
Usernames:
user - Enabled - offline
oper - Disabled - offline
admin - Always Enabled - online 1 session
Note: You can use a configured loopback address as the source address so the
RADIUS server accepts requests only from the expected loopback address
block. Use the following command to specify the loopback interface:
RS G8124(config)# ip radius source-interface loopback <1-5>
2. Configure the RADIUS secret.
3. If desired, you may change the default UDP port number used to listen to
RADIUS.
The well-known port for RADIUS is 1812.
4. Configure the number retry attempts for contacting the RADIUS server, and the
timeout period.
The default G8124 setting for backdoor and secure backdoor access is disabled.
Backdoor and secure backdoor access is always enabled on the console port.
All user privileges, other than those assigned to the Administrator, have to be
defined in the RADIUS dictionary. RADIUS attribute 6 which is built into all RADIUS
servers defines the administrator. The file name of the dictionary is RADIUS
vendor-dependent. The following RADIUS attributes are defined for G8124 user
privileges levels:
Table 7. IBM N/OS-proprietary Attributes for RADIUS
Admin Vendor-supplied 6
Authorization
user 0
oper 3
admin 6
user 0-1
oper 6-8
admin 14 - 15
Accounting is the action of recording a user's activities on the device for the
purposes of billing and/or security. It follows the authentication and authorization
actions. If the authentication and authorization is not performed via TACACS+, there
are no TACACS+ accounting messages sent out.
You can use TACACS+ to record and track software login access, configuration
changes, and interactive commands.
The following examples illustrate the format of N/OS commands sent to the
TACACS+ server:
Note: You can use a configured loopback address as the source address so the
TACACS+ server accepts requests only from the expected loopback
address block. Use the following command to specify the loopback interface:
RS G8124(config)# ip tacacs source-interface loopback <1-5>
2. Configure the TACACS+ secret and second secret.
3. If desired, you may change the default TCP port number used to listen to
TACACS+.
The well-known port for TACACS+ is 49.
Each entry in the LDAP server is referenced by its Distinguished Name (DN). The
DN consists of the user-account name concatenated with the LDAP domain name.
If the user-account name is John, the following is an example DN:
uid=John,ou=people,dc=domain,dc=com
G8124 user groups and user accounts must reside within the same domain. On the
LDAP server, configure the domain to include G8124 user groups and user
accounts, as follows:
• User Accounts:
Use the uid attribute to define each individual user account. If a custom attribute
is used to define individual users, it must also be configured on the switch.
• User Groups:
Use the members attribute in the groupOfNames object class to create the user
groups. The first word of the common name for each user group must be equal
to the user group names defined in the G8124, as follows:
– admin
– oper
– user
3. You may change the default TCP port number used to listen to LDAP (optional).
The well-known port for LDAP is 389.
5. You may change the default LDAP attribute (uid) or add a custom attribute. For
instance, Microsoft’s Active Directory requires the cn attribute.
• IPv6 ACLs
Up to 128 ACLs are supported for networks that use IPv6 addressing. IPv6 ACLs
are configured using the following ISCLI command path:
1 icmp
2 igmp
6 tcp
17 udp
89 ospf
112 vrrp
Flag Value
URG 0x0020
ACK 0x0010
PSH 0x0008
RST 0x0004
SYN 0x0002
FIN 0x0001
When multiple ACLs are assigned to a port, higher-priority ACLs are considered
first, and their action takes precedence over lower-priority ACLs. ACL order of
precedence is discussed in the next section.
If multiple ACLs match the port traffic, only the action of the one with the lowest ACL
number is applied. The others are ignored.
Actions taken by an ACL are called In-Profile actions. You can configure additional
In-Profile and Out-of-Profile actions on a port. Data traffic can be metered, and
re-marked to ensure that the traffic flow provides certain levels of service in terms of
bandwidth for different types of network traffic.
Using meters, you set a Committed Rate in Kbps (in multiples of 64 Mbps). All traffic
within this Committed Rate is In-Profile. Additionally, you can set a Maximum Burst
Size that specifies an allowed data burst larger than the Committed Rate for a brief
period. These parameters define the In-Profile traffic.
Meters keep the sorted packets within certain parameters. You can configure a
meter on an ACL, and perform actions on metered traffic, such as packet
re-marking.
Re-Marking
Re-marking allows for the treatment of packets to be reset based on new network
specifications or desired levels of service. You can configure the ACL to re-mark a
packet as follows:
• Change the DSCP value of a packet, used to specify the service level that traffic
receives.
• Change the 802.1p priority of a packet.
The source port for the mirrored packets cannot be a portchannel, but may be a
member of a portchannel.
The destination port to which packets are mirrored must be a physical port.
The action (permit, drop, etc.) of the ACL or VMap must be configured before
assigning it to a port.
The ACL must be also assigned to it target ports as usual (see “Assigning
Individual ACLs to a Port” on page 82).
• For VMaps (see “VLAN Maps” on page 89):
You must enable statistics for each ACL that you wish to monitor:
Logged Information
When ACL logging is enabled on any particular ACL, the switch will collect
information about packets that match the ACL. The information collected depends
on the ACL type:
• For IP-based ACLs, information is collected regarding
– Source IP address
– Destination IP address
– TCP/UDP port number
– ACL action
– Number of packets logged
For example:
Sep 27 4:20:28 DUT3 NOTICE ACL-LOG: %IP ACCESS LOG: list
ACL-IP-12-IN denied tcp 1.1.1.1 (0) -> 200.0.1.2 (0), 150
packets.
• For MAC-based ACLs, information is collected regarding
– Source MAC address
– Source IP address
– Destination IP address
– TCP/UDP port number
– ACL action
– Number of packets logged
For example:
Sep 27 4:25:38 DUT3 NOTICE ACL-LOG: %MAC ACCESS LOG: list
ACL-MAC-12-IN permitted tcp 1.1.1.2 (0) (12,
00:ff:d7:66:74:62) -> 200.0.1.2 (0) (00:18:73:ee:a7:c6), 32
packets.
Log Interval
For each log-enabled ACL, the first packet that matches the ACL initiates an
immediate message in the system log. Beyond that, additional matches are subject
to the log interval. By default, the switch will buffer ACL log messages for a period of
300 seconds. At the end of that interval, all messages in the buffer are written to the
system log. The global interval value can be changed as follows:
In any given interval, packets that have identical log information are condensed into
a single message. However, the packet count shown in the ACL log message
represents only the logged messages, which due to rate-limiting, may be
significantly less than the number of packets actually matched by the ACL.
Also, the switch is limited to 64 different ACL log messages in any interval. Once the
threshold is reached, the oldest message will be discarded in favor of the new
message, and an overflow message will be added to the system log.
• ACL logging reserves packet queue 1 for internal use. Features that allow
remapping packet queues (such as QoS CPU rate limit) may not behave as
expected if other packet flows are reconfigured to use queue 1.
Use this configuration to block traffic to a specific host. All traffic that ingresses on
port 1 is denied if it is destined for the host at IP address 100.10.1.1
1. Configure an Access Control List.
ACL Example 2
Use this configuration to block traffic from a network destined for a specific host
address. All traffic that ingresses in port 2 with source IP from class 100.10.1.0/24
and destination IP 200.20.2.2 is denied.
1. Configure an Access Control List.
ACL Example 3
Use this configuration to block traffic from a specific IPv6 source address. All traffic
that ingresses in port 2 with source IP from class 2001:0:0:5:0:0:0:2/128 is denied.
1. Configure an Access Control List.
Use this configuration to deny all ARP packets that ingress a port.
1. Configure an Access Control List.
ACL Example 5
Use the following configuration to permit access to hosts with destination MAC
address that matches 11:05:00:10:00:00 FF:F5:FF:FF:FF:FF and deny access to all
other hosts.
1. Configure Access Control Lists.
The G8124 supports up to 127 VMaps when the switch is operating in the default
deployment mode (see “Deployment Profiles” on page 175). VMap menus and
commands are not available in the Routing deployment mode.
Individual VMap filters are configured in the same fashion as IPv4 ACLs, except that
VLANs cannot be specified as a filtering criteria (unnecessary, since the VMap are
assigned to a specific VLAN or associated with a VM group VLAN).
VMaps are configured using the following ISCLI configuration command path:
Once a VMap filter is created, it can be assigned or removed using the following
configuration commands:
• For regular VLAN, use config-vlan mode:
• For a VM group (see “VM Group Types” on page 194), use the global
configuration mode:
Note: Each VMap can be assigned to only one VLAN or VM group. However, each
VLAN or VM group may have multiple VMaps assigned to it.
VLAN Classification
Packets received on ports may belong to multiple VLANs or may be untagged.
VLAN classification using ACLs allows you to assign a new VLAN to such packets
that can be flooded to a monitor port. These packets, when sent out from the
monitor port, can be identified by their source ports.
The ingress and monitor ports must belong to the new VLAN. Tagging must be
enabled on these ports.
Note: When you assign a new VLAN to the ingress packets, the packets will be
forwarded based on the new VLAN.
Example
Consider the following example in which packets from ingress port 1 are assigned to
VLAN 100. Packets are flooded to monitor port 20.
1. Create a new VLAN. Add ingress and monitor ports to the VLAN:
2. Create an ACL to assign the new VLAN to packets received on ingress port:
Note: You can add filters, such as source IP address, to the ACL.
3. Enable tagging on ingress and monitor ports:
Note: When you apply VLAN classification, VMAP, and IPv4 ACL at the same time,
IPv4 ACL takes precedence over VMAP.
Note: When you apply VLAN classification, VMAP, and IPv6 ACL at the same time,
VMAP ACL takes precedence over IPv6 ACL.
Restrictions
VLAN classification is primarily useful for monitoring packets. When you enable this
feature, the switch considers only the new VLAN. The switch does not learn the
original VLAN. We recommend that you use this feature only if the switch does not
need to process regular switching and bidirectional traffic.
The G8124 provides filters that can limit the number of the following packet types
transmitted by switch ports:
• Broadcast packets
• Multicast packets
• Unknown unicast packets (destination lookup failure)
Unicast packets whose destination MAC address is not in the Forwarding Database
are unknown unicasts. When an unknown unicast is encountered, the switch
handles it like a broadcast packet and floods it to all other ports in the VLAN
(broadcast domain). A high rate of unknown unicast traffic can have the same
negative effects as a broadcast storm.
Configure broadcast filters on each port that requires broadcast storm control. Set a
threshold that defines the total number of broadcast packets transmitted
(100-10000), in packets per second. When the threshold is reached, no more
packets of the specified type are transmitted.
Ports are grouped into broadcast domains by assigning them to the same VLAN.
Frames received in one VLAN can only be forwarded within that VLAN, and
multicast, broadcast, and unknown unicast frames are flooded only to ports in the
same VLAN.
* = PVID/Native-VLAN is tagged.
Trk = Trunk mode
NVLAN = Native-VLAN
Each port on the switch can belong to one or more VLANs, and each VLAN can
have any number of switch ports in its membership. Any port that belongs to multiple
VLANs, however, must have VLAN tagging/trunk mode enabled (see “VLAN
Tagging/Trunk Mode” on page 98).
Tagging places the VLAN identifier in the frame header of a packet, allowing each
port to belong to multiple VLANs. When you add a port to multiple VLANs, you also
must enable tagging on that port.
802.1Q Switch
VLAN 1
DA CRC
SA
Incoming Outgoing Data
untagged Data untagged packet
packet (unchanged) SA
CRC DA
Key
By default:
All ports are assigned PVID = 1
All ports are untagged members of VLAN 1
BS45010A
Note: The port numbers specified in these illustrations may not directly correspond
to the physical port configuration of your switch model.
When a VLAN is configured, ports are added as members of the VLAN, and the
ports are defined as either tagged or untagged (see Figure 2 through Figure 5).
The default configuration settings for the G8124 has all ports set as untagged
members of VLAN 1 with all ports configured as PVID = 1. In the default
configuration example shown in Figure 1, all incoming packets are assigned to
VLAN 1 by the default port VLAN identifier (PVID =1).
Port 5
Untagged member
of VLAN 2
Port 4
Port 5
802.1Q Switch CRC* Data Tag SA DA
(*Recalculated)
Port 6 Port 7 Port 8
Before
Port 6 Port 7 Port 8
Untagged member
of VLAN 2
BS45013A
As shown in Figure 5, the tagged packet remains unchanged as it leaves the switch
through port 5, which is configured as a tagged member of VLAN 2. However, the
tagged packet is stripped (untagged) as it leaves the switch through port 7, which is
configured as an untagged member of VLAN 2.
Port 4
Port 5
802.1Q Switch CRC Data Tag SA DA
Outgoing After
SA untagged packet
changed Key
DA (tag removed)
Priority - User_priority
CFI - Canonical format indicator
VID - VLAN identifier
BS45014A
Enterprise Enterprise
Routing Switch Routing Switch
Component Description
G8124 switch This switch is configured with three VLANs that represent three
different IP subnets. Five ports are connected downstream to
servers. Two ports are connected upstream to routing switches.
Uplink ports are members of all three VLANs, with VLAN
tagging/trunk mode enabled.
Note: VLAN tagging/trunk mode is required only on ports that are connected to
other switches or on ports that connect to tag-capable end-stations, such as
servers with VLAN-tagging/trunk mode adapters.
By default, all ports are members of VLAN 1, so configure only those ports that
belong to other VLANs.
Use Private VLANs to partition a VLAN domain into sub-domains. Each sub-domain
is comprised of one primary VLAN and one or more secondary VLANs, as follows:
• Primary VLAN—carries unidirectional traffic downstream from promiscuous
ports. Each Private VLAN configuration has only one primary VLAN. All ports in
the Private VLAN are members of the primary VLAN.
• Secondary VLAN—Secondary VLANs are internal to a private VLAN domain,
and are defined as follows:
– Isolated VLAN—carries unidirectional traffic upstream from the host servers
toward ports in the primary VLAN and the gateway. Each Private VLAN
configuration can contain only one isolated VLAN.
– Community VLAN—carries upstream traffic from ports in the community
VLAN to other ports in the same community, and to ports in the primary
VLAN and the gateway. Each Private VLAN configuration can contain
multiple community VLANs.
After you define the primary VLAN and one or more secondary VLANs, you map the
secondary VLAN(s) to the primary VLAN.
Configuration Example
Follow this procedure to configure a Private VLAN.
1. Select a VLAN and define the Private VLAN type as primary.
The G8124 supports two trunk types: static trunk groups (portchannel), and dynamic
LACP trunk groups. You may configure up to 24 trunk groups on the switch, with
both types (static and LACP) sharing the same pool. Of the available configuration
slots, any or all may be used for LACP trunks, though only up to 12 may used for
static trunks. In addition, although up to a total of 24 trunks may be configured and
enabled, only a maximum of 16 may be operational at any given time.
For example, if you configure and enable 12 static trunks (the maximum), up to 4
LACP trunks may also be configured and enabled, for a total of 16 operational
trunks. If more than 16 trunks are enabled at any given time, once the switch
establishes the 16th trunk group, any additional trunks are automatically placed in a
non-operational state. In this scenario, there is no administrative means to ensure
which 16 trunks are selected for operation.
Figure 7. Port Trunk Group
Switch 1 Switch 2
Aggregate
Port Trunk
Trunk groups are also useful for connecting a G8124 to third-party devices that
support link aggregation, such as Cisco routers and switches with EtherChannel
technology (not ISL trunking technology) and Sun's Quad Fast Ethernet Adapter.
Trunk Group technology is compatible with these devices when they are configured
manually.
Trunk traffic is statistically distributed among the ports in a trunk group, based on a
variety of configurable options.
Also, since each trunk group is comprised of multiple physical links, the trunk group
is inherently fault tolerant. As long as one connection between the switches is
available, the trunk remains active and statistical load balancing is maintained
whenever a port in a trunk group is lost or returned to service.
Before you configure your trunk, you must consider these settings, along with
specific configuration rules, as follows:
1. Read the configuration rules provided in the section, “Static Trunk Group
Configuration Rules” on page 111.
2. Determine which switch ports (up to 12) are to become trunk members (the
specific ports making up the trunk).
3. Ensure that the chosen switch ports are set to enabled. Trunk member ports
must have the same VLAN and Spanning Tree configuration.
4. Consider how the existing Spanning Tree will react to the new trunk
configuration. See Chapter 9, “Spanning Tree Protocols,” for Spanning Tree
Group configuration guidelines.
5. Consider how existing VLANs will be affected by the addition of a trunk.
Prior to configuring each switch in this example, you must connect to the
appropriate switches as the administrator.
Note: For details about accessing and using any of the commands described in
this example, see the RackSwitch G8124 ISCLI Reference.
1. Follow these steps on the G8124:
a. Define a trunk group.
3. Connect the switch ports that will be members in the trunk group.
Trunk group 3 (on the G8124) is now connected to trunk group 1 (on the other
switch).
Note: In this example, two G8124 switches are used. If a third-party device support-
ing link aggregation is used (such as Cisco routers and switches with Ether-
Channel technology or Sun's Quad Fast Ethernet Adapter), trunk groups on
the third-party device must be configured manually. Connection problems
could arise when using automatic trunk group negotiation on the third-party
device.
Information about each port in each configured trunk group is displayed. Make
sure that trunk groups consist of the expected ports and that each port is in the
expected state.
The 802.3ad standard allows standard Ethernet links to form a single Layer 2 link
using the Link Aggregation Control Protocol (LACP). Link aggregation is a method
of grouping physical link segments of the same media type and speed in full duplex,
and treating them as if they were part of a single, logical link segment. If a link in a
LACP trunk group fails, traffic is reassigned dynamically to the remaining link(s) of
the dynamic trunk group.
Note: LACP implementation in the IBM Networking OS does not support the Churn
machine, an option used to detect if the port is operable within a bounded
time period between the actor and the partner. Only the Marker Responder is
implemented, and there is no marker protocol generator.
A port’s Link Aggregation Identifier (LAG ID) determines how the port can be
aggregated. The Link Aggregation ID (LAG ID) is constructed mainly from the
partner switch’s system ID and the port’s admin key, as follows:
• System ID: an integer value based on the partner switch’s MAC address and the
system priority assigned in the CLI.
• Admin key: a port’s Admin key is an integer value (1-65535) that you can
configure in the CLI. Each switch port that participates in the same LACP trunk
group must have the same admin key value. The Admin key is local significant,
which means the partner switch does not need to use the same Admin key value.
For example, consider two switches, an Actor (the G8124) and a Partner (another
switch), as shown in Table 14.
Table 14. Actor vs. Partner LACP configuration
Port 7 (admin key = 100) Port 1 (admin key = 50) Primary trunk group
Port 8 (admin key = 100) Port 2 (admin key = 50) Primary trunk group
Port 9 (admin key = 100) Port 3 (admin key = 70) Secondary trunk group
Port 10 (admin key = 100) Port 4 (admin key = 70) Secondary trunk group
In the configuration shown in Table 14, Actor switch ports 7 and 8 aggregate to form
an LACP trunk group with Partner switch ports 1 and 2. Only ports with the same
LAG ID are aggregated in the trunk group. Actor switch ports 9 and 10 are not
aggregated in the same trunk group, because although they have the same admin
key on the Actor switch, their LAG IDs are different (due to a different Partner switch
admin key configuration). Instead, they form a secondary trunk group with Partner
switch ports 3 and 4.
LACP automatically determines which member links can be aggregated and then
aggregates them. It provides for the controlled addition and removal of physical links
for the link aggregation.
A port may also be placed in suspended mode for the following reasons:
• When LACP is configured on the port but it stops receiving LACPDUs from the
partner switch.
• When the port has a different LAG ID because of the partner switch MAC or port
LACP key being different. For example: when a switch is connected to two
partners.
Static LACP trunks are configured by associating the LACP admin key to a
portchannel ID within a dedicated LACP portchannel group range:
Each active LACP port transmits LACP data units (LACPDUs), while each passive
LACP port listens for LACPDUs. During LACP negotiation, the admin key is
exchanged. The LACP trunk group is enabled as long as the information matches at
both ends of the link. If the admin key value changes for a port at either end of the
link, that port’s association with the LACP trunk group is lost.
When the system is initialized, all ports by default are in LACP off mode and are
assigned unique admin keys. To make a group of ports aggregatable, you assign
them all the same admin key. You must set the port’s LACP mode to active to
activate LACP negotiation. You can set other port’s LACP mode to passive, to
reduce the amount of LACPDU traffic at the initial trunk-forming stage.
Use the following command to check whether the ports are trunked:
This allows the selected ports to be treated as normal link-up ports, which may
forward data traffic according to STP, Hot Links or other applications, if they do not
receive any LACPDUs.
To configure the LACP individual setting for all the ports in a static LACP trunk, use
the following commands:
The switch can be configured to use a variety of hashing options. To achieve the
most even traffic distribution, select options that exhibit a wide range of values for
your particular network. Avoid hashing on information that is not usually present in
the expected traffic, or which does not vary.
PVRST Mode
Note: Per-VLAN Rapid Spanning Tree (PVRST) is enabled by default on the
G8124.
Using STP, network devices detect and eliminate logical loops in a bridged or
switched network. When multiple paths exist, Spanning Tree configures the network
so that a switch uses only the most efficient path. If that path fails, Spanning Tree
automatically sets up another active path on the network to sustain network
operations.
N/OS PVRST mode is based on IEEE 802.1w RSTP. Like RSTP, PVRST mode
provides rapid Spanning Tree convergence. However, PVRST mode is enhanced
for multiple instances of Spanning Tree. In PVRST mode, each VLAN may be
automatically or manually assigned to one of 127 available STGs. Each STG acts
as an independent, simultaneous instance of STP. PVRST uses IEEE 802.1Q
tagging to differentiate STP BPDUs and is compatible with Cisco R-PVST/R-PVST+
modes.
The relationship between ports, trunk groups, VLANs, and Spanning Trees is shown
in Table 15.
Table 15. Ports, Trunk Groups, and VLANs
Due to the sequence involved in these STP states, considerable delays may occur
while paths are being resolved. To mitigate delays, ports defined as edge ports
(“Port Type and Link Type” on page 138) may bypass the discarding and
learning states, and enter directly into the forwarding state.
Bridge Priority
The bridge priority parameter controls which bridge on the network is the STG root
bridge. To make one switch become the root bridge, configure the bridge priority lower
than all other switches and bridges on your network. The lower the value, the higher
the bridge priority. Use the following command to configure the bridge priority:
The port priority helps determine which bridge port becomes the root port or the
designated port. The case for the root port is when two switches are connected using
a minimum of two links with the same path-cost. The case for the designated port is in
a network topology that has multiple bridge ports with the same path-cost connected
to a single segment, the port with the lowest port priority becomes the designated port
for the segment. Use the following command to configure the port priority:
Root Guard
The root guard feature provides a way to enforce the root bridge placement in the
network. It keeps a new device from becoming root and thereby forcing STP
re-convergence. If a root-guard enabled port detects a root device, that port will be
placed in a blocked state.
You can configure the root guard at the port level using the following commands:
Loop Guard
Note: The global loop guard command will be effective on a port only if the
port-level loop guard command is set to default as shown below:
RS G8124(config)# interface port <port number>
RS G8124(config-if)# no spanning-tree guard
To enable loop guard at the port level, enter the following command:
The port path cost assigns lower values to high-bandwidth ports, such as 10 Gigabit
Ethernet, to encourage their use. The objective is to use the fastest links so that the
route with the lowest cost is chosen. A value of 0 (the default) indicates that the
default cost will be computed for an auto-negotiated link or trunk speed.
The port path cost can be a value from 1 to 200000000. Specify 0 for automatic path
cost.
Enterprise
Routing
Switches
Switch 1 x Switch 2
STP
Blocks Link
To prevent a network loop among the switches, STP must block one of the links
between them. In this case, it is desired that STP block the link between the IBM
switches, and not one of the G8124 uplinks or the Enterprise switch trunk.
During operation, if one G8124 experiences an uplink failure, STP will activate the
IBM switch-to-switch link so that server traffic on the affected G8124 may pass
through to the active uplink on the other G8124, as shown in Figure 10.
Enterprise
Routing Uplink
Switches Failure
Switch 1 Switch 2
STP
Restores Link
In this example, port 10 on each G8124 is used for the switch-to-switch link. To
ensure that the G8124 switch-to-switch link is blocked during normal operation, the
port path cost is set to a higher value than other paths in the network. To configure
the port path cost on the switch-to-switch links in this example, use the following
commands on each G8124.
RS G8124(config)# interface port 10
RS G8124(config-if)# spanning-tree stp 1 path-cost 60000
RS G8124(config-if)# exit
Multiple STGs provide multiple data paths which can be used for load-balancing and
redundancy. To enable load balancing between two G8124s using multiple STGs,
configure each path with a different VLAN and then assign each VLAN to a separate
STG. Since each STG is independent, they each send their own IEEE 802.1Q
tagged Bridge Protocol Data Units (BPDUs).
Each STG behaves as a bridge group and forms a loop-free topology. The default
STG 1 may contain multiple VLANs (typically until they can be assigned to another
STG). STGs 2-127 may contain only one VLAN each.
Switch 1 Switch 2
VLAN 30
VLAN 1
STG 1 STG 2
False x
Loop VLAN 1 VLAN 30
is active is active
In the second network, the problem of improper link blocking is resolved when the
VLANs are placed into different Spanning Tree Groups (STGs). Since each STG
has its own independent instance of Spanning Tree, each STG is responsible only
for the loops within its own VLAN. This eliminates the false loop, and allows both
VLANs to forward packets between the switches at the same time.
STG 1 is the default STG. Although VLANs can be added to or deleted from default
STG 1, the STG itself cannot be deleted from the system. By default, STG 1 is
enabled and includes VLAN 1, which by default includes all switch ports (except for
management VLANs and management ports).
STG 128 is reserved for switch management. By default, STG 128 is disabled, but
includes management VLAN 4095 and the management ports (MGMT-A and
MGMT-B).
By default, all other STGs (STG 2 through 127) are enabled, though they initially
include no member VLANs. VLANs must be assigned to STGs. By default, this is
done automatically using VLAN Automatic STG Assignment (VASA), though it can
also be done manually (see “Manually Assigning STGs” on page 127.
When VASA is enabled (as by default), each time a new VLAN is configured, the
switch will automatically assign that new VLAN to its own STG. Conversely, when a
VLAN is deleted, if its STG is not associated with any other VLAN, the STG is
returned to the available pool.
The specific STG number to which the VLAN is assigned is based on the VLAN
number itself. For low VLAN numbers (1 through 127), the switch will attempt to
assign the VLAN to its matching STG number. For higher numbered VLANs, the
STG assignment is based on a simple modulus calculation; the attempted STG
number will “wrap around,” starting back at the top of STG list each time the end of
the list is reached. However, if the attempted STG is already in use, the switch will
select the next available STG. If an empty STG is not available when creating a new
VLAN, the VLAN is automatically assigned to default STG 1.
If ports are tagged, each tagged port sends out a special BPDU containing the
tagged information. Also, when a tagged port belongs to more than one STG, the
egress BPDUs are tagged to distinguish the BPDUs of one STG from those of
another STG.
VASA is enabled by default, but can be disabled or re-enabled using the following
commands:
If VASA is disabled, when you create a new VLAN, that VLAN automatically belongs
to default STG 1. To place the VLAN in a different STG, assign it manually.
VASA applies only to PVRST mode and is ignored in RSTP and MSTP modes.
When a VLAN is assigned to a new STG, the VLAN is automatically removed from
its prior STG.
Note: For proper operation with switches that use Cisco PVST+, it is
recommended that you create a separate STG for each VLAN.
• When you remove a port from VLAN that belongs to an STG, that port will also be
removed from the STG. However, if that port belongs to another VLAN in the
same STG, the port remains in the STG.
As an example, assume that port 2 belongs to only VLAN 2, and that VLAN 2
belongs to STG 2. When you remove port 2 from VLAN 2, the port is moved to
default VLAN 1 and is removed from STG 2.
However, if port 2 belongs to both VLAN 1 and VLAN 2, and both VLANs belong
to STG 2, removing port 2 from VLAN 2 does not remove port 2 from STG 2,
because the port is still a member of VLAN 1, which is still a member of STG 2.
• An STG cannot be deleted, only disabled. If you disable the STG while it still
contains VLAN members, Spanning Tree will be off on all ports belonging to that
VLAN.
The relationship between port, trunk groups, VLANs, and Spanning Trees is shown
in Table 15 on page 120.
For example, in Figure 12, each switch is responsible for the proper configuration of
its own ports, VLANs, and STGs. Switch A identifies its own port 17 as part of VLAN
2 on STG 2, and the Switch B identifies its own port 8 as part of VLAN 2 on STG 2.
Figure 12. Implementing Multiple Spanning Tree Groups
Chassis Application
Switch A Switch B
STG 2
17 8
VLAN 2
18 2 1
STG 3
VLAN 3 STG 1
VLAN 1
8 2 1
1 8
Application Application
Switch C Switch D
The VLAN participation for each Spanning Tree Group in Figure 12 on page 129 is
as follows:
• VLAN 1 Participation
Assuming Switch B to be the root bridge, Switch B transmits the BPDU for STG
1 on ports 1 and 2. Switch C receives the BPDU on port 2, and Switch D receives
the BPDU on port 1. Because there is a network loop between the switches in
VLAN 1, either Switch D will block port 8 or Switch C will block port 1, depending
on the information provided in the BPDU.
• VLAN 2 Participation
Switch B, the root bridge, generates a BPDU for STG 2 from port 8. Switch A
receives this BPDU on port 17, which is assigned to VLAN 2, STG 2. Because
switch B has no additional ports participating in STG 2, this BPDU is not
forwarded to any additional ports and Switch B remains the designated root.
• VLAN 3 Participation
For VLAN 3, Switch A or Switch C may be the root bridge. If Switch A is the root
bridge for VLAN 3, STG 3, then Switch A transmits the BPDU from port 18.
Switch C receives this BPDU on port 8 and is identified as participating in VLAN
3, STG 3. Since Switch C has no additional ports participating in STG 3, this
BPDU is not forwarded to any additional ports and Switch A remains the
designated root.
Because VASA is enabled by default, each new VLAN is automatically assigned its
own STG.
1. Set the Spanning Tree mode on each switch to PVRST.
Note: PVRST is the default mode on the G8124. This step is not required unless
the STP mode has been previously changed, and is shown here merely as
an example of manual configuration.
2. Configure the following on Switch A:
Enable VLAN 2 and VLAN 3.
RS G8124(config)# vlan 2
RS G8124(config-vlan)# exit
RS G8124(config)# vlan 3
RS G8124(config-vlan)# exit
RS G8124(config)# vlan 2
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 8
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 2
RS G8124(config-if)# exit
RS G8124(config)# vlan 3
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 8
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 3
RS G8124(config-if)# exit
RSTP was originally defined in IEEE 802.1w (2001) and was later incorporated into
IEEE 802.1D (2004), superseding the original STP standard.
RSTP parameters apply only to Spanning Tree Group (STG) 1. The PVRST mode
STGs 2-128 are not used when the switch is placed in RSTP mode.
RSTP is compatible with devices that run IEEE 802.1D (1998) Spanning Tree
Protocol. If the switch detects IEEE 802.1D (1998) BPDUs, it responds with IEEE
802.1D (1998)-compatible data units. RSTP is not compatible with Per-VLAN Rapid
Spanning Tree (PVRST) protocol.
Port States
RSTP port state controls are the same as for PVRST: discarding, learning,
and forwarding.
Due to the sequence involved in these STP states, considerable delays may occur
while paths are being resolved. To mitigate delays, ports defined as edge/portfast
ports (“Port Type and Link Type” on page 138) may bypass the discarding and
learning states, and enter directly into the forwarding state.
MSTP allows frames assigned to different VLANs to follow separate paths, with
each path based on an independent Spanning Tree instance. This approach
provides multiple forwarding paths for data traffic, thereby enabling load-balancing,
and reducing the number of Spanning Tree instances required to support a large
number of VLANs.
MSTP Region
A group of interconnected bridges that share the same attributes is called an MST
region. Each bridge within the region must share the following attributes:
• Alphanumeric name
• Revision number
• VLAN-to STG mapping scheme
MSTP provides rapid re-configuration, scalability and control due to the support of
regions, and multiple Spanning-Tree instances support within each region.
CIST allows the MSTP region to act as a virtual bridge to other bridges outside of
the region, and provides a single Spanning-Tree instance to interact with them.
CIST port configuration includes Hello time, path-cost, and interface priority. These
parameters do not affect Spanning Tree Groups 1-32. They apply only when the
CIST is used.
This configuration shows how to configure MSTP Groups on the switch, as shown in
Figure 12.
Figure 13. Implementing Multiple Spanning Tree Groups
Enterprise Enterprise
Routing Switch Routing Switch
MSTP Group 1 MSTP Group 2
Root Root
This example shows how multiple Spanning Trees can provide redundancy without
wasting any uplink ports. In this example, the server ports are split between two
separate VLANs. Both VLANs belong to two different MSTP groups. The Spanning
Tree priority values are configured so that each routing switch is the root for a
different MSTP instance. All of the uplinks are active, with each uplink port backing
up the other.
1. Configure port membership and define the STGs for VLAN 1. Enable tagging
on uplink ports that share VLANs. Port 19 and port 20 connect to the Enterprise
Routing switches.
4. Configure port membership and define the STGs for VLAN 2. Add server
ports 3, 4, and 5 to VLAN 2. Add uplink ports 19 and 20 to VLAN 2. Assign
VLAN 2 to STG 2.
RS G8124(config)# interface port 3,4,5,19,20
RS G8124(config-if)# switchport access vlan 2
RS G8124(config-if)# exit
Edge ports send BPDUs to upstream STP devices like normal STP ports, but do not
receive BPDUs. If a port with edge enabled does receive a BPDU, it immediately
begins working as a normal (non-edge) port, and participates fully in Spanning Tree.
Link Type
The link type determines how the port behaves in regard to Rapid Spanning Tree.
Use the following commands to define the link type for the port:
RS G8124(config)# interface port <port>
RS G8124(config-if)# [no] spanning-tree link-type <type>
RS G8124(config-if)# exit
ISL
Aggregation VLAG
Layer Peers
Servers
As shown in the example, a switch in the access layer may be connected to more
than one switch in the aggregation layer to provide for network redundancy.
Typically, Spanning Tree Protocol (RSTP, PVRST, or MSTP—see “Spanning Tree
Protocols” on page 119) is used to prevent broadcast loops, blocking redundant
uplink paths. This has the unwanted consequence of reducing the available
bandwidth between the layers by as much as 50%. In addition, STP may be slow to
resolve topology changes that occur during a link failure, and can result in
considerable MAC address flooding.
Using Virtual Link Aggregation Groups (VLAGs), the redundant uplinks remain
active, utilizing all available bandwidth.
Two switches are paired into VLAG peers, and act as a single virtual entity for the
purpose of establishing a multi-port trunk. Ports from both peers can be grouped
into a VLAG and connected to the same LAG-capable target device. From the
perspective of the target device, the ports connected to the VLAG peers appear to
be a single trunk connecting to a single logical device. The target device uses the
configured Tier ID to identify the VLAG peers as this single logical device. It is
important that you use a unique Tier ID for each VLAG pair you configure. The
VLAG-capable switches synchronize their logical view of the access layer port
structure and internally prevent implicit loops. The VLAG topology also responds
more quickly to link failure and does not result in unnecessary MAC flooding.
VLAGs are also useful in multi-layer environments for both uplink and downlink
redundancy to any regular LAG-capable device. For example:
VLAG 3 Trunk
VLAG 3 VLAG 4
ISL ISL
VLAG VLAG
Peers A Peers B
VLAG 1 VLAG 2
Trunk Trunk
LACP-capable
Switch
LACP-capable
Server
Servers
Wherever ports from both peered switches are trunked to another device, the
trunked ports must be configured as a VLAG. For example, VLAGs 1 and 3 must be
configured for both VLAG Peer A switches. VLAGs 2 and 4 must be configured for
both VLAG Peer B switches.VLAGs 3, 5, and 6 must be configured on both VLAG
Peer C switches. Other devices connecting to the VLAG peers are configured using
regular static or dynamic trunks.
Note: Do not configure a VLAG for connecting only one switch in the peer set to
another device or peer set. For instance, in VLAG Peer C, a regular trunk is
employed for the downlink connection to VLAG Peer B because only one of
the VLAG Peer C switches is involved.
VLAG
ISL Peers
VRRP VRRP
VLAG
Master Backup
Server Active
Traffic Flows
VLAG Capacities
Servers or switches that connect to the VLAG peers using a multi-port VLAG are
considered VLAG clients. VLAG clients are not required to be VLAG-capable. The
ports participating in the VLAG are configured as regular port trunks on the VLAG
client end.
On the VLAG peers, the VLAGs are configured similarly to regular port trunks, using
many of the same features and rules. See “Ports and Trunking” on page 109 for
general information concerning all port trunks.
Each VLAG begins as a regular port trunk on each VLAG-peer switch. The VLAG
may be either a static trunk group (portchannel) or dynamic LACP trunk group, and
consumes one slot from the overall port trunk capacity pool. The trunk type must
match that used on VLAG client devices. Additional configuration is then required to
implement the VLAG on both VLAG peer switches.
You may configure up to 12 trunk groups on the switch, with all types (regular or
VLAG, static or LACP) sharing the same pool.
Each trunk type can contain up to 12 member ports, depending on the port type and
availability.
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 141
VLAGs versus Port Trunks
Though similar to regular port trunks in many regards, VLAGs differ from regular
port trunks in a number of important ways:
• A VLAG can consist of multiple ports on two VLAG peers, which are connected to
one logical client device such as a server, switch, or another VLAG device.
• The participating ports on the client device are configured as a regular port trunk.
• The VLAG peers must be the same model, and run the same software version.
• VLAG peers require a dedicated inter-switch link (ISL) for synchronization. The
ports used to create the ISL must have the following properties:
– ISL ports must have VLAN tagging turned on.
– ISL ports must be configured for all VLAG VLANs.
– ISL ports must be placed into a regular port trunk group (dynamic or static).
– A minimum of two ports on each switch are recommended for ISL use.
• Dynamic routing protocols, such as OSPF, cannot terminate on VLAGs.
• Routing over VLAGs is not supported. However, IP forwarding between subnets
served by VLAGs can be accomplished using VRRP.
• VLAGs are configured using additional commands.
• It is recommended that end-devices connected to VLAG switches use NICs with
dual-homing. This increases traffic efficiency, reduces ISL load, and provides
faster link failover.
The following parameters must be identically configured on the VLAG ports of both
the VLAG peers:
• VLANs
• Native VLAN tagging
• Native VLAN/PVID
• STP mode
• BPDU Guard setting
• STP port setting
• MAC aging timers
• Static MAC entries
• ACL configuration parameters
• QoS configuration parameters
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 143
Basic VLAG Configuration
Figure 17 shows an example configuration where two VLAG peers are used for
aggregating traffic from downstream devices.
Figure 17. Basic VLAGs
ISL
VLAG Peer 1 1 2 VLAG Peer 2
Mgmt IP: 10.10.10.1/24 2 3 Mgmt IP: 10.10.10.2/24
8 9
LACP 200 7 8
VLAG 1 VLAG 2
LACP 1000 LACP 2000
VLAN 100 VLAN 100
In this example, each client switch is connected to both VLAG peers. On each client
switch, the ports connecting to the VLAG peers are configured as a dynamic LACP
port trunk. The VLAG peer switches share a dedicated ISL for synchronizing VLAG
information. On the individual VLAG peers, each port leading to a specific client
switch (and part of the client switch’s port trunk) is configured as a VLAG.
In the following example configuration, only the configuration for VLAG 1 on VLAG
Peer 1 is shown. VLAG Peer 2 and all other VLAGs are configured in a similar
fashion.
Before changing the STP mode to MSTP, ensure you have the same region name,
revision and VLAN to STG mapping on both VLAG switches.
The ISL connecting the VLAG peers is shared by all their VLAGs. The ISL needs to
be configured only once on each VLAG peer.
1. Configure STP if required. Use PVRST or MSTP mode only:
2. Configure the ISL ports and place them into a port trunk group:
4. Continue by configuring all required VLAGs on VLAG Peer 1, and then repeat
the configuration for VLAG Peer 2.
For each corresponding VLAG on the peer, the port trunk type (dynamic or
static), VLAN, and STP mode and ID must be the same as on VLAG Peer 1.
5. Verify the completed configuration:
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 145
VLAG Configuration - VLANs Mapped to MSTI
Follow the steps below to configure VLAG in environments where the VLANs are
mapped to Multiple Spanning Tree Instance (MSTI).
Before changing the STP mode to MSTP, ensure you have the same region name,
revision and VLAN to STG mapping on both VLAG switches.
The ISL connecting the VLAG peers is shared by all their VLAGs. The ISL needs to
be configured only once on each VLAG peer.
1. Configure STP:
2. Configure the ISL ports and place them into a port trunk group:
Note: In this case, a dynamic trunk group is shown. A static trunk (portchannel)
could be configured instead.
3. Configure VLAG Tier ID and enable VLAG globally. This is used to identify the
VLAG switch in a multi-tier environment.
4. Disable VLAG.
8. Continue by configuring all required VLAGs on VLAG Peer 1, and then follow
the steps below for configuring VLAG Peer 2.
9. Configure the VLAN for VLAG 2.
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 147
10. Map the VLAN to an MSTI.
On VLAG Peer2:
15. Place the VLAG 2 port(s) in a port trunk group:
Note: If the switch does not have a dedicated management interface, configure a
VLAN for the health check interface. The health check interface can be
configured with an IPv4 address:
Note: Configure a similar interface on VLAG Peer 2. For example, use IP address
10.10.10.2.
2. Specify the IPv4 or IPv6 address of the VLAG Peer:
VLAG supports either IPv4 or IPv6 health check addresses at one time. Configuring
an IPv4 health check address, will set any IPv6 health check address in the VLAG to
0, and vice-versa.
One can still configure an IPv6 health check address in a profile that doesn’t support
IPv6.
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 149
VLAGs with VRRP
Note: In a multi-layer environment, configure VRRP separately for each layer. We
recommend that you configure VRRP only on the tier with uplinks. See
“Configuring VLAGs in Multiple Layers” on page 155.
VRRP (see “Virtual Router Redundancy Protocol” on page 383) can be used in
conjunction with VLAGs and LACP-capable devices to provide seamless
redundancy.
Figure 18. Active-Active Configuration using VRRP and VLAGs
VRRP Master
VLAG Peer 1 Server 1
Layer 3
Router VIR: 10.0.1.100 VLAG 1
10.0.1.1
1 10
11
2 Server 2
4 5 12 VLAG 2
Internet ISL 10.0.1.2
4 5 10
1 11 VLAG 3
Server 3
12
2
Layer 3 VRRP Backup 10.0.1.3
Router
VLAG Peer 2
VIR: 10.0.1.100 Network 10.0.1.0/24
Although OSPF is used in this example, static routing could also be deployed.
For more information, see “OSPF” on page 333 or “Basic IP Routing” on
page 245.
3. Configure a server-facing interface.
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# ip address 10.0.1.10 255.255.255.0
RS G8124(config-ip-if)# vlan 100
RS G8124(config-ip-if)# exit
5. Set the priority of Virtual Router 1 to 101, so that it becomes the Master.
6. Configure the ISL ports and place them into a port trunk group:
Note: In this case, a dynamic trunk group is shown. A static trunk (portchannel)
could be configured instead.
7. Configure the upstream ports.
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 151
9. Configure all VLANs including VLANs for the VLAGs.
RS G8124(config)# vlan 10
RS G8124(config-vlan)# exit
RS G8124(config)# vlan 20
RS G8124(config-vlan)# exit
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 172.1.1.10 255.255.255.0
RS G8124(config-ip-if)# vlan 10
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# ip ospf area 1
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 172.1.3.10 255.255.255.0
RS G8124(config-ip-if)# vlan 20
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# ip ospf area 1
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
The VLAG peer (VLAG Peer 2) must be configured using the same ISL trunk type
(dynamic or static), the same VLAN for VLAG and VLAG ISL ports, and the same
STP mode and Tier ID used on VLAG Switch 1.
For each corresponding VLAG on the peer, the port trunk type (dynamic or static),
VLAN, and STP mode and ID must be the same as on VLAG Switch 1.
1. Configure VLAG tier ID and enable VLAG globally.
Although OSPF is used in this example, static routing could also be deployed.
3. Configure a server-facing interface.
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# ip address 10.0.1.11 255.255.255.0
RS G8124(config-ip-if)# vlan 100
RS G8124(config-ip-if)# exit
5. Configure the ISL ports and place them into a port trunk group:
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 153
7. Configure the server ports.
RS G8124(config)# vlan 30
RS G8124(config-vlan)# exit
RS G8124(config)# vlan 40
RS G8124(config-vlan)# exit
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 172.1.2.11 255.255.255.0
RS G8124(config-ip-if)# vlan 30
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# ip ospf area 1
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 172.1.4.12 255.255.255.0
RS G8124(config-ip-if)# vlan 40
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# ip ospf area 1
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
VLAG 3 Trunk
VLAG 3 VLAG 4
ISL ISL
VLAG VLAG
Peers A Switch C Switch D Switch E Switch F Peers B
VLAG 1 VLAG 2
Trunk Trunk
LACP-capable
Switch G Switch
LACP-capable
Server
Servers
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 155
Task 2: Configure switches in the Layer 2 region.
RS G8124(config)# vlan 10
VLAN number 10 with name “VLAN 10” created
VLAN 10 was assigned to STG 10
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 1,2,5
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 10
RS G8124(config-if)# exit
Repeat the previous steps on Switch B for ports connecting to Layer 2/3 router 1.
RS G8124(config)# vlan 20
VLAN number 20 with name “VLAN 20” created
VLAN 20 was assigned to STG 20
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 1,2,6
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 20
RS G8124(config-if)# exit
Repeat the previous steps on Switch B for ports connecting to Layer 2/3 router 2.
5. Configure ports on Switch A connecting to downstream VLAG switches C and
D.
RS G8124(config)# vlan 20
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 10,11
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 20
RS G8124(config-if)# lacp key 600
RS G8124(config-if)# lacp mode active
RS G8124(config-if)# exit
Repeat the above steps on Switch B for ports connecting to downstream VLAG
switch C and D.
6. Configure ports on Switch B connecting to downstream switches E and F.
RS G8124(config)# vlan 30
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 15-18
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 30
RS G8124(config-if)# lacp key 700
RS G8124(config-if)# lacp mode active
RS G8124(config-if)# exit
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 157
VLAG with PIM
Note: This section is applicable only to G8124-E.
IBM Networking OS supports PIM in Sparse Mode (PIM-SM) and Dense Mode
(PIM-DM). For more details on PIM, see Chapter 26, “Protocol Independent
Multicast"” on page 361.
PIM, when configured in a VLAG topology, provides efficient multicast routing along
with redundancy and failover. When the multicast source is located in the core L3
network, only the primary VLAG switch forwards multicast data packets to avoid
duplicate packets reaching the access layer switch. The secondary VLAG switch is
available as backup and forwards packets only when the primary VLAG switch is not
available and during failover. When the multicast source is located in the L2 domain,
behind the VLAG ports, either the primary or the secondary switch will forward the
data traffic to the receiver, based on the shortest path detected by PIM.
See Figure 17 on page 144 for a basic VLAG topology. For PIM to function in a
VLAG topology, the following are required:
• IGMP (v1 or v2) must be configured on the VLAG switches.
• A Layer 3 routing protocol (such as BGP, OSPF, RIP, or static routes) must be
globally enabled and on VLAG-associated IP interfaces for multicast routing.
• The VLAG switches must be connected to upstream multicast routers.
• The Rendezvous Point (RP) and/or the Bootstrap router (BSR) must be
configured on the upstream router.
• Flooding must be disabled on the VLAG switches or in the VLAN associated with
the VLAG ports.
• ISL ports must be members of VLANs that have VLAG ports as members.
For PIM configuration steps and commands, see “PIM Configuration Examples” on
page 370.
Traffic Forwarding
In a VLAG with PIM topology, traffic forwarded by the upstream router is managed
as follows when the multicast source is located in the core L3 network and the
receiver is located in the L2 network:
• If the primary and secondary VLAG ports are up, the primary switch forwards
traffic to the receiver. The secondary switch blocks the traffic. Multicast entries
are created on both the VLAG switches: primary VLAG switch with forward state;
secondary VLAG switch with pruned state.
• If the primary VLAG port fails, the secondary VLAG switch forwards traffic to the
receiver. Multicast entries are created on both the VLAG switches: primary VLAG
switch with forward state; secondary VLAG switch with VLAG pruned state.
When the multicast source is connected to VLAG ports (layer 2 domain), traffic
forwarded by the VLAG routers is managed as follows:
• IPMC traffic from the access switch can be hashed to any of the VLAG switches.
Consequently, both the primary and secondary VLAG switches must synchronize
the (S,G) entries for faster failover.
• The Rendezvous Point sends (S,G) entries to either the primary or secondary
VLAG switch, depending on which provides the shortest path to the source.
However, Register-Stop messages are only sent to the primary VLAG switch.
Based on the shortest path, one of the VLAG switches will forward traffic for a
particular (S,G) entry to the receiver.
• For the VLAG multi-tier topology, an additional L3 backup path to ISL is
supported. On the L3 backup interface, both L3 routing protocols and PIM must
be enabled.
Health Check
In a VLAG with PIM topology, you must configure health check. See “Configuring
Health Check” on page 149.
When health check is configured, and the ISL is down, the primary VLAG switch
forwards traffic to the receiver. The secondary VLAG switch ports will be errdisable
state and will block traffic to the receiver.
© Copyright IBM Corp. 2014 Chapter 10: Virtual Link Aggregation Groups 159
160 RackSwitch G8124: Application Guide
Chapter 11. Quality of Service
Quality of Service features allow you to allocate network resources to
mission-critical applications at the expense of applications that are less sensitive to
such factors as time delays or network congestion. You can configure your network
to prioritize specific types of traffic, ensuring that each type receives the appropriate
Quality of Service (QoS) level.
By assigning QoS levels to traffic flows on your network, you can ensure that
network resources are allocated where they are needed most. QoS features allow
you to prioritize network traffic, thereby providing better service for selected
applications.
IBM Networking OS 7.11 supports up to 127 ACLs when the switch is operating in
the Balanced deployment mode (see “Deployment Profiles” on page 175). ACL
menus and commands are not available in the Routing deployment mode.
The G8124 allows you to classify packets based on various parameters. For
example:
• Ethernet: source MAC, destination MAC, VLAN number/mask, Ethernet type,
priority.
• IPv4: Source IP address/mask, destination address/mask, type of service, IP
protocol number.
• TCP/UPD: Source port, destination port, TCP flag.
• Packet format
Actions taken by an ACL are called In-Profile actions. You can configure additional
In-Profile and Out-of-Profile actions on a port. Data traffic can be metered, and
re-marked to ensure that the traffic flow provides certain levels of service in terms of
bandwidth for different types of network traffic.
Metering
Using meters, you set a Committed Rate in Kbps (multiples of 64 Mbps). All traffic
within this Committed Rate is In-Profile. Additionally, you set a Maximum Burst Size
that specifies an allowed data burst larger than the Committed Rate for a brief
period. These parameters define the In-Profile traffic.
Meters keep the sorted packets within certain parameters. You can configure a
meter on an ACL, and perform actions on metered traffic, such as packet
re-marking.
Re-marking allows for the treatment of packets to be reset based on new network
specifications or desired levels of service. You can configure the ACL to re-mark a
packet as follows:
• Change the DSCP value of a packet, used to specify the service level traffic
receives.
• Change the 802.1p priority of a packet.
The following example includes steps to configure a meter and out-of-profile DSCP
remarking:
1. Create an ACL.
3. Set out-of-profile action to re-mark DSCP value based on the global DSCP
mapping. The DSCP remarking value is global for all ACLs that have DSCP
re-marking enabled.
The six most significant bits in the TOS byte of the IP header are defined as DiffServ
Code Points (DSCP). Packets are marked with a certain value depending on the
type of treatment the packet must receive in the network device. DSCP is a measure
of the Quality of Service (QoS) level of the packet.
The switch can classify traffic by reading the DiffServ Code Point (DSCP) or IEEE
802.1p priority value, or by using filters to match specific criteria. When network traffic
attributes match those specified in a traffic pattern, the policy instructs the switch to
perform specified actions on each packet that passes through it. The packets are
assigned to different Class of Service (COS) queues and scheduled for transmission.
7 6 5 4 3 2 1 0
The switch can use the DSCP value to direct traffic prioritization.
With DiffServ, you can establish policies to direct traffic. A policy is a traffic-controlling
mechanism that monitors the characteristics of the traffic, (for example, its source,
destination, and protocol) and performs a controlling action on the traffic when certain
characteristics are matched.
Trusted/Untrusted Ports
By default, all ports on the G8124 are trusted. To configure untrusted ports, re-mark
the DSCP value of the incoming packet to a lower DSCP value using the following
commands:
The default settings are based on the following standard PHBs, as defined in the
IEEE standards:
• Expedited Forwarding (EF)—This PHB has the highest egress priority and
lowest drop precedence level. EF traffic is forwarded ahead of all other traffic. EF
PHB is described in RFC 2598.
• Assured Forwarding (AF)—This PHB contains four service levels, each with a
different drop precedence, as shown in the following table. Routers use drop
precedence to determine which packets to discard last when the network
becomes congested. AF PHB is described in RFC 2597.
Low AF11 (DSCP 10) AF21 (DSCP 18) AF31 (DSCP 26) AF41 (DSCP 34)
Medium AF12 (DSCP 12) AF22 (DSCP 20) AF32 (DSCP 28) AF42 (DSCP 36)
High AF13 (DSCP 14) AF23 (DSCP 22) AF33 (DSCP 30) AF43 (DSCP 38)
• Class Selector (CS)—This PHB has eight priority classes, with CS7 representing
the highest priority, and CS0 representing the lowest priority, as shown in the
following table. CS PHB is described in RFC 2474.
Highest CS7 56
CS6 48
CS5 40
CS4 32
CS3 24
CS2 16
CS1 8
Lowest CS0 0
Critical CS7 7
Then you must enable DSCP re-marking on any port that you wish to perform this
function (Interface Port mode).
Note: If an ACL meter is configured for DSCP re-marking, the meter function takes
precedence over QoS re-marking.
The following example includes the basic steps for re-marking DSCP value and
mapping DSCP value to 802.1p.
1. Turn DSCP re-marking on globally, and define the DSCP-DSCP-802.1p
mapping. You can use the default mapping.
Example 2
The following example assigns strict priority to VoIP traffic and a lower priority to all
other traffic.
1. Create an ACL to re-mark DSCP value and COS queue for all VoIP packets.
The IEEE 802.1p standard uses eight levels of priority (0-7). Priority 7 is assigned to
highest priority network traffic, such as OSPF or RIP routing table updates, priorities
5-6 are assigned to delay-sensitive applications such as voice and video, and lower
priorities are assigned to standard applications. A value of 0 (zero) indicates a “best
effort” traffic prioritization, and this is the default when traffic priority has not been
configured on your network. The switch can filter packets based on the 802.1p
values.
Figure 22. Layer 2 802.1q/802.1p VLAN tagged packet
7 6 5 4 3 2 1 0 7 6 5 4 3 2 1 0
Egress packets are placed in a COS queue based on the priority value, and
scheduled for transmission based on the COS queue number. Higher COS queue
numbers provide forwarding precedence.
To configure a port’s default 802.1p priority value, use the following commands.
RS G8124(config)# qos transmit-queue mapping <802.1p priority value (0-7)> <COS queue (0-7)>
To set the COS queue scheduling weight, use the following command.
Capacity, by Mode
Switch
Feature Default Aggregation IPv6 Routing HFT
Note: Throughout this guide, where feature capacities are listed, values reflect
those of the Default profile only, unless otherwise noted.
The following ISCLI commands are used to change the deployment profile:
To view the currently selected deployment profile, use the following ISCLI privileged
EXEC command:
Note: When using a specialized profile, menus and commands are unavailable for
features that are not supported under the profile. Such menus and
commands will be available again only when a supporting profile is used.
Note: Deployment profiles other than those listed in this section should be used
only under the direction of your support personnel.
All configuration commands from the prior profile are initially retained when
changing profiles, even though some may be ignored when the switch starts with
new profile. This allows the administrator to change back to the prior deployment
profile with the prior configuration intact if desired. However, once the administrator
saves the configuration under the new profile, all unsupported commands are
immediately cleared. For example, when using the Routing profile, because ACLs
are unsupported in that mode, their settings will be excluded when the configuration
is saved. Then, if returning to the Default profile, it will be necessary to reconfigure
the desired ACLs, or to use the backup configuration.
Virtualizing the NIC helps to resolve issues caused by limited NIC slot availability. By
virtualizing a 10Gbps NIC, its resources can be divided into multiple logical
instances known as virtual NICs (vNICs), Each vNIC appear as a regular,
independent NIC to the server operating system or a hypervisor, with each vNIC
using some portion of the physical NIC’s overall bandwidth.
Figure 23. Virtualizing the NIC for Multiple Virtual Pipes on Each Link
Server
NIC
Physical Switch Switch 1
VNIC NIC Ports Ports
VNIC
VNIC
OS or
10 Gbps Link with
Hypervisor VNIC Multiple Virtual Pipes
Switch 2
VNIC
VNIC
VNIC
VNIC
A G8124 with IBM Networking OS 7.11 supports the Emulex Virtual Fabric Adapter
(VFA) to provide the following vNIC features:
• Up to four vNICs are supported on each server port.
• vNICs can be grouped together, along with regular server ports, uplink ports, or
trunk groups, to define vNIC groups for enforcing communication boundaries.
• In the case of a failure on the uplink ports associated with a vNIC group, the
switch can signal affected vNICs for failover while permitting other vNICs to
continue operation.
• Each vNIC can be independently allocated a symmetric percentage of the
10Gbps bandwidth on the link (from NIC to switch, and from switch to NIC).
• The G8124 can be used as the single point of vNIC configuration as long as the
Emulex NIC is working in IBM Virtual Fabric mode.
Ports that are not defined as server ports are considered uplink ports and do not
support vNICs.
Note: When the vNIC feature is enabled, the maximum number of QOS Class of
Service queues available is four.
vNIC IDs
vNIC IDs on the Switch
IBM N/OS 7.11 supports up to four vNICs attached to each server port. Each vNIC is
provided its own independent virtual pipe on the port.
On the switch, each vNIC is identified by its port and vNIC number as follows:
<port number or alias>.<vNIC pipe number (1-4)>
For example:
1.1, 1.2, 1.3, and 1.4 represent the vNICs on port 1.
2.1, 2.2, 2.3, and 2.4 represent the vNICs on port 2, etc.
These vNIC IDs are used when adding vNICs to vNIC groups, and are shown in
some configuration and information displays.
0 0 1 x.1
2 0 2 x.2
4 0 3 x.3
6 0 4 x.4
1 1 1 x.1
3 1 2 x.2
5 1 3 x.3
7 1 4 x.4
In this, the x in the vNIC ID represents the switch port to which the NIC port is
connected.
vNIC bandwidth can be configured as a value from 1 to 100, with each unit
representing 1% (or 100Mbps) of the 10Gbps link. By default, each vNICs enabled
on a port is assigned 25 units (equal to 25% of the link, or 2.5Gbps). When traffic
from the switch to the vNIC reaches its assigned bandwidth limit, the switch will drop
packets egressing to the affected vNIC. Likewise, if traffic from the vNIC to the
switch reaches its limit, the NIC will drop egress of any further packets. When traffic
falls to less than the configured thresholds, traffic resumes at its allowed rate.
Note: Bandwidth metering drops excess packets when configured limits are
reached. Consider using the ETS feature in applications where packet loss
is not desirable (see “Enhanced Transmission Selection” on page 232).
RS G8124(config)# vnic port <port alias or number> index <vNIC number (1-4)>
RS G8124(vnic-config)# bandwidth <allocated percentage>
Note: vNICs that are disabled are automatically allocated a bandwidth value of 0.
A combined maximum of 100 units can be allocated among vNIC pipes enabled for
any specific port (bandwidth values for disabled pipes are not counted). If more than
100 units are assigned to enabled pipes, an error will be reported when attempting
to apply the configuration.
To enforce group boundaries, each vNIC group is assigned its own unique VLAN.
The vNIC group VLAN ID is placed on all vNIC group packets as an “outer” tag. As
shown in Figure 24, the outer vNIC group VLAN ID is placed on the packet in
addition to any regular VLAN tag assigned by the network, server, or hypervisor.
The outer vNIC group VLAN is used only between the G8124 and the NIC.
Figure 24. Outer and Inner VLAN Tags
Outer tag sets vNIC; Switching uses outer tag; Switch adds outer
NIC strips outer tag Ignores regular VLAN vNIC group VLAN ID
Inbound
Packet
Within the G8124, all Layer 2 switching for packets within a vNIC group is based on
the outer vNIC group VLAN. The G8124 does not consider the regular, inner VLAN
ID (if any) for any VLAN-specific operation.
The outer vNIC group VLAN is removed by the NIC before the packet reaches the
server OS or hypervisor, or by the switch before the packet egresses any switch port
which does not need it for vNIC processing.
The VLAN configured for the vNIC group will be automatically assigned to member
vNICs, ports, and trunks must not be manually configured for those elements.
Note: Once a VLAN is assigned to a vNIC group, that VLAN is used only for vNIC
purposes and is no longer available for configuration. Likewise, any VLAN
configured for regular purposes cannot be configured as a vNIC group
VLAN.
Primary
Switch Virtual Servers
NIC Hypervisor
Pipes VNIC vSwitch
VNIC
X VNIC
Group 1
X VNIC
VNIC
VM 1
Port 1 Port 10 VNIC
VM 2
VNIC
VNIC
VNIC
VNIC vSwitch
VNIC
VNIC
Group 2 X VNIC
VNIC VM 3
VM 4
Port 2 Port 11 VNIC
VNIC
VNIC
VNIC
NIC Hypervisor
To avoid disrupting vNICs that have not lost their uplinks, N/OS 7.11 and the Emulex
Virtual Fabric Adapter provide vNIC-aware failover. When a vNIC group’s uplink
ports fail, the switch cooperates with the affected NIC to prompt failover only on the
appropriate vNICs. This allows the vNICs that are not affected by the failure to
continue without disruption (see Figure 26 on page 188).
Primary Servers
Switch Virtual
NIC Hypervisor
Pipes VNIC vSwitch
VNIC
X VNIC
Group 1
X VNIC
VNIC
VM 1
VM 2
Port 1 Port 10 VNIC
VNIC
VNIC
VNIC
VNIC vSwitch
VNIC
VNIC X VNIC
VNIC VM 3
Group 2 VM 4
Port 2 Port 11 VNIC
VNIC
VNIC
VNIC
NIC Hypervisor
By default, vNIC Teaming Failover is disabled on each vNIC group, but can be
enabled or disabled independently for each vNIC group using the following
commands:
Switch 1 Servers
.1 60% VNIC
.2 40% VNIC
.3 VNIC
Port Port .4 VNIC OS or
11 1 VNIC Hypervisor
VNIC
To Switch 2 VNIC
VNIC Group 1 VNIC
.1 25% VNIC
VLAN 1000 .2 25% VNIC
.3 VNIC
Port Port .4 VNIC OS or
12 2 VNIC Hypervisor
VNIC
To Switch 2 VNIC
VNIC
VNIC Group 2
Port VLAN 1774 Port OS or
14 4 Hypervisor
To Switch 2
Port Port OS or
15 5 Hypervisor
To Switch 2
4. Configure the virtual pipes for the vNICs attached to each server port:
Note: vNICs are not supported simultaneously on the same switch ports as
VMready.
Once VLAN 1000 and 1774 are configured for vNIC groups, they will not be
available for configuration in the regular VLAN menus
(RS G8124(config)# vlan <VLAN number>).
Note: vNICs are not supported simultaneously on the same switch ports as
VMready.
6. Save the configuration.
To configure the switch for this solution, place iSCSI traffic in its own vNIC group,
comprised of the uplink port leading to the iSCSI target, and the related <port>.2
vNIC pipes connected to the participating servers. For example:
1. Define the server ports.
3. Configure the virtual pipes for the iSCSI vNICs attached to each server port:
Note: vNICs are not supported simultaneously on the same switch ports as
VMready, or on the same switch as DCBX or FCoE.
4. Add ports and virtual pipes to a vNIC group.
Ports that are not defined as server ports are automatically considered uplink ports.
VM Group Types
VEs, as well as switch server ports, switch uplink ports, static trunks, and LACP
trunks, can be placed into VM groups on the switch to define virtual communication
boundaries. Elements in a given VM group are permitted to communicate with each
other, while those in different groups are not. The elements within a VM group
automatically share certain group-level settings.
N/OS 7.11 supports up to 1024 VM groups. There are two different types:
• Local VM groups are maintained locally on the switch. Their configuration is not
synchronized with hypervisors. Of the 2048 VEs supported on the switch, up to
500 VEs may be used in local groups.
• Distributed VM groups are automatically synchronized with a virtualization man-
agement server (see “Assigning a vCenter” on page 204).
Local VM groups support limited VE migration: as VMs and other VEs move to
different hypervisors connected to different ports on the switch, the configuration of
their group identity and features moves with them. However, VE migration to and
from more distant hypervisors (those not connected to the G8124, may require
manual configuration when using local VM groups.
Use the following ISCLI configuration commands to assign group properties and
membership:
Note: Local VM groups are not supported simultaneously on the same ports as
vNICs (see “Virtual NICs” on page 181).
VM Profiles
VM profiles are required for configuring distributed VM groups. They are not used
with local VM groups. A VM profile defines the VLAN and virtual switch bandwidth
shaping characteristics for the distributed VM group. The switch distributes these
settings to the virtualization management server, which in turn distributes them to
the appropriate hypervisors for VE members associated with the group.
Creating VM profiles is a two part process. First, the VM profile is created as shown
in the following command on the switch:
Next, the profile must be edited and configured using the following configuration
commands:
For virtual switch bandwidth shaping parameters, average and peak bandwidth are
specified in kilobits per second (a value of 1000 represents 1 Mbps). Burst size is
specified in kilobytes (a value of 1000 represents 1 MB). Eshaping (egress shaping)
is used for distributed virtual switch.
Note: The bandwidth shaping parameters in the VM profile are used by the
hypervisor virtual switch software. To set bandwidth policies for individual
VEs, see “VM Policy Bandwidth Control” on page 209.
RS G8124(config)# virt vmgroup <VM group number> profile <VM profile name>
Only one VM profile can be assigned to a given distributed VM group. To change the
VM profile, the old one must first be removed using the following ISCLI configuration
command:
Note: The VM profile can be added only to an empty VM group (one that has no
VLAN, VMs, or port members). Any VM group number currently configured
for a local VM group (see “Local VM Groups” on page 195) cannot be
converted and must be deleted before it can be used for a distributed VM
group.
Assigning Members
VMs, ports, and trunks may be added to the distributed VM group only after the VM
profile is assigned. Group members are added, pre-provisioned, or removed from
distributed VM groups in the same manner as with local VM groups (“Local VM
Groups” on page 195), with the following exceptions:
• VMs: VMs and other VEs are not required to be local. Any VE known by the
virtualization management server can be part of a distributed VM group.
• The VM group vlan option (see page 196) cannot be used with distributed VM
groups. For distributed VM groups, the VLAN is assigned in the VM profile.
For VM membership changes, hypervisors modify their internal virtual switch port
groups, adding or removing server port memberships to enforce the boundaries
defined by the distributed VM groups. Virtual switch port groups created in this
fashion can be identified in the virtual management server by the name of the VM
profile, formatted as follows:
IBM_<VM profile name>
(or)
IBM_<VM profile name> <index number> (for vDS)
Adding a server host interface to a distributed VM group does not create a new port
group on the virtual switch or move the host. Instead, because the host interface
already has its own virtual switch port group on the hypervisor, the VM profile
settings are applied to its existing port group.
Note: When applying the distributed VM group configuration, the virtualization
management server and associated hypervisors must take appropriate
actions. If a hypervisor is unable to make requested changes, an error
message will be displayed on the switch. Be sure to evaluate all error
message and take the appropriate actions for the expected changes to
apply.
The VMcheck solution addresses these security concerns by validating the MAC
addresses assigned to VMs. The switch periodically sends hello messages on
server ports. These messages include the switch identifier and port number. The
hypervisor listens to these messages on physical NICs and stores the information,
which can be retrieved using the VMware Infrastructure Application Programming
Interface (VI API). This information is used to validate VM MAC addresses. Two
modes of validation are available: Basic and Advanced.
Use the following command to select the validation mode or to disable validation:
Basic Validation
The switch, using the hello message information, identifies a hypervisor port. If the
hypervisor port is found in the hello message information, it is deemed to be a
trusted port. Basic validation should be enabled when:
• A VM is added to a VM group, and the MAC address of the VM interface is in the
Layer 2 table of the switch.
• A VM interface that belongs to a VM group experiences a “source miss” i.e. is not
able to learn new MAC address.
• A trusted port goes down. Port validation must be performed to ensure that the
port does not get connected to an untrusted source when it comes back up.
Use the following command to set the action to be performed if the switch is unable
to validate the VM MAC address:
When the switch receives frames from a VM, it first validates the VM interface based
on the VM MAC address, VM Universally Unique Identifier (UUID), Switch port, and
Switch ID available in the hello message information. Only if all the four parameters
are matched, the VM MAC address is considered valid.
In advanced validation mode, if the VM MAC address validation fails, an ACL can be
automatically created to drop the traffic received from the VM MAC address on the
switch port. Use the following command to specify the number of ACLs to be
automatically created for dropping traffic:
Use the following command to set the action to be performed if the switch is unable
to validate the VM MAC address:
Command Description
Distributed port groups on a vDS are available to all hypervisors that are connected
to the vDS. Members of a single distributed port group can communicate with each
other.
Note: vDS works with ESX 4.0 or higher versions.
RS G8124# virt vmware dvswitch add <datacenter name> <dvSwitch name> [<dvSwitch-version>]
Prerequisites
Before adding a vDS on the G8124, ensure the following:
• VMware vCenter is fully installed and configured and includes a “bladevm”
administration account and a valid SSL certificate.
• A virtual distributed switch instance has been created on the vCenter. The vDS
version must be higher or the same as the hypervisor version on the hosts.
• At least two hypervisors are configured.
Guidelines
Before migrating VMs to a vDS, consider the following:
• At any one time, a VM NIC can be associated with only one virtual switch: to the
hypervisor’s virtual switch, or to the vDS.
• Management connection to the server must be ensured during the migration.
The connection is via the Service Console or the Kernel/Management Interface.
• The vDS configuration and migration can be viewed in vCenter at the following
locations:
– vDS: Home> Inventory > Networking
– vDS Hosts: Home > Inventory > Networking > vDS > Hosts
Note: These changes will not be displayed in the running configuration on the
G8124.
Assigning a vCenter
Assigning a vCenter to the switch requires the following:
• The vCenter must have a valid IPv4 address which is accessible to the switch
(IPv6 addressing is not supported for the vCenter).
• A user account must be configured on the vCenter to provide access for the
switch. The account must have (at a minimum) the following vCenter user privi-
leges:
– Network
– Host Network > Configuration
– Virtual Machine > Modify Device Settings
Once vCenter requirements are met, the following configuration command can be
used on the G8124 to associate the vCenter with the switch:
This command specifies the IPv4 address and account username that the switch
will use for vCenter access. Once entered, the administrator will be prompted to
enter the password for the specified vCenter account.
The noauth option causes to the switch to ignores SSL certificate authentication.
This is required when no authoritative SSL certificate is installed on the vCenter.
Note: By default, the vCenter includes only a self-signed SSL certificate. If using
the default certificate, the noauth option is required.
Once the vCenter configuration has been applied on the switch, the G8124 will
connect to the vCenter to collect VE information.
The switch completes a vCenter scan approximately every two minutes. Any major
changes made through the vCenter may take up to two minutes to be reflected on
the switch. However, you can force an immediate scan of the vCenter by using one
of the following ISCLI privileged EXEC commands:
VM migration requires that the target hypervisor includes all the virtual switch port
groups to which the VM connects on the source hypervisor. The VM profile export
feature can be used to distribute the associated port groups to all the potential hosts
for a given VM.
A VM profile can be exported to a host using the following ISCLI privileged EXEC
command:
RS G8124# virt vmware export <VM profile name> <host list> <virtual switch name>
The host list can include one or more target hosts, specified by host name, IPv4
address, or UUID, with each list item separated by a space.
Once executed, the requisite port group will be created on the specified virtual
switch. If the specified virtual switch does not exist on the target host, the port group
will not be created.
Undiscovered VEs are added to or removed from VM groups using the following
configuration commands:
RS G8124(config)# [no] virt vmgroup <VM group number> vm <VE MAC address>
N/OS 7.11 supports up to 127 VMAPs when the switch is operating in the Balanced
deployment mode (see “Deployment Profiles” on page 175). VMAP menus and
commands are not available in the Routing deployment mode.
Individual VMAP filters are configured in the same fashion as regular ACLs, except
that VLANs cannot be specified as a filtering criteria (unnecessary, since VMAPs
are assigned to a specific VLAN or associated with a VM group VLAN).
VMAPs are configured using the following ISCLI configuration command path:
Once a VMAP filter is created, it can be assigned or removed using the following
commands:
• For regular VLANs, use config-vlan mode:
Note: Each VMAP can be assigned to only one VLAN or VM group. However, each
VLAN or VM group may have multiple VMAPs assigned to it.
Bandwidth allocation can be defined for transmit (TX) traffic or receive (RX) traffic.
Because bandwidth allocation is specified from the perspective of the VE, the switch
command for TX Rate Control (txrate) sets the data rate to be sent from the VM to
the switch, and the RX rate sets the data rate to be received by the VM from the
switch.
The committed rate is specified in multiples of 64 kbps, from 64 to 40,000,000. The
maximum burst rate is specified as 32, 64, 128, 256, 1024, 2048, or 4096 kb. If both
the committed rate and burst are set to 0, bandwidth control will be disabled.
When txrate is specified, the switch automatically selects an available ACL for
internal use with bandwidth control. Optionally, if automatic ACL selection is not
desired, a specific ACL may be selected. If there are no unassigned ACLs available,
txrate cannot be configured.
VM Profile Bandwidth Shaping (see “VM Profiles” on page 197) is configured per
VM group and is enforced on the server by a virtual switch in the hypervisor.
Shaping is unidirectional and limits traffic transmitted from the virtual switch to the
G8124. Shaping is performed prior to transmit VM Policy Bandwidth Control. If the
egress traffic for a virtual switch port group exceeds shaping parameters, the traffic
is dropped by the virtual switch in the hypervisor. Shaping uses server CPU
resources, but prevents extra traffic from consuming bandwidth between the server
and the G8124. Shaping is not supported simultaneously on the same ports as
vNICs.
VM Policy Bandwidth Control is configured per VE, and can be set independently for
transmit traffic. Bandwidth policies are enforced by the G8124. VE traffic that
exceeds configured levels is dropped by the switch upon ingress. Setting txrate
uses ACL resources on the switch.
Local VE Information
A concise list of local VEs and pre-provisioned VEs is available with the following
ISCLI privileged EXEC command:
Number of entries: 6
~ indicates inactive VMs
0.0.0.0 indicates IP address not yet available
Note: The Index numbers shown in the VE information displays can be used to
specify a particular VE in configuration commands.
5 00:50:56:55:47:0c 17
0.0.0.0
--
6 of 6 entries printed
~ indicates inactive VMs
0.0.0.0 indicates IP Address is not available
Use the "-v -r" options to refresh data before displaying results
To view additional detail regarding any specific VE, see “vCenter VE Details” on
page 214).
If a vCenter is available, the following ISCLI privileged EXEC command displays the
name and UUID of all VMware hosts, providing an essential overview of the data
center:
Using the following command, the administrator can view more detailed vCenter
host information, including a list of virtual switches and their port groups, as well as
details for all associated VEs:
vCenter VE Details
RS G8124# show virt vmware showvm {<VM UUID>|<VM IPv4 address>|<VM name>}
----------------------------------------------------------------------
MAC Address 00:50:56:9c:21:2f
Port 4
Type Virtual Machine
VM vCenter Name halibut
VM OS hostname localhost.localdomain
VM IP Address 172.16.46.15
VM UUID 001c41f3-ccd8-94bb-1b94-6b94b03b9200
Current VM Host 172.16.46.10
Vswitch vSwitch0
Port Group BNT_Default
VLAN ID 0
When prompted, enter the user password that the switch must use for access to
the vCenter.
4. Create the VM profile.
When VMs are added, the server ports on which they appear are automatically
added to the VM group. In this example, there is no need to manually add ports
1 and 2.
Note: VM groups and vNICs (see “Virtual NICs” on page 181) are not supported
simultaneously on the same switch ports.
6. If necessary, enable VLAN tagging for the VM group:
Note: If the VM group contains ports that also exist in other VM groups, make sure
tagging is enabled in both VM groups. In this example configuration, no ports
exist in more than one VM group.
7. Save the configuration.
With server virtualization, servers capable of hosting both Fibre Channel and
Ethernet applications will provide advantages in server efficiency, particularly as
FCoE-enabled network adapters provide consolidated SAN and LAN traffic
capabilities.
The RackSwitch G8124 with IBM Networking OS 7.11 software is compliant with the
INCITS T11.3, FC-BB-5 FCoE specification.
Note: The G8124 supports up to 2048 FCoE login sessions.
In a converged multi-hop FCoE network where Fibre Channel devices are bridged
to Ethernet devices, the direct point-to-point QoS capabilities normally provided by
the Fibre Channel fabric may be lost in the transition between the different network
types. The G8124 provides a solution to overcome this.
Figure 28. A Mixed Fibre Channel and FCoE Network
Fibre
Channel LAN
Port 1
In Figure 28 on page 218, the Fibre Channel network is connected to the FCoE
network through an FCoE Forwarder (FCF). The FCF acts as a Fibre Channel
gateway to and from the FCoE network.
To block undesired or unvalidated traffic on FCoE links that exists outside the
regular Fibre Channel topology, Ethernet ports used in FCoE are configured with
Access Control Lists (ACLs) that are narrowly tailored to permit expected FCoE
traffic to and from confirmed FCFs and ENodes, and deny all other FCoE or FIP
traffic. This ensures that all FCoE traffic to an from the ENode passes through the
FCF.
Automatic FCoE-related ACLs are independent from ACLs used for typical Ethernet
purposes.
FCoE Requirements
The following are required for implementing FCoE using the RackSwitch G8124
(G8124) with N/OS 7.11 software:
• The G8124 must be connected to the Fibre Channel network through an FCF
such as a Cisco Nexus 5000 Series Switch.
• For each G8124 port participating in FCoE, the connected server must use the
supported FCoE CNA. The QLogic CNA is currently the first CNA supported for
this purpose. Also supported is the Emulex Virtual Fabric Adapter.
• CEE must be turned on (see “Turning CEE On or Off” on page 221). When CEE
is on, the DCBX, PFC, and ETS features are enabled and configured with
default FCoE settings. These features may be reconfigured, but must remain
enabled for FCoE to function.
• FIP snooping must be turned on (see “FCoE Initialization Protocol Snooping” on
page 224). When FIP snooping is turned on, the feature is enabled on all ports
by default. The administrator can disable FIP snooping on individual ports that
do not require FCoE, but FIP snooping must remain enabled on all FCoE ports
for FCoE to function.
Note: FCoE and vNICs (see “Virtual NICs” on page 181) are not supported
simultaneously on the same G8124.
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 219
Port Trunking
IBM N/OS 7.11 supports port trunking for FCoE connections. The Link Aggregation
(LAG) can be used for separate FCoE traffic, or for Ethernet and FCoE traffic. Ports
directly connected to servers cannot be combined in a LAG group.
Uplink ports, connected to the FCF, can be grouped as static or dynamic trunks.
Data Center Bridging (DCBX) is configured on a per-port basis. Each port in a trunk
must have the same ETS, PFC, and DCBX configuration. When a port ceases to be
the trunk group member, its configuration does not change.
CAUTION:
Turning CEE on will automatically change some 802.1p QoS and 802.3x
standard flow control settings on the G8124. Read the following material
carefully to determine whether you will need to take action to reconfigure
expected settings.
It is recommended that you backup your configuration prior to turning CEE on.
Viewing the file will allow you to manually re-create the equivalent configuration
once CEE is turned on, and will also allow you to recover your prior configuration if
you need to turn CEE off.
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 221
Effects on 802.1p Quality of Service
While CEE is off (the default), the G8124 allows 802.1p priority values to be used for
Quality of Service (QoS) configuration (see page 161). 802.1p QoS default settings
are shown in Table 20, but can be changed by the administrator.
When CEE is turned on, 802.1p QoS is replaced by ETS (see “Enhanced
Transmission Selection” on page 232). As a result, while CEE is turned on, the
802.1p QoS configuration commands are no longer available on the switch (the
menu is restored when CEE is turned off).
In addition, when CEE is turned on, prior 802.1p QoS settings are replaced with new
defaults designed for use with ETS priority groups (PGIDs) as shown in Table 20:
Table 20. CEE Effects on 802.1p Defaults
0 0 1 0 2 2
1 1 2 1 2 2
2 2 3 2 2 2
3 3 4 3 3 3
4 4 5 4 4 4
5 5 7 5 4 4
6 6 15 6 4 4
7 7 0 7 7 15
When CEE is on, the default ETS configuration also allocates a portion of link
bandwidth to each PGID as shown in Table 21:
Table 21. Default ETS Bandwidth Allocation
2 LAN 10%
3 SAN 50%
If the prior, non-CEE configuration used 802.1p priority values for different
purposes, or does not expect bandwidth allocation as shown in Table 21 on
page 222, when CEE is turned on, have the administrator reconfigure ETS settings
as appropriate.
When CEE is turned on, standard flow control is disabled on all ports, and in its
place, PFC (see “Priority-Based Flow Control” on page 229) is enabled on all ports
for 802.1p priority value 3. This default is chosen because priority value 3 is
commonly used to identify FCoE traffic in a CEE environment and must be
guaranteed lossless behavior. PFC is disabled for all other priority values.
Each time CEE is turned off, the prior 802.3x standard flow control settings will be
restored (including any previous changes from the defaults).
When CEE is on, PFC can be enabled only on priority value 3 and one other priority.
If flow control is required on additional priorities on any given port, consider using
standard flow control on that port, so that regardless of which priority traffic
becomes congested, a flow control frame is generated.
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 223
FCoE Initialization Protocol Snooping
FCoE Initialization Protocol (FIP) snooping is an FCoE feature. To enforce
point-to-point links for FCoE traffic outside the regular Fibre Channel topology,
Ethernet ports used in FCoE can be automatically and dynamically configured with
Access Control Lists (ACLs).
Using FIP snooping, the G8124 examines the FIP frames normally exchanged
between the FCF and ENodes to determine information about connected FCoE
devices. This information is used to create narrowly tailored ACLs that permit
expected FCoE traffic to and from confirmed Fibre Channel nodes, and deny all
other undesirable FCoE or FIP traffic.
In case of trunk groups, FIP traffic from a particular FCF can be received by any
member port on which the FCF was detected.
Note: FIP snooping requires CEE to be turned on (see “Turning CEE On or Off” on
page 221).
When FIP snooping is off, all FCoE-related ACLs generated by the feature are
removed from all switch ports.
FIP snooping configuration must be the same on all member ports in a trunk group.
If the configuration of a member port is changed, an error message, similar to the
following, will be displayed.
“FAIL: Trunk X FIP Snooping port Yand port Z need to have the same fcf
mode config”
The configuration changes are applied to all member ports in a trunk group.
RS G8124(config)# [no] fcoe fips port <port alias, number, list, or range> enable
When FIP snooping is disabled on a port, all FCoE-related ACLs on the port are
removed, and the switch will enforce no FCoE-related rules for traffic on the port.
Ports can also be specifically configured as to whether automatic FCF detection will
be used, or whether the port is connected to an FCF or ENode:
RS G8124(config)# fcoe fips port <port alias, number, list, or range> fcf-mode {auto|on|off}
When FCF mode is on, the port is assumed to be connected to a trusted FCF, and
only ACLs appropriate to FCFs will be installed on the port. When off, the port is
assumed to be connected to an ENode, and only ACLs appropriate to ENodes will
be installed. When the mode is changed (either through manual configuration or as
a result of automatic detection), the appropriate ACLs are automatically added,
removed, or changed to reflect the new FCF or ENode connection.
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 225
FCoE ACL Rules
When FIP Snooping is enabled on a port, the switch automatically installs the
appropriate ACLs to enforce the following rules for FCoE traffic:
• Ensure that FIP frames from ENodes may only be addressed to FCFs.
• Flag important FIP packets for switch processing.
• Ensure no end device uses an FCF MAC address as its source.
• Each FCoE port is assumed to be connected to an ENode and include
ENode-specific ACLs installed, until the port is either detected or configured to
be connected to an FCF.
• Ports that are configured to have FIP snooping disabled will not have any FIP or
FCoE related ACLs installed.
• Prevent transmission of all FCoE frames from an ENode prior to its successful
completion of login (FLOGI) to the FCF.
• After successful completion of FLOGI, ensure that the ENode uses only those
FCoE source addresses assigned to it by FCF.
• After successful completion of FLOGI, ensure that all ENode FCoE source
addresses originate from or are destined to the appropriate ENode port.
• After successful completion of each FLOGI, ensure that FCoE frames may only
be addressed to the FCFs that accept them.
Initially, a basic set of FCoE-related ACLs will be installed on all ports where FIP
snooping is enabled. As the switch encounters FIP frames and learns about FCFs
and ENodes that are attached or disconnect, ACLs are dynamically installed or
expanded to provide appropriate security.
When an FCoE connection logs out, or times out (if ACL timeout is enabled), the
related ACLs will be automatically removed.
FCoE-related ACLs are independent of manually configured ACLs used for regular
Ethernet purposes (see “Access Control Lists” on page 79). FCoE ACLs generally
have a higher priority over standard ACLs, and do not inhibit non-FCoE and non-FIP
traffic.
FCoE VLANs
FCoE packets to any FCF will be confined to the VLAN advertised by the FCF
(typically VLAN 1002). The appropriate VLAN must be configured on the switch with
member FCF ports and must be supported by the participating CNAs. The switch
will then automatically add ENode ports to the appropriate VLAN and enable
tagging on those ports.
Note: If using Emulex CNA, you must create the FCoE VLAN add the ENode and
FCF ports to that VLAN using the CLI.
For example:
For each ACL, the required traffic criteria are listed, along with the action taken
(permit or deny) for matching traffic. ACLs are listed in order of precedence and
evaluated in the order shown.
Operational Commands
The administrator may use the operational commands to delete FIP-related entries
from the switch.
To delete a specific FCF entry and all associated ACLs from the switch, use the
following command:
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 227
FIP Snooping Configuration
In this example, as shown in Figure 28 on page 218, FCoE devices are connected
to port 2 for the FCF device, and port 3 for an ENode. FIP snooping can be
configured on these ports using the following ISCLI commands:
1. Enable VLAN tagging on the FCoE ports:
Note: If you are using Emulex CNA BE 2 - FCoE mode, you must enable PVID
tagging on the Enode ports.
2. Place FCoE ports into a VLAN supported by the FCF and CNAs (typically
VLAN 1002):
Note: Placing ports into the VLAN (Step 2) after tagging is enabled (Step 1) helps
to ensure that their port VLAN ID (PVID) is not accidentally changed.
3. Turn CEE on.
Note: Turning CEE on will automatically change some 802.1p QoS and 802.3x
standard flow control settings and menus (see “Turning CEE On or Off” on
page 221).
4. Turn global FIP snooping on:
6. Enable FIP snooping on FCoE ports, and set the desired FCF mode:
Note: By default, FIP snooping is enabled on all ports and the FCF mode set for
automatic detection. The configuration in this step is unnecessary, if
default settings have not been changed, and is shown merely as a manual
configuration example.
7. Save the configuration.
PFC pauses traffic based on 802.1p priority values in the VLAN tag. The
administrator can assign different priority values to different types of traffic and then
enable PFC for up to two specific priority values: priority value 3, and one other. The
configuration can be applied globally for all ports on the switch. Then, when traffic
congestion occurs on a port (caused when ingress traffic exceeds internal buffer
thresholds), only traffic with priority values where PFC is enabled is paused. Traffic
with priority values where PFC is disabled proceeds without interruption but may be
subject to loss if port ingress buffers become full.
For FCoE, standard flow control would pause both SAN and LAN traffic during
congestion. While this approach would limit SAN traffic loss, it could degrade the
performance of some LAN applications that expect to handle congestion by
dropping traffic. PFC resolves these FCoE flow control issues. Different types of
SAN and LAN traffic can be assigned different IEEE 802.1p priority values. PFC can
then be enabled for priority values that represent SAN and LAN traffic that must be
paused during congestion, and disabled for priority values that represent LAN traffic
that is more loss-tolerant.
PFC requires CEE to be turned on (“Turning CEE On or Off” on page 221). When
CEE is turned on, PFC is enabled on priority value 3 by default. Optionally, the
administrator can also enable PFC on one other priority value, providing lossless
handling for another traffic type, such as for a business-critical LAN application.
Note: For any given port, only one flow control method can be implemented at any
given time: either PFC or standard IEEE 802.3x flow control.
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 229
Global Configuration
PFC requires CEE to be turned on (“Turning CEE On or Off” on page 221). When
CEE is turned on, standard flow control is disabled on all ports, and PFC is enabled
on all ports for 802.1p priority value 3. While CEE is turned on, PFC cannot be
disabled for priority value 3. This default is chosen because priority value 3 is
commonly used to identify FCoE traffic in a CEE environment and must be
guaranteed lossless behavior. PFC is disabled for all other priority values by default,
but can be enabled for one additional priority value.
• Global PFC configuration is preferable in networks that implement end-to-end
CEE devices. For example, if all ports are involved with FCoE and can use the
same SAN and LAN priority value configuration with the same PFC settings,
global configuration is easy and efficient.
• Global PFC configuration can also be used in some mixed environments where
traffic with PFC-enabled priority values occurs only on ports connected to CEE
devices, and not on any ports connected to non-CEE devices. In such cases,
PFC can be configured globally on specific priority values even though not all
ports make use them.
• PFC is not restricted to CEE and FCoE networks. In any LAN where traffic is
separated into different priorities, PFC can be enabled on priority values for
loss-sensitive traffic.
• If you want to enable PFC on a priority, add the priority to a priority group with the
same number. For example, if you want to enable PFC on priority 0, you must
map priority 0 to PG 0.
Note: When using global PFC configuration in conjunction with the ETS feature
(see “Enhanced Transmission Selection” on page 232), ensure that only
pause-tolerant traffic (such as lossless FCoE traffic) is assigned priority
values where PFC is enabled. Pausing other types of traffic can have
adverse effects on LAN applications that expect uninterrupted traffic flow
and tolerate dropping packets during congestion.
This example is consistent with the network shown in Figure 28 on page 218. In this
example, the following topology is used.
Table 22. PFC Configuration
3 FCoE Enabled
In this example, PFC is to facilitate lossless traffic handling for FCoE (priority value
3) and a business-critical LAN application (priority value 4).
Assuming that CEE is off (the G8124 default), the example topology shown in the
table above can be configured using the following commands:
1. Turn CEE on.
Note: Turning CEE on will automatically change some 802.1p QoS and 802.3x
standard flow control settings and menus (see “Turning CEE On or Off” on
page 221).
2. Enable PFC for the FCoE traffic.
Note: PFC is enabled on priority 3 by default. If using the defaults, the manual
configuration commands shown in this step are not necessary.
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 231
Enhanced Transmission Selection
Enhanced Transmission Selection (ETS) is defined in IEEE 802.1Qaz. ETS
provides a method for allocating port bandwidth based on 802.1p priority values in
the VLAN tag. Using ETS, different amounts of link bandwidth can specified for
different traffic types (such as for LAN, SAN, and management).
The ETS feature requires CEE to be turned on (see “Turning CEE On or Off” on
page 221).
0 15 16 32
Servers and other network devices may be configured to assign different priority
values to packets belonging to different traffic types (such as SAN and LAN).
ETS uses the assigned 802.1p priority values to identify different traffic types. The
various priority values are assigned to priority groups (PGID), and each priority
group is assigned a portion of available link bandwidth.
Priorities values within in any specific ETS priority group are expected to have
similar traffic handling requirements with respect to latency and loss.
802.1p Bandwidth
Typical Traffic Type PGID
Priority Allocation
LAN 0
LAN 1 2 10%
LAN 2
SAN 3 3 50%
Latency-Sensitive LAN 4
Latency-Sensitive LAN 5 4 40%
Latency-Sensitive LAN 6
Network Management 7 15 -
Because CEE and ETS features are generally associated with FCoE, Priority 3 is
typically used to identify FCoE (SAN) traffic.
Priorities 4-7 are typically used for latency sensitive traffic and other important
business applications. For example, priority 4 and 5 are often used for video and
voice applications such as IPTV, Video on Demand (VoD), and Voice over IP (VoIP).
Priority 6 and 7 are often used for traffic characterized with a “must get there”
requirement, with priority 7 used for network control which is requires guaranteed
delivery to support configuration and maintenance of the network infrastructure.
Note: The default assignment of 802.1p priority values on the G8124 changes
depending on whether CEE is on or off. See “Turning CEE On or Off” on
page 221 for details.
Priority Groups
For ETS use, each 801.2p priority value is assigned to a priority group which can
then be allocated a specific portion of available link bandwidth. To configure a
priority group, the following is required:
• CEE must be turned on (“Turning CEE On or Off” on page 221) for the ETS
feature to function.
• A priority group must be assigned a priority group ID (PGID), one or more 802.1p
priority values, and allocated link bandwidth greater than 9%.
PGID
Each priority group is identified with number (0 through 7, and 15) known as the
PGID.
PGID 15 is a strict priority group. It is generally used for critical traffic, such as
network management. Any traffic with priority values assigned to PGID 15 is
permitted as much bandwidth as required, up to the maximum available on the
switch. After serving PGID 15, any remaining link bandwidth is shared among the
other groups, divided according to the configured bandwidth allocation settings.
Make sure all 802.1p priority values assigned to a particular PGID have similar
traffic handling requirements. For example, PFC-enabled traffic must not be
grouped with non-PFC traffic. Also, traffic of the same general type must be
assigned to the same PGID. Splitting one type of traffic into multiple 802.1p
priorities, and then assigning those priorities to different PGIDs may result in
unexpected network behavior.
Each 802.1p priority value may be assigned to only one PGID. However, each PGID
may include multiple priority values. Up to eight PGIDs may be configured at any
given time. However, no more than three ETS Priority Groups may include priority
values for which PFC is disabled.
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 233
Assigning Priority Values to a Priority Group
Each priority group may be configured from its corresponding ETS Priority Group,
available using the following command:
RS G8124(config)# cee global ets priority-group pgid <group number (0-7, or 15)> priority
<priority list>
where priority list is one or more 802.1p priority values (with each separated by a
comma). For example, to assign priority values 0 through 2:
RS G8124(config)# cee global ets priority-group pgid <group number (0-7, or 15)> priority
0,1,2
Note: Within any specific PGID, the PFC settings (see “Priority-Based Flow
Control” on page 229) must be the same (enabled or disabled) for all priority
values within the group. PFC can be enabled only on priority value 3 and one
other priority. If the PFC setting is inconsistent within a PGID, an error is
reported when attempting to apply the configuration. Also, no more than
three ETS Priority Groups may include priority values for which PFC is
disabled.
When assigning priority values to a PGID, the specified priority value will be
automatically removed from its old group and assigned to the new group when the
configuration is applied.
Each priority value must be assigned to a PGID. Priority values may not be deleted
or unassigned. To remove a priority value from a PGID, it must be moved to another
PGID.
For PGIDs 0 through 7, bandwidth allocation can also be configured through the
ETS Priority Group menu. See for “Allocating Bandwidth” on page 235 for details.
RS G8124(config)# cee global ets priority-group pgid <priority group number> bandwidth
<bandwidth allocation> pgid
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 235
Configuring ETS
Consider an example consistent with that used forPFC configuration (on
page 231):1
Table 23. ETS Configuration
5 Latency-sensitive LAN
5 40%
6 Latency-sensitive LAN
The example shown in Table 23 is only slightly different than the default
configuration shown in Figure 29 on page 232. In this example, latency-sensitive
LAN traffic (802.1p priority 5 through 6) are moved from priority group 4 to priority
group 5. This leaves Business Critical LAN traffic (802.1p priority 4) in priority group
4 by itself. Also, a new group for network management traffic has been assigned.
Finally, the bandwidth allocation for priority groups 3, 4, and 5 are revised.
Note: DCBX may be configured to permit sharing or learning PFC configuration
with or from external devices. This example assumes that PFC configuration
is being performed manually. See “Data Center Bridging Capability
Exchange” on page 239 for more information on DCBX.
Note: Turning CEE on will automatically change some 802.1p QoS and 802.3x
standard flow control settings and menus (see “Turning CEE On or Off” on
page 221).
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 237
RS G8124(config)# show cee global pfc
PFC - ON
The DCBX feature requires CEE to be turned on (see “Turning CEE On or Off” on
page 221).
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 239
DCBX Settings
When CEE is turned on, DCBX is enabled for peer information exchange on all
ports. For configuration negotiation, the following default settings are configured:
• Application Protocol: FCoE and FIP snooping is set for traffic with 802.1p priority
3
• PFC: Enabled on 802.1p priority 3
• ETS
– Priority group 2 includes priority values 0 through 2, with bandwidth
allocation of 10%
– Priority group 3 includes priority value 3, with bandwidth allocation of 50%
– Priority group 4 includes priority values 4 through 7, with bandwidth
allocation of 40%
When CEE is turned on, DCBX can be enabled and disabled on a per-port basis,
using the following commands:
Note: DCBX and vNICs (see “Virtual NICs” on page 181) are not supported
simultaneously on the same G8124.
When DCBX is enabled on a port, Link Layer Detection Protocol (LLDP) is used to
exchange DCBX parameters between CEE peers. Also, the interval for LLDP
transmission time is set to one second for the first five initial LLDP transmissions,
after which it is returned to the administratively configured value. The minimum
delay between consecutive LLDP frames is also set to one second as a DCBX
default.
CEE peer configuration negotiation can be set on a per-port basis for a number of
CEE features. For each supported feature, the administrator can configure two
independent flags:
• The advertise flag
When this flag is set for a particular feature, the switch settings will be transmit to
the remote CEE peer. If the peer is capable of the feature, and willing to accept
the G8124 settings, it will be automatically reconfigured to match the switch.
• The willing flag
Set this flag when required by the remote CEE peer for a particular feature as
part of DCBX signaling and support. Although some devices may also expect
this flag to indicate that the switch will accept overrides on feature settings, the
G8124 retains its configured settings. As a result, the administrator must
configure the feature settings on the switch to match those expected by the
remote CEE peer.
RS G8124(config)# [no] cee port <port alias or number> dcbx app_proto advertise
RS G8124(config)# [no] cee port <port alias or number> dcbx app_proto willing
• PFC
DCBX exchanges information regarding whether PFC is enabled or disabled on
the port. The advertise flag is set or reset using the following command:
RS G8124(config)# [no] cee port <port alias or number> dcbx pfc advertise
RS G8124(config)# [no] cee port <port alias or number> dcbx pfc willing
• ETS
DCBX exchanges information regarding ETS priority groups, including their
802.1p priority members and bandwidth allocation percentages. The
advertise flag is set or reset using the following command:
RS G8124(config)# [no] cee port <port alias or number> dcbx ets advertise
RS G8124(config)# [no] cee port <port alias or number> dcbx pfc willing
© Copyright IBM Corp. 2014 Chapter 16: FCoE and CEE 241
Configuring DCBX
Consider an example consistent Figure 28 on page 218 and used with the previous
FCoE examples in this chapter:
• FCoE is used on ports 2 and 3.
• CEE features are also used with LANs on ports 1 and 4.
• All other ports are disabled or are connected to regular (non-CEE) LAN devices.
In this example, the G8124 acts as the central point for CEE configuration.
FCoE-related ports will be configured for advertising CEE capabilities, but not to
accept external configuration. Other LAN ports that use CEE features will also be
configured to advertise feature settings to remote peers, but not to accept external
configuration. DCBX will be disabled on all non-CEE ports.
Note: Turning CEE on will automatically change some 802.1p QoS and 802.3x
standard flow control settings and menus (see “Turning CEE On or Off” on
page 221).
2. Enable desired DCBX configuration negotiation on FCoE ports:
The combination of faster routing and switching in a single device allows you to
build versatile topologies that account for legacy configurations.
For example, consider a corporate campus that has migrated from a router-centric
topology to a faster, more powerful, switch-based topology. As is often the case, the
legacy of network growth and redesign has left the system with a mix of illogically
distributed subnets.
This is a situation that switching alone cannot cure. Instead, the router is flooded
with cross-subnet communication. This compromises efficiency in two ways:
• Routers can be slower than switches. The cross-subnet side trip from the switch
to the router and back again adds two hops for the data, slowing throughput
considerably.
• Traffic to the router increases, increasing congestion.
Even if every end-station could be moved to better logical subnets (a daunting task),
competition for access to common server pools on different subnets still burdens the
routers.
IF 1
VLAN 1
IF 2 IF 4
VLAN 2 VLAN 4
IF 3
VLAN 3
Server subnet 2:
131.15.15.2-254
The switch connects the Gigabit Ethernet and Fast Ethernet trunks from various
switched subnets throughout one building. Common servers are placed on another
subnet attached to the switch. A primary and backup router are attached to the
switch on yet another subnet.
With Layer 3 IP routing in place on the switch, routing between different IP subnets
can be accomplished entirely within the switch. This leaves the routers free to
handle inbound and outbound traffic for this group of subnets.
Configuration Example
This section describes the steps used to configure the example topology shown in
Figure 30 on page 247.
1. Assign an IP address (or document the existing one) for each router and each
server.
The following IP addresses are used:
Default router 1 22 1
Note: To perform this configuration, you must be connected to the switch Industry
Standard Command Line Interface (ISCLI) as the administrator.
RS G8124(config)# vlan 1
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 22 (Add ports to VLAN 1)
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 1
RS G8124(config-if)# exit
RS G8124(config)# vlan 2
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 1,2 (Add ports to VLAN 2)
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 2
RS G8124(config-if)# exit
RS G8124(config)# vlan 3
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 3,4 (Add ports to VLAN 3)
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 3
RS G8124(config-if)# exit
RS G8124(config)# vlan 4
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 5,6 (Add ports to VLAN 4)
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 4
RS G8124(config-if)# exit
Each time you add a port to a VLAN, you may get the following prompt:
7. Enable IP routing.
RS G8124(config)# ip routing
Examine the resulting information. If any settings are incorrect, make the
appropriate changes.
2. Add another static route with the same IP address and mask, but a different
gateway address.
Use the following commands to check the status of ECMP static routes:
The switch accepts gateway configuration parameters if they have not been
configured manually. The switch ignores DHCP gateway parameters if the gateway
is configured.
DHCP is described in RFC 2131, and the DHCP relay agent supported on the
G8124 is described in RFC 1542. DHCP uses UDP as its transport protocol. The
client sends messages to the server on port 67 and the server sends messages to
the client on port 68.
DHCP defines the methods through which clients can be assigned an IP address for
a finite lease period and allowing reassignment of the IP address to another client
later. Additionally, DHCP provides the mechanism for a client to gather other IP
configuration parameters it needs to operate in the TCP/IP network.
In the DHCP environment, the G8124 acts as a relay agent. The DHCP relay feature
enables the switch to forward a client request for an IP address to two BOOTP
servers with IP addresses that have been configured on the switch.
When a switch receives a UDP broadcast on port 67 from a DHCP client requesting
an IP address, the switch acts as a proxy for the client, replacing the client source IP
(SIP) and destination IP (DIP) addresses. The request is then forwarded as a UDP
Unicast MAC layer message to two BOOTP servers whose IP addresses are
configured on the switch. The servers respond as a UDP Unicast message back to
the switch, with the default gateway and IP address for the client. The destination IP
address in the server response represents the interface address on the switch that
received the client request. This interface address tells the switch on which VLAN to
send the server response to the client.
To enable the G8124 to be the BOOTP forwarder, you need to configure the
DHCP/BOOTP server IP addresses on the switch. Generally, it is best tomust
configure the switch IP interface on the client side to match the client’s subnet, and
configure VLANs to separate client and server subnets. The DHCP server knows
from which IP subnet the newly allocated IP address will come.
Use the following commands to configure the switch as a DHCP relay agent:
However, G8124 ports can also be configured as routed ports. Routed ports are
configured with their own IP address belonging to a unique Layer 3 network, and
behave similar to a port on a conventional router. Routed ports are typically used for
connecting to a server or to a router.
When a switch port is configured as a routed port, it forwards Layer 3 traffic and no
longer performs Layer 2 switching functions.
Overview
A routed port has the following characteristics:
• Does not participate in bridging.
• Does not belong to any user-configurable VLAN.
• Does not implement any Layer 2 functionality, such as Spanning Tree Protocol
(STP).
• Is always in a forwarding state.
• Can participate in IPv4 routing.
• Can be configured with basic IP protocols, such as Internet Control Message
Protocol (ICMP), and with Layer 3 protocols, such as Protocol-Independent
Multicast (PIM), Routing Information Protocol (RIP), Open Shortest Path First
(OSPF), and Border Gateway Protocol (BGP).
• Can be configured with Internet Group Management Protocol (IGMP) querier
and snooping functionality.
• Layer 3 configuration is saved even when the interface is shutdown.
• MAC address learning is always enabled.
• Tagging and port VLAN ID (PVID) tagging is disabled.
• Flooding is disabled.
• Bridge Protocol Data Unit (BPDU)-guard is disabled.
• Link Aggregation Control Protocol (LACP) is disabled.
• Multicast threshold is disabled.
• Static Multicast MAC and static unicast MAC can be configured.
Note: Ports that have Static MAC addresses configured cannot be changed to
routed ports.
Note: The maximum number of VLANs you can configure on the RackSwitch
G8124 is 4095. This maximum number will be reduced by the number of
routed ports you configure.
• All the Layer 2 configuration is lost.
When a routed port is changed back to a switch port, the following changes take
place:
• All the IP configuration is lost.
• The ARP entry corresponding to the IP address is lost.
• The switch port is added to the default VLAN and STG. In case of MSTP, it is
added to the CIST.
• STP is turned on.
• The switch port can participate in STG and VLAN flooding.
• Can participate in bridging.
• LACP port attributes are set to default.
• Multicast threshold remains disabled.
• BPDU guard remains disabled.
• IGMP configuration is lost.
Note: When you configure a routed port to back to a switch port, it does not restore
the Layer 2 configuration it had before it was changed to a routed port.
Note: You must enter only one port number. If you need to change multiple ports
to routed ports, repeat the configuration steps for each port.
2. Enable routing.
RS G8124(config-if)# no switchport
3. Assign an IP address.
RS G8124(config-if)# ip {<ospf>|<pim>|<rip>}
RS G8124(config-if)# ip ospf ?
See Chapter 25, “OSPF for details on the OSPF protocol and its configuration.
RS G8124(config-if)# ip rip ?
See Chapter 21, “Routing Information Protocol for details on the RIP protocol and its
configuration.
RS G8124(config-if)# ip pim ?
See Chapter 26, “Protocol Independent Multicast for details on the PIM protocol and
its configuration.
To configure IGMP snooping on a routed port, enter the following command in the
Global Configuration mode:
To configure fastleave on routed ports, enter the following command in the Global
Configuration mode:
This chapter describes the basic configuration of IPv6 addresses and how to
manage the switch via IPv6 host management.
IPv6 Limitations
The following IPv6 features are not supported in this release.
• Dynamic Host Control Protocol for IPv6 (DHCPv6)
• Border Gateway Protocol for IPv6 (BGP)
• Routing Information Protocol for IPv6 (RIPng)
Unlike IPv4, a subnet mask is not used for IPv6 addresses. IPv6 uses the subnet
prefix as the network identifier. The prefix is the part of the address that indicates the
bits that have fixed values or are the bits of the subnet prefix. An IPv6 prefix is
written in address/prefix-length notation. For example, in the following address, 64
is the network prefix:
21DA:D300:0000:2F3C::/64
Most IBM N/OS 7.11 features permit IP addresses to be configured using either
IPv4 or IPv6 address formats. Throughout this manual, IP address is used in places
where either an IPv4 or IPv6 address is allowed. In places where only one type of
address is allowed, the type (IPv4 or IPv6 is specified.
Unicast Address
Multicast
The following well-known multicast addresses are pre-defined. The group IDs
defined in this section are defined for explicit scope values, as follows:
FF00:::::::0 through FF0F:::::::0
Anycast
Packets sent to an anycast address or list of addresses are delivered to the nearest
interface identified by that address. Anycast is a communication between a single
sender and a list of addresses.
Anycast addresses are allocated from the unicast address space, using any of the
defined unicast address formats. Thus, anycast addresses are syntactically
indistinguishable from unicast addresses. When a unicast address is assigned to
more than one interface, thus turning it into an anycast address, the nodes to which
the address is assigned must be explicitly configured to know that it is an anycast
address.
© Copyright IBM Corp. 2014 Chapter 19: Internet Protocol Version 6 265
IPv6 Address Autoconfiguration
IPv6 supports the following types of address autoconfiguration:
• Stateful address configuration
Address configuration is based on the use of a stateful address configuration
protocol, such as DHCPv6, to obtain addresses and other configuration options.
• Stateless address configuration
Address configuration is based on the receipt of Router Advertisement
messages that contain one or more Prefix Information options.
You can manually configure two IPv6 addresses for each interface, as follows:
• Initial IPv6 address is a global unicast or anycast address.
Note that you cannot configure both addresses as anycast. If you configure an
anycast address on the interface you must also configure a global unicast
address on that interface.
• Second IPv6 address can be a unicast or anycast address.
Each IPv6 interface can belong to only one VLAN. Each VLAN can support only one
IPv6 interface. Each VLAN can support multiple IPv4 interfaces.
IPv6 gateway 1 is reserved for IPv6 data interfaces. IPv6 gateway 4 is the default
IPv6 management gateway.
© Copyright IBM Corp. 2014 Chapter 19: Internet Protocol Version 6 267
Neighbor Discovery
Neighbor Discovery Overview
The switch uses Neighbor Discovery protocol (ND) to gather information about other
router and host nodes, including the IPv6 addresses. Host nodes use ND to
configure their interfaces and perform health detection. ND allows each node to
determine the link-layer addresses of neighboring nodes, and to keep track of each
neighbor’s information. A neighboring node is a host or a router that is linked directly
to the switch. The switch supports Neighbor Discovery as described in RFC 4861.
To add or remove entries in the static neighbor cache, use the following command
path:
Each IPv6 interface can be configured as a router node or a host node, as follows:
• A router node’s IP address is configured manually. Router nodes can send
Router Advertisements.
• A host node’s IP address can be autoconfigured. Host nodes listen for Router
Advertisements that convey information about devices on the network.
Note: When IP forwarding is turned on, all IPv6 interfaces configured on the switch
can forward packets.
You can configure each IPv6 interface as either a host node or a router node. You
can manually assign an IPv6 address to an interface in host mode, or the interface
can be assigned an IPv6 address by an upstream router, using information from
router advertisements to perform stateless auto-configuration.
© Copyright IBM Corp. 2014 Chapter 19: Internet Protocol Version 6 269
Supported Applications
The following applications have been enhanced to provide IPv6 support.
• Ping
The ping command supports IPv6 addresses. Use the following format to ping
an IPv6 address:
ping <host name>|<IPv6 address> [-n <tries (0-4294967295)>]
[-w <msec delay (0-4294967295)>] [-l <length (0/32-65500/2080)>]
[-s <IP source>] [-v <TOS (0-255)>] [-f] [-t]
To ping a link-local address (begins with FE80), provide an interface index, as
follows:
ping <IPv6 address>%<Interface index> [-n <tries (0-4294967295)>]
[-w <msec delay (0-4294967295)>] [-l <length (0/32-65500/2080)>]
[-s <IP source>] [-v <TOS (0-255)>] [-f] [-t]
• Traceroute
The traceroute command supports IPv6 addresses (but not link-local
addresses).
Use the following format to perform a traceroute to an IPv6 address:
traceroute <host name>| <IPv6 address> [<max-hops (1-32)>
[<msec delay (1-4294967295)>]]
• Telnet server
The telnet command supports IPv6 addresses (but not link-local addresses).
Use the following format to Telnet into an IPv6 interface on the switch:
telnet <host name>| <IPv6 address> [<port>]
• Telnet client
The telnet command supports IPv6 addresses (but not link-local addresses).
Use the following format to Telnet to an IPv6 address:
telnet <host name>| <IPv6 address> [<port>]
• HTTP/HTTPS
The HTTP/HTTPS servers support both IPv4 and IPv6 connections.
• SSH
Secure Shell (SSH) connections over IPv6 are supported (but not link-local
addresses). The following syntax is required from the client:
ssh -u <IPv6 address>
Example:
ssh -u 2001:2:3:4:0:0:0:142
• TFTP
The TFTP commands support both IPv4 and IPv6 addresses. Link-local
addresses are not supported.
• FTP
The FTP commands support both IPv4 and IPv6 addresses. Link-local
addresses are not supported.
If you set the request version to ipv4, the DNS application sends an A query
first, to resolve the hostname with an IPv4 address. If no A record is found for
that hostname (no IPv4 address for that hostname) an AAAA query is sent to
resolve the hostname with a IPv6 address.
If you set the request version to ipv6, the DNS application sends an AAAA query
first, to resolve the hostname with an IPv6 address. If no AAAA record is found
for that hostname (no IPv6 address for that hostname) an A query is sent to
resolve the hostname with an IPv4 address.
Configuration Guidelines
When you configure an interface for IPv6, consider the following guidelines:
• Support for subnet router anycast addresses is not available.
• A single interface can accept either IPv4 or IPv6 addresses, but not both IPv4
and IPv6 addresses.
• A single interface can accept multiple IPv6 addresses.
• A single interface can accept only one IPv4 address.
• If you change the IPv6 address of a configured interface to an IPv4 address, all
IPv6 settings are deleted.
• A single VLAN can support only one IPv6 interface.
• Health checks are not supported for IPv6 gateways.
• IPv6 interfaces support Path MTU Discovery. The CPU’s MTU is fixed at 1500
bytes.
• Support for jumbo frames (1,500 to 9,216 byte MTUs) is limited. Any jumbo
frames intended for the CPU must be fragmented by the remote node. The
switch can re-assemble fragmented packets up to 9k. It can also fragment and
transmit jumbo packets received from higher layers.
© Copyright IBM Corp. 2014 Chapter 19: Internet Protocol Version 6 271
IPv6 Configuration Examples
This section provides steps to configure IPv6 on the switch.
IPv6 Example 1
The following example uses IPv6 host mode to autoconfigure an IPv6 address for
the interface. By default, the interface is assigned to VLAN 1.
1. Enable IPv6 host mode on an interface.
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip6host
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
IPv6 Example 2
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# ipv6 address 2001:BA98:7654:BA98:FEDC:1234:ABCD:5214
RS G8124(config-ip-if)# ipv6 prefixlen 64
RS G8124(config-ip-if)# ipv6 seccaddr6 2003::1 32
RS G8124(config-ip-if)# vlan 2
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
The secondary IPv6 address is compressed, and the prefix length is 32.
2. Configure the IPv6 default gateway.
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# no ipv6 nd suppress-ra
Since IPsec was implemented in conjunction with IPv6, all implementations of IPv6
must contain IPsec. To support the National Institute of Standards and Technology
(NIST) recommendations for IPv6 implementations, IBM Networking OS IPv6
feature compliance has been extended to include the following IETF RFCs, with an
emphasis on IP Security (IPsec) and Internet Key Exchange version 2, and
authentication/confidentiality for OSPFv3:
• RFC 4301 for IPv6 security
• RFC 4302 for the IPv6 Authentication Header
• RFCs 2404, 2410, 2451, 3602, and 4303 for IPv6 Encapsulating Security
Payload (ESP), including NULL encryption, CBC-mode 3DES and AES ciphers,
and HMAC-SHA-1-96.
• RFCs 4306, 4307, 4718, and 4835 for IKEv2 and cryptography
• RFC 4552 for OSPFv3 IPv6 authentication
• RFC 5114 for Diffie-Hellman groups
Note: This implementation of IPsec supports DH groups 1, 2, 5, 14, and 24.
© Copyright IBM Corp. 2014 Chapter 20: IPsec with IPv6 273
IPsec Protocols
The IBM N/OS implementation of IPsec supports the following protocols:
• Authentication Header (AH)
AHs provide connectionless integrity outand data origin authentication for IP
packets, and provide protection against replay attacks. In IPv6, the AH protects
the AH itself, the Destination Options extension header after the AH, and the IP
payload. It also protects the fixed IPv6 header and all extension headers before
the AH, except for the mutable fields DSCP, ECN, Flow Label, and Hop Limit. AH
is defined in RFC 4302.
• Encapsulating Security Payload (ESP)
ESPs provide confidentiality, data origin authentication, integrity, an anti-replay
service (a form of partial sequence integrity), and some traffic flow confidentiality.
ESPs may be applied alone or in combination with an AH. ESP is defined in RFC
4303.
• Internet Key Exchange Version 2 (IKEv2)
IKEv2 is used for mutual authentication between two network elements. An IKE
establishes a security association (SA) that includes shared secret information to
efficiently establish SAs for ESPs and AHs, and a set of cryptographic algorithms
to be used by the SAs to protect the associated traffic. IKEv2 is defined in RFC
4306.
Using IKEv2 as the foundation, IPsec supports ESP for encryption and/or
authentication, and/or AH for authentication of the remote partner.
Both ESP and AH rely on security associations. A security association (SA) is the
bundle of algorithms and parameters (such as keys) that encrypt and authenticate a
particular flow in one direction.
The security protocol for the session key is either ESP or AH. Outgoing packets are
labeled with the SA SPI (Security Parameter Index), which the remote device will
use in its verification and decryption process.
Every outgoing IPv6 packet is checked against the IPsec policies in force. For each
outbound packet, after the packet is encrypted, the software compares the packet
size with the MTU size that it either obtains from the default minimum maximum
transmission unit (MTU) size (1500) or from path MTU discovery. If the packet size
is larger than the MTU size, the receiver drops the packet and sends a message
containing the MTU size to the sender. The sender then fragments the packet into
smaller pieces and retransmits them using the correct MTU size.
The maximum traffic load for each IPsec packet is limited to the following:
• IKEv2 SAs: 5
• IPsec SAs: 10 (5 SAs in each direction)
• SPDs: 20 (10 policies in each direction)
Setting up Authentication
Before you can use IPsec, you need to have key policy authentication in place.
There are two types of key policy authentication:
• Preshared key (default)
The parties agree on a shared, secret key that is used for authentication in an
IPsec policy. During security negotiation, information is encrypted before
transmission by using a session key created by using a Diffie-Hellman
calculation and the shared, secret key. Information is decrypted on the receiving
end using the same key. One IPsec peer authenticates the other peer's packet
by decryption and verification of the hash inside the packet (the hash inside the
packet is a hash of the preshared key). If authentication fails, the packet is
discarded.
• Digital certificate (using RSA algorithms)
The peer being validated must hold a digital certificate signed by a trusted
Certificate Authority and the private key for that digital certificate. The side
performing the authentication only needs a copy of the trusted certificate
authorities digital certificate. During IKEv2 authentication, the side being
validated sends a copy of the digital certificate and a hash value signed using the
private key. The certificate can be either generated or imported.
Note: During the IKEv2 negotiation phase, the digital certificate takes precedence
over the preshared key.
© Copyright IBM Corp. 2014 Chapter 20: IPsec with IPv6 275
Creating an IKEv2 Proposal
With IKEv2, a single policy can have multiple encryption and authentication types,
as well as multiple integrity algorithms.
Source file name: <path and filename of host private key file>
Port type ["DATA"/"MGT"]: >
Confirm download operation [y/n]: y
Note: When prompted for the port to use for download the file, if you used a
management port to connect the switch to the server, enter mgt, otherwise
enter data.
© Copyright IBM Corp. 2014 Chapter 20: IPsec with IPv6 277
Setting Up a Key Policy
When configuring IPsec, you must define a key policy. This key policy can be either
manual or dynamic. Either way, configuring a policy involves the following steps:
• Create a transform set—This defines which encryption and authentication algo-
rithms are used.
• Create a traffic selector—This describes the packets to which the policy applies.
• Establish an IPsec policy.
• Apply the policy.
1. To define which encryption and authentication algorithms are used, create a
transform set:
3. To describe the packets to which this policy applies, create a traffic selector
using the following command:
© Copyright IBM Corp. 2014 Chapter 20: IPsec with IPv6 279
Note: When configuring a manual policy ESP, the ESP authenticator key is
optional.
Note: If using third-party switches, the IPsec manual policy session key must be of
fixed length as follows:
For AH key: SHA1 is 20 bytes; MD5 is 16 bytes
For ESP cipher key: 3DES is 24 bytes; AES-cbc is 24 bytes; DES is 8 bytes
For ESP auth key: SHA1 is 20 bytes; MD5 is 16 bytes
3. After you configure the IPSec policy, you need to apply it to the interface to
enforce the security policies on that interface and save it to keep it in place after
a reboot. To accomplish this, enter:
© Copyright IBM Corp. 2014 Chapter 20: IPsec with IPv6 281
282 RackSwitch G8124: Application Guide
Chapter 21. Routing Information Protocol
In a routed environment, routers communicate with one another to keep track of
available routes. Routers can learn about available routes dynamically using the
Routing Information Protocol (RIP). IBM Networking OS software supports RIP
version 1 (RIPv1) and RIP version 2 (RIPv2) for exchanging TCP/IPv4 route
information with other routers.
Note: IBM N/OS 7.11 does not support IPv6 for RIP.
When a switch receives a routing update that contains a new or changed destination
network entry, the switch adds 1 to the metric value indicated in the update and
enters the network in the routing table. The IPv4 address of the sender is used as
the next hop.
Stability
RIP includes a number of other stability features that are common to many routing
protocols. For example, RIP implements the split horizon and hold-down
mechanisms to prevent incorrect routing information from being propagated.
RIP is often used in stub networks and in small autonomous systems that do not
have many redundant paths.
For more information, see the Configuration section, Routing Information Protocol
Configuration in the IBM Networking OS Command Reference.
RIPv1
RIP version 1 use broadcast User Datagram Protocol (UDP) data packets for the
regular routing updates. The main disadvantage is that the routing updates do not
carry subnet mask information. Hence, the router cannot determine whether the
route is a subnet route or a host route. It is of limited usage after the introduction of
RIPv2. For more information about RIPv1 and RIPv2, refer to RFC 1058 and RFC
2453.
RIPv2
RIPv2 is the most popular and preferred configuration for most networks. RIPv2
expands the amount of useful information carried in RIP messages and provides a
measure of security. For a detailed explanation of RIPv2, refer to RFC 1723 and
RFC 2453.
RIPv2 improves efficiency by using multicast UDP (address 224.0.0.9) data packets
for regular routing updates. Subnet mask information is provided in the routing
updates. A security option is added for authenticating routing updates, by using a
shared password. N/OS supports using clear password for RIPv2.
© Copyright IBM Corp. 2014 Chapter 21: Routing Information Protocol 285
RIP Configuration Example
The following is an example of RIP configuration.
Note: An interface RIP disabled uses all the default values of the RIP, no matter
how the RIP parameters are configured for that interface. RIP sends out RIP
regular updates to include an UP interface, but not a DOWN interface.
1. Add VLANs for routing interfaces.
>> # interface ip 2
>> (config-ip-if)# enable
>> (config-ip-if)# ip address 102.1.1.1
>> (config-ip-if)# vlan 2
>> (config-ip-if)# exit
>> # interface ip 3
>> (config-ip-if)# enable
>> (config-ip-if)# ip address 103.1.1.1
>> (config-ip-if)# vlan 3
Use the following command to check the current valid routes in the routing table of
the switch:
Locally configured static routes do not appear in the RIP Routes table.
© Copyright IBM Corp. 2014 Chapter 21: Routing Information Protocol 287
288 RackSwitch G8124: Application Guide
Chapter 22. Internet Group Management Protocol
Internet Group Management Protocol (IGMP) is used by IPv4 Multicast routers
(Mrouters) to learn about the existence of host group members on their directly
attached subnet. The IPv4 Mrouters get this information by broadcasting IGMP
Membership Queries and listening for IPv4 hosts reporting their host group
memberships. This process is used to set up a client/server relationship between an
IPv4 multicast source that provides the data streams and the clients that want to
receive the data. The switch supports three versions of IGMP:
• IGMPv1: Defines the method for hosts to join a multicast group. However, this
version does not define the method for hosts to leave a multicast group. See
RFC 1112 for details.
• IGMPv2: Adds the ability for a host to signal its desire to leave a multicast group.
See RFC 2236 for details.
• IGMPv3: Adds support for source filtering by which a host can report interest in
receiving packets only from specific source addresses, or from all but specific
source addresses, sent to a particular multicast address. See RFC 3376 for
details.
The G8124 can perform IGMP Snooping, and connect to static Mrouters. The
G8124 can act as a Querier, and participate in the IGMP Querier election process.
© Copyright IBM Corp. 2014 Chapter 22: Internet Group Management Protocol 291
IGMP Capacity and Default Values
The following table lists the maximum and minimum values of the G8124 variables.
Table 27. G8124 Capacity Table
Variable Maximum
Static Mrouters 20
Dynamic Mrouters 20
The following table lists the default settings for IGMP features and variables.
Table 28. IGMP Default Configuration Settings
IGMPv3 Disabled
Valid range: 1 - 64
The switch can sense IGMP Membership Reports from attached hosts and acts as a
proxy to set up a dedicated path between the requesting host and a local IPv4
Mrouter. After the path is established, the switch blocks the IPv4 multicast stream
from flowing through any port that does not connect to a host member, thus
conserving bandwidth.
IGMP Querier
For IGMP Snooping to function, you must have an Mrouter on the network that
generates IGMP Query packets. Enabling the IGMP Querier feature on the switch
allows it to participate in the Querier election process. If the switch is elected as the
Querier, it will send IGMP Query packets for the LAN segment.
Querier Election
If multiple Mrouters exist on the network, only one can be elected as a Querier. The
Mrouters elect the one with the lowest source IPv4 address or MAC address as the
Querier. The Querier performs all periodic membership queries. All other Mrouters
(non-Queriers) do not send IGMP Query packets.
Note: When IGMP Querier is enabled on a VLAN, the switch performs the role of
an IGMP Querier only if it meets the IGMP Querier election criteria.
Each time the Querier switch sends an IGMP Query packet, it initializes a general
query timer. If a Querier receives a General Query packet from an Mrouter with a
lower IP address or MAC address, it transitions to a non-Querier state and initializes
an other querier present timer. When this timer expires, the Mrouter transitions back
to the Querier state and sends a General Query packet.
© Copyright IBM Corp. 2014 Chapter 22: Internet Group Management Protocol 293
4. Verify the configuration.
IGMP Groups
One IGMP entry is allocated for each unique join request, based on the VLAN and
IGMP group address. If multiple ports join the same IGMP group using the same
VLAN, only a single IGMP entry is used.
IGMPv3 Snooping
IGMPv3 includes new Membership Report messages that extend IGMP functionality.
The switch provides snooping capability for all types of IGMPv3 Membership Reports.
The IGMPv3 implementation keeps records on the multicast hosts present in the
network. If a host is already registered, when it receives a new IS_INC, TO_INC,
IS_EXC, or TO_EXC report from same host, the switch makes the correct transition
to new (port-host-group) registration based on the IGMPv3 RFC. The registrations
of other hosts for the same group on the same port are not changed.
By default, the G8124 snoops the first eight sources listed in the IGMPv3 Group
Record. Use the following command to change the number of snooping sources:
© Copyright IBM Corp. 2014 Chapter 22: Internet Group Management Protocol 295
IGMP Snooping Configuration Example
This section provides steps to configure IGMP Snooping on the G8124.
1. Configure port and VLAN membership on the switch.
2. Add VLANs to IGMP Snooping.
These commands display information about IGMP Groups and Mrouters learned by
the switch.
Multicast
Server
© Copyright IBM Corp. 2014 Chapter 22: Internet Group Management Protocol 297
• The hosts receive multicast traffic as follows:
– Host 1 receives multicast traffic for groups (*, 225.10.0.11), (22.10.0.13,
225.10.0.13)
– Host 2 receives multicast traffic for groups (*, 225.10.0.11), (*, 230.0.2.1),
(22.10.0.13, 225.10.0.13), (22.10.0.3, 230.0.2.3)
– Host 3 receives multicast traffic for groups (*, 230.0.2.1), (22.10.0.3,
230.0.2.3)
• The Mrouter receives all the multicast traffic.
Prerequisites
Before you configure IGMP Snooping, ensure you have performed the following
actions:
• Configured VLANs.
• Enabled IGMP.
• Added VLANs to IGMP Snooping.
• Configured a switch or Mrouter as the Querier.
• Identified the IGMP version(s) you want to enable.
• Disabled IGMP flooding.
Configuration
This section provides the configuration details of the switches shown in Figure 31.
Switch A Configuration
1. Configure VLANs and tagging.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 10.10.10.1 enable
RS G8124(config-ip-if)# vlan 2
RS G8124(config-ip-if)# exit
3. Assign a bridge priority lower than the default bridge priority to enable the
switch to become the STP root in STG 2 and 3.
Switch B Configuration
1. Configure VLANs and tagging.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 10.10.10.2 enable
RS G8124(config-ip-if)# vlan 2
RS G8124(config-ip-if)# exit
3. Configure STP. Reset the ports to make the edge configuration operational.
© Copyright IBM Corp. 2014 Chapter 22: Internet Group Management Protocol 299
6. Configure IGMP Snooping.
Switch C Configuration
1. Configure VLANs and tagging.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 10.10.10.3 enable
RS G8124(config-ip-if)# vlan 2
RS G8124(config-ip-if)# exit
3. Configure STP. Reset the ports to make the edge configuration operational.
RS G8124(config)# no ip ipmcfld
• Check the egress port’s VLAN membership. The ports to which the hosts and
Mrouter are connected must be used only for VLAN 2 and VLAN 3.
Note: To avoid such a scenario, disable IPMC flooding for all VLANs enabled on
the switches (if this is an acceptable configuration).
• Check IGMP Reports on switches B and C for information about the IGMP
groups.
If the non-member IGMP groups are displayed in the table, close the application
that may be sending the IGMP Reports for these groups.
Identify the traffic source by using a sniffer on the hosts and reading the source
IP/MAC address. If the source IP/MAC address is unknown, check the port
statistics to find the ingress port.
• Ensure no static multicast MACs, static multicast groups, or static Mrouters are
configured.
• Ensure PIM is not configured.
If some of the groups are not displayed, ensure the multicast application is
running on the host device and the generated IGMP Reports are correct.
• Ensure multicast traffic reaches the switch to which the host is connected.
Close the application sending the IGMP Reports. Clear the IGMP groups by
disabling, then re-enabling the port.
© Copyright IBM Corp. 2014 Chapter 22: Internet Group Management Protocol 301
Note: To clear all IGMP groups, use the following command:
RS G8124(config)# clear ip igmp groups
However, this will clear all the IGMP groups and will influence other hosts.
Check if the multicast traffic reaches the switch.
If the multicast traffic group is not displayed in the table, check the link state,
VLAN membership, and STP convergence.
• Ensure multicast server is sending all the multicast traffic.
• Ensure no static multicast MACs, static multicast groups, or static multicast
routes are configured.
If it is not learned on switch B but is learned on switch C, check the link state of
the trunk group, VLAN membership, and STP convergence.
If it is not learned on any switch, ensure the multicast application is running and
is sending correct IGMP Query packets.
If it is learned on both switches, check the link state, VLAN membership, and
STP port states for the ports connected to the hosts.
• Ensure the host’s multicast application is started and is sending correct IGMP
Reports/Leaves.
© Copyright IBM Corp. 2014 Chapter 22: Internet Group Management Protocol 303
Additional IGMP Features
The following topics are discussed in this section:
• “FastLeave” on page 304
• “IGMP Filtering” on page 304
• “Static Multicast Router” on page 305
FastLeave
In normal IGMP operation, when the switch receives an IGMPv2 Leave message, it
sends a Group-Specific Query to determine if any other devices in the same group
(and on the same port) are still interested in the specified multicast group traffic. The
switch removes the affiliated port from that particular group, if the switch does not
receive an IGMP Membership Report within the query-response-interval.
With FastLeave enabled on the VLAN, a port can be removed immediately from the
port list of the group entry when the IGMP Leave message is received.
Note: Only IGMPv2 supports FastLeave. Enable FastLeave on ports that have
only one host connected. If more than one host is connected to a port, you
may lose some hosts unexpectedly.
IGMP Filtering
With IGMP filtering, you can allow or deny certain IGMP groups to be learned on a
port.
If access to a multicast group is denied, IGMP Membership Reports from the port
are dropped, and the port is not allowed to receive IPv4 multicast traffic from that
group. If access to the multicast group is allowed, Membership Reports from the
port are forwarded for normal processing.
To configure IGMP filtering, you must globally enable IGMP filtering, define an IGMP
filter, assign the filter to a port, and enable IGMP filtering on the port. To define an
IGMP filter, you must configure a range of IPv4 multicast groups, choose whether
the filter will allow or deny multicast traffic for groups within the range, and enable
the filter.
Each IGMP filter allows you to set a start and end point that defines the range of
IPv4 addresses upon which the filter takes action. Each IPv4 address in the range
must be between 224.0.0.0 and 239.255.255.255.
Each IGMP filter can allow or deny IPv4 multicasts to the range of IPv4 addresses
configured. If you configure the filter to deny IPv4 multicasts, then IGMP
Membership Reports from multicast groups within the range are dropped. You can
configure a secondary filter to allow IPv4 multicasts to a small range of addresses
within a larger range that a primary filter is configured to deny. The two filters work
together to allow IPv4 multicasts to a small subset of addresses within the larger
range of addresses.
Note: Lower-numbered filters take precedence over higher-number filters. For
example, the action defined for IGMP filter 1 supersedes the action defined
for IGMP filter 2.
When you configure a static Mrouter on a VLAN, it replaces any dynamic Mrouters
learned through IGMP Snooping.
© Copyright IBM Corp. 2014 Chapter 22: Internet Group Management Protocol 305
306 RackSwitch G8124: Application Guide
Chapter 23. Multicast Listener Discovery
Multicast Listener Discovery (MLD) is an IPv6 protocol that a host uses to request
multicast data for a multicast group. An IPv6 router uses MLD to discover the
presence of multicast listeners (nodes that want to receive multicast packets) on its
directly attached links, and to discover specifically the multicast addresses that are
of interest to those neighboring nodes.
MLDv2 protocol, when compared to MLDv1, adds support for source filtering—the
ability for a node to report interest in listening to packets only from specific source
addresses, or from all but specific source addresses, sent to a particular multicast
address. MLDv2 is interoperable with MLDv1. See RFC 3569 for details on
Source-Specific Multicast (SSM).
Without MLD, the switch forwards IPv6 multicast traffic through all ports, increasing
network load. Following is an overview of operations when MLD is configured on the
G8124:
• The switch acts as an Mrouter when MLDv1/v2 is configured and enabled on
each of its directly attached links. If the switch has multiple interfaces connected
to the same link, it operates the protocol on any one of the interfaces.
• If there are multiple Mrouters on the subnet, the Mrouter with the numerically
lowest IPv6 address is elected as the Querier.
• The Querier sends general queries at short intervals to learn multicast address
listener information from an attached link.
• Hosts respond to these queries by reporting their per-interface Multicast Address
Listening state, through Current State Report messages sent to a specific
multicast address that all MLD routers on the link listen to.
• If the listening state of a host changes, the host immediately reports these
changes through a State Change Report message.
• The Querier sends a Multicast Address Specific Query to verify if hosts are
listening to a specified multicast address or not. Similarly, if MLDv2 is configured,
the Querier sends a Multicast Address and Source Specific Query to verify, for a
specified multicast address, if hosts are listening to a specific set of sources, or
not. MLDv2 listener report messages consists of Multicast Address Records:
– INCLUDE: to receive packets from source specified in the MLDv2 message
– EXCLUDE: to receive packets from all sources except the ones specified in
the MLDv2 message
• A host can send a State Change Report to indicate its desire to stop listening to
a particular multicast address (or source in MLDv2). The Querier then sends a
multicast address specific query to verify if there are other listeners of the
multicast address. If there aren’t any, the Mrouter deletes the multicast address
from its Multicast Address Listener state and stops sending multicast traffic.
Similarly in MLDv2, the Mrouter sends a Multicast Address and Source Specific
Query to verify if, for a specified multicast address, there are hosts still listening
to a specific set of sources.
© Copyright IBM Corp. 2014 Chapter 23: Multicast Listener Discovery 309
How Flooding Impacts MLD
By default, the flood option is enabled to allow hardware flooding in VLAN for all
unknown IP multicast (IPMC) traffic. When the flood option is disabled, unknown
IPMC is sent only to the Mrouter ports.
MLD Querier
An Mrouter acts as a Querier and periodically (at short query intervals) sends query
messages in the subnet. If there are multiple Mrouters in the subnet, only one can
be the Querier. All Mrouters on the subnet listen to the messages sent by the
multicast address listeners, and maintain the same multicast listening information
state.
All MLDv2 queries are sent with the FE80::/64 link-local source address prefix.
Querier Election
Only one Mrouter can be the Querier per subnet. All other Mrouters will be
non-Queriers. MLD versions 1 and 2 elect the Mrouter with the numerically lowest
IPv6 address as the Querier.
Dynamic Mrouters
The switch learns Mrouters on the ingress VLANs of the MLD-enabled interface. All
report or done messages are forwarded to these Mrouters. By default, the option of
dynamically learning Mrouters is disabled. To enable it, use the following command:
Table 30 lists the default settings for MLD features and variables.
Table 30. MLD Timers and Default Values
Other Querier Present Interval [OQPT] 255 seconds [derived: RV*QI + ½ QRI]
Older Version Querier Present Timeout: 260 seconds [derived: RV*QI+ QRI]
[OVQPT]
Older Version Host Present Interval 260 seconds [derived: RV* QI+QRI]
[OVHPT]
© Copyright IBM Corp. 2014 Chapter 23: Multicast Listener Discovery 311
Configuring MLD
Following are the steps to enable MLD and configure the interface parameters:
1. Enable IPv6 boot profile.
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# ipv6 address 2002:1:0:0:0:0:0:3
RS G8124(config-ip-if)# ipv6 prefixlen 64
RackSwitch G8124es can advertise their IP interfaces and IPv4 addresses using
BGP and take BGP feeds from as many as 96 BGP router peers. This allows more
resilience and flexibility in balancing traffic from the Internet.
Note: IBM Networking OS 7.11 does not support IPv6 for BGP.
Internet
When there are many iBGP peers, having a full-mesh configuration results in large
number of sessions between the iBGP peers. In such situations, configuring a route
reflector eliminates the full-mesh configuration requirement, prevents route
propagation loops, and provides better scalability to the peers. For details, see
“Route Reflector” on page 314.
Typically, an AS has one or more border routers—peer routers that exchange routes
with other ASs—and an internal routing scheme that enables routers in that AS to
reach every other router and destination within that AS. When you advertise routes
to border routers on other autonomous systems, you are effectively committing to
carry data to the IPv4 space represented in the route being advertised. For
example, if you advertise 192.204.4.0/24, you are declaring that if another router
sends you data destined for any address in 192.204.4.0/24, you know how to carry
that data to its destination.
Route Reflector
The IBM N/OS implementation conforms to the BGP Route Reflection specification
defined in RFC 4456.
As per RFC 1771 specification, a route received from an iBGP peer cannot be
advertised to another iBGP peer. This makes it mandatory to have full-mesh iBGP
sessions between all BGP routers within an AS. A route reflector—a BGP router—
breaks this iBGP loop avoidance rule. It does not affect the eBGP behavior. A route
reflector is a BGP speaker that advertises a route learnt from an iBGP peer to
another iBGP peer. The advertised route is called the reflected route.
A route reflector has two groups of internal peers: clients and non-clients. A route
reflector reflects between these groups and among the clients. The non-client peers
must be fully meshed. The route reflector and its clients form a cluster.
Cluster
RR Client RR Client
iBGP iBGP
Route Reflector
iBGP iBGP
iBGP
RR Non-Client RR Non-Client
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 315
Route reflection functionality can be configured as follows:
1. Configure an AS.
Note: When a client is configured on the G8124, the switch automatically gets
configured as a route reflector.
3. Verify configuration.
Once configured as a route reflector, the switch, by default, passes routes between
clients. If required, you can disable this by using the following command:
You can view the route reflector BGP attributes attached to a BGP route using the
following command:
For each new route, if a peer is interested in that route (for example, if a peer would
like to receive your static routes and the new route is static), an update message is
sent to that peer containing the new route. For each route removed from the route
table, if the route has already been sent to a peer, an update message containing
the route to withdraw is sent to that peer.
For each Internet host, you must be able to send a packet to that host, and that host
has to have a path back to you. This means that whoever provides Internet
connectivity to that host must have a path to you. Ultimately, this means that they must
“hear a route” which covers the section of the IPv4 space you are using; otherwise,
you will not have connectivity to the host in question.
Static Peers
You can configure BGP static peers by using the commands below:
Static peers always take precedence over dynamic peers. Consider the following:
• If the remote address of an incoming BGP connection matches both a static peer
address and an IP address from a dynamic group, the peer is configured
statically and not dynamically.
• If a new static peer is enabled while a dynamic peer for the same remote address
exists, BGP automatically removes the dynamic peer.
• If a new static peer is enabled when the maximum number of BGP peers were
already configured, then BGP deletes the dynamic peer that was last created
and adds the newly created static peer. A syslog will be generated for the peer
that was deleted.
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 317
Dynamic Peers
To configure dynamic peers, you must define a range of IP addresses for a group.
BGP waits to receive an open message initiated from BGP speakers within that
range. Dynamic peers are automatically created when a peer group member
accepts the incoming BGP connection. Dynamic peers are passive. When they are
not in the established state, they accept inbound connections but do not initiate
outbound connections.
You can configure up to 6 AS numbers per group. When the BGP speaker receives
an open message from a dynamic peer, the AS number from the packet must match
one of the remote AS numbers configured on the corresponding group.
When you delete a remote AS number, all dynamic peers established from that
remote AS will be deleted.
You can define attributes for the dynamic peers only at the group level. You cannot
configure attributes for any one dynamic peer. All static peer attributes, except the
BGP passive mode, can also be configured for groups.
To set the maximum number of dynamic peers for a group that can simultaneously
be in an established state, enter the following command:
If you reset this limit to a lower number, and if the dynamic peers already
established for the group are higher than this new limit, then BGP deletes the last
created dynamic peer(s) until the new limit is reached.
Note: The maximum number of static and dynamic peers established
simultaneously cannot exceed the maximum peers, i.e. 96, that the switch
can support. If the maximum peers are established, no more dynamic peers
will be enabled even if the maximum dynamic peers limit you had configured
for the groups was not reached.
Given below are the basic commands for configuring dynamic peers:
You cannot remove dynamic peers manually. However, you can stop a dynamic
peer using the following command:
The stop command interrupts the BGP connection until the peer tries to re-establish
the connection.
Also, when a dynamic peer state changes from established to idle, BGP removes
the dynamic peer.
To configure an existing loopback interface for BGP neighbor, use the following
commands:
A route map allows you to match attributes, such as metric, network address, and
AS number. It also allows users to overwrite the local preference metric and to
append the AS number in the AS route. See “BGP Failover Configuration” on
page 328.
IBM N/OS allows you to configure 64 route maps. Each route map can have up to
eight access lists. Each access list consists of a network filter. A network filter
defines an IPv4 address and subnet mask of the network that you want to include in
the filter. Figure 34 illustrates the relationship between route maps, access lists, and
network filters.
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 319
Figure 34. Distributing Network Filters in Access Lists and Route Maps
1 9
---
Route Map 2 ---
---
8 16
-----
-----
-----
-----
-----
-----
----- 1 249
---
Route Map 64 ---
---
8 256
If a route map is not configured in the incoming route map list, the router imports all
BGP updates. If a route map is configured in the incoming route map list, the router
ignores all unmatched incoming updates. If you set the action to deny, you must add
another route map to permit all unmatched updates.
Route maps in an outgoing route map list behave similar to route maps in an
incoming route map list. If a route map is not configured in the outgoing route map
list, all routes are advertised or permitted. If a route map in the outgoing route map
list is set to permit, matched routes are advertised and unmatched routes are
ignored.
The smaller the value the higher the precedence. If two route maps have the same
precedence value, the smaller number has higher precedence.
Configuration Overview
To configure route maps, you need to do the following:
1. Define a network filter.
Enter a filter number from 1 to 256. Specify the IPv4 address and subnet mask of
the network that you want to match. Enable the network filter. You can distribute
up to 256 network filters among 64 route maps each containing eight access
lists.
Steps 2 and 3 are optional, depending on the criteria that you want to match. In Step
2, the network filter number is used to match the subnets defined in the network
filter. In Step 3, the autonomous system number is used to match the subnets. Or,
you can use both (Step 2 and Step 3) criteria: access list (network filter) and access
path (AS filter) to configure the route maps.
2. (Optional) Define the criteria for the access list and enable it.
Specify the access list and associate the network filter number configured in
Step 1.
RS G8124(config)# route-map 1
RS G8124(config-route-map)# access-list 1 match-address 1
RS G8124(config-route-map)# access-list 1 metric <metric value>
RS G8124(config-route-map)# access-list 1 action deny
RS G8124(config-route-map)# access-list 1 enable
RS G8124(config-route-map)# as-path-list 1 as 1
RS G8124(config-route-map)# as-path-list 1 action deny
RS G8124(config-route-map)# as-path-list 1 enable
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 321
4. Set up the BGP attributes.
If you want to overwrite the attributes that the peer router is sending, define the
following BGP attributes:
– Specify up to 32 AS numbers that you want to prepend to a matched route.
Use one space between each of the entries in the list.
– Specify the local preference for the matched route.
– Specify the Multi Exit Discriminator (MED) metric for the matched route.
RS G8124(config-route-map)# enable
RS G8124(config-route-map)# exit
RS G8124(config-router-bgp)# exit
To define an aggregate route in the BGP routing table, use the following commands:
Redistributing Routes
In addition to running multiple routing protocols simultaneously, N/OS software can
redistribute information from one routing protocol to another. For example, you can
instruct the switch to use BGP to re-advertise static routes. This applies to all of the
IP-based routing protocols.
You can also conditionally control the redistribution of routes between routing
domains by defining a method known as route maps between the two domains. For
more information on route maps, see “What is a Route Map?” on page 319.
Redistributing routes is another way of providing policy control over whether to
export OSPF routes, fixed routes, and static routes. For an example configuration,
see “Default Redistribution and Route Aggregation Example” on page 330.
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 323
BGP Communities
BGP communities are attribute tags that allow controlled distribution of routing
information based on an agreement between BGP peers. Communities are
commonly used by transit service providers to enable peering customers to choose
specific routing destinations for their outgoing routes. The transit service provider
would typically publish a list of well-known or proprietary communities along with
their descriptions, and take it upon itself to advertise incoming routes accordingly.
For instance, an ISP may advertise that incoming routes tagged with community
XY:01 will be advertised only to European peers while incoming routes tagged with
community XY:02 will be advertised only to Asian peers.
The RackSwitch G8124 can be configured to manage the community tags applied
to the outgoing route updates. It does not, however, modify any routing decisions
based on the community tags.
To remove all community tags from prefixes that pass the route-map, use the
following command:
When there are multiple paths to the same destination, the local preference attribute
indicates the preferred path. The path with the higher preference is preferred (the
default value of the local preference attribute is 100). Unlike the weight attribute,
which is only relevant to the local router, the local preference attribute is part of the
routing update and is exchanged among routers in the same AS.
• The following commands use the route map local preference method, which
affects both inbound and outbound directions.
RS G8124(config)# route-map 1
RS G8124(config_route_map)# local-preference
RS G8124(config_router_map)# exit
This attribute is a hint to external neighbors about the preferred path into an AS
when there are multiple entry points. A lower metric value is preferred over a higher
metric value. The default value of the metric attribute is 0.
Unlike local preference, the metric attribute is exchanged between ASs; however, a
metric attribute that comes into an AS does not leave the AS.
When an update enters the AS with a certain metric value, that value is used for
decision making within the AS. When BGP sends that update to another AS, the
metric is reset to 0.
Unless otherwise specified, the router compares metric attributes for paths from
external neighbors that are in the same AS.
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 325
Next Hop Attribute
BGP routing updates sent to a neighbor contain the next hop IP address used to
reach a destination. In eBGP, the edge router, by default, sends its own IP address
as the next hop address. However, this can sometimes cause routing path failures in
Non-Broadcast Multiaccess Networks (NBMA) and when the edge router sends
iBGP updates.
To avoid routing failures, you can manually configure the next hop IP address. In
case of NBMA networks, you can configure the external BGP speaker to advertise
its own IP address as the next hop. In case of iBGP updates, you can configure the
edge iBGP router to send its IP address as the next hop.
Next hop can be configured on a BGP peer or a peer group. Use the following
commands:
• Next Hop for a BGP Peer
When the path is selected, BGP puts the selected path in its routing table and
propagates the path to its neighbors.
Multipath Relax
BGP multipath relax functionality allows load balancing across routes with different
autonomous system paths, but equal in length (same as-path length). With this
option disabled, both autonomous system paths and as-path length must be
identical for load sharing. This functionality can be enabled using the command:
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 327
BGP Failover Configuration
Use the following example to create redundant default gateways for a G8124 at a
Web Host/ISP site, eliminating the possibility, if one gateway goes down, that
requests will be forwarded to an upstream router unknown to the switch.
As shown in Figure 35, the switch is connected to ISP 1 and ISP 2. The customer
negotiates with both ISPs to allow the switch to use their peer routers as default
gateways. The ISP peer routers will then need to announce themselves as default
gateways to the G8124.
Figure 35. BGP Failover Configuration Example
Switch
IP: 200.200.200.1
IP: 210.210.210.1
BladeCenter
Server 1 Server 2
IP: 200.200.200.10 IP: 200.200.200.11
On the G8124, one peer router (the secondary one) is configured with a longer AS
path than the other, so that the peer with the shorter AS path will be seen by the
switch as the primary default gateway. ISP 2, the secondary peer, is configured with
a metric of “3,” thereby appearing to the switch to be three router hops away.
1. Define the VLANs.
For simplicity, both default gateways are configured in the same VLAN in this
example. The gateways could be in the same VLAN or different VLANs.
RS G8124(config)# vlan 1
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 200.200.200.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 210.210.210.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
3. Enable IP forwarding.
IP forwarding is turned on by default and is used for VLAN-to-VLAN (non-BGP)
routing. Make sure IP forwarding is on if the default gateways are on different
subnets or if the switch is connected to different subnets and those subnets need
to communicate through the switch (which they almost always do).
RS G8124(config)# ip routing
Note: To help eliminate the possibility for a Denial of Service (DoS) attack, the
forwarding of directed broadcasts is disabled by default.
4. Configure BGP peer router 1 and 2 with IPv4 addresses.
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 329
Default Redistribution and Route Aggregation Example
This example shows you how to configure the switch to redistribute information from
one routing protocol to another and create an aggregate route entry in the BGP
routing table to minimize the size of the routing table.
As illustrated in Figure 36, you have two peer routers: an internal and an external
peer router. Configure the G8124 to redistribute the default routes from AS 200 to
AS 135. At the same time, configure for route aggregation to allow you to condense
the number of routes traversing from AS 135 to AS 200.
Figure 36. Route Aggregation and Default Route Redistribution
Switch
10.1.1.135
3. Configure internal peer router 1 and external peer router 2 with IPv4
addresses.
© Copyright IBM Corp. 2014 Chapter 24: Border Gateway Protocol 331
332 RackSwitch G8124: Application Guide
Chapter 25. OSPF
IBM Networking OS supports the Open Shortest Path First (OSPF) routing protocol.
The IBM N/OS implementation conforms to the OSPF version 2 specifications
detailed in Internet RFC 1583, and OSPF version 3 specifications in RFC 5340. The
following sections discuss OSPF support for the RackSwitch G8124:
• “OSPFv2 Overview” on page 334. This section provides information on OSPFv2
concepts, such as types of OSPF areas, types of routing devices, neighbors,
adjacencies, link state database, authentication, and internal versus external
routing.
• “OSPFv2 Implementation in IBM N/OS” on page 338. This section describes how
OSPFv2 is implemented in N/OS, such as configuration parameters, electing the
designated router, summarizing routes, defining route maps and so forth.
• “OSPFv2 Configuration Examples” on page 347. This section provides
step-by-step instructions on configuring different OSPFv2 examples:
– Creating a simple OSPF domain
– Creating virtual links
– Summarizing routes
• “OSPFv3 Implementation in IBM N/OS” on page 356. This section describes
differences and additional features found in OSPFv3.
All routing devices maintain link information in their own Link State Database
(LSDB). OSPF allows networks to be grouped together into an area. The topology of
an area is hidden from the rest of the AS, thereby reducing routing traffic. Routing
within an area is determined only by the area’s own topology, thus protecting it from
bad routing data. An area can be generalized as an IP subnetwork.
Backbone
Area 0
(Also a Transit Area)
ABR ABR
ABR
Internal LSA
Routes Virtual
Stub Area Transit Area Link
External LSA
Routes
ASBR
Stub Area, NSSA,
ABR = Area Border Router or Transit Area
ASBR = Autonomous System Connected to Backbone
Non-OSPF Area Boundary Router via Virtual Link
RIP/BGP AS
BGP Backbone
Area 3
Area 0
Inter-Area Routes
External ABR
ASBR (Summary Routes)
Routes
RIP
ABR ABR
Internal
ASBR Router
Area 1 Area 2
Neighbors are routing devices that maintain information about each others’ state. To
establish neighbor relationships, routing devices periodically send hello packets on
each of their interfaces. All routing devices that share a common network segment,
appear in the same area, and have the same health parameters (hello and dead
intervals) and authentication parameters respond to each other’s hello packets and
become neighbors. Neighbors continue to send periodic hello packets to advertise
their health to neighbors. In turn, they listen to hello packets to determine the health
of their neighbors and to establish contact with new neighbors.
The hello process is used for electing one of the neighbors as the network
segment’s Designated Router (DR) and one as the network segment’s Backup
Designated Router (BDR). The DR is adjacent to all other neighbors on that specific
network segment and acts as the central contact for database exchanges. Each
neighbor sends its database information to the DR, which relays the information to
the other neighbors.
The BDR is adjacent to all other neighbors (including the DR). Each neighbor sends
its database information to the BDR just as with the DR, but the BDR merely stores
this data and does not distribute it. If the DR fails, the BDR will take over the task of
distributing database information to the other neighbors.
Each routing device transmits a Link-State Advertisement (LSA) on each of its active
interfaces. LSAs are entered into the LSDB of each routing device. OSPF uses
flooding to distribute LSAs between routing devices. Interfaces may also be
passive. Passive interfaces send LSAs to active interfaces, but do not receive LSAs,
hello packets, or any other OSPF protocol information from active interfaces.
Passive interfaces behave as stub networks, allowing OSPF routing devices to be
aware of devices that do otherwise participate in OSPF (either because they do not
support it, or because the administrator chooses to restrict OSPF traffic exchange or
transit).
When LSAs result in changes to the routing device’s LSDB, the routing device
forwards the changes to the adjacent neighbors (the DR and BDR) for distribution to
the other neighbors.
OSPF routing updates occur only when changes occur, instead of periodically. For
each new route, if a neighbor is interested in that route (for example, if configured to
receive static routes and the new route is indeed static), an update message
containing the new route is sent to the adjacency. For each route removed from the
route table, if the route has already been sent to a neighbor, an update message
containing the route to withdraw is sent.
It is also useful to tell routers outside your network (upstream providers or peers)
about the routes you have access to in your network. Sharing of routing information
between autonomous systems is known as external routing.
Typically, an AS will have one or more border routers (peer routers that exchange
routes with other OSPF networks) as well as an internal routing system enabling
every router in that AS to reach every other router and destination within that AS.
Configurable Parameters
In N/OS, OSPF parameters can be configured through the Industry Standard
Command Line Interfaces (ISCLI), Browser-Based Interface (BBI), or through
SNMP. For more information, see “Switch Administration” on page 23.
The ISCLI supports the following parameters: interface output cost, interface
priority, dead and hello intervals, retransmission interval, and interface transmit
delay.
Since the backbone connects the areas in your network, it must be a contiguous
area. If the backbone is partitioned (possibly as a result of joining separate OSPF
networks), parts of the AS will be unreachable, and you will need to configure virtual
links to reconnect the partitioned areas (see “Virtual Links” on page 342).
An OSPF area is defined by assigning two pieces of information: an area index and
an area ID. The commands to define and enable an OSPF area are as follows:
Note: The area option is an arbitrary index used only on the switch and does not
represent the actual OSPF area number. The actual OSPF area number is
defined in the area portion of the command as explained in the following
sections.
For example, both of the following sets of commands define OSPF area 0 (the
backbone) and area 1 because that information is held in the area ID portion of the
command. However, the first set of commands is easier to maintain because the
arbitrary area indexes agree with the area IDs:
• Area index and area ID agree
area 0 area-id 0.0.0.0 (Use index 0 to set area 0 in ID octet
format)
area 1 area-id 0.0.0.1 (Use index 1 to set area 1 in ID octet
format)
• Area index set to an arbitrary value
area 1 area-id 0.0.0.0 (Use index 1 to set area 0 in ID octet
format)
area 2 area-id 0.0.0.1 (Use index 2 to set area 1 in ID octet
format)
On the G8124, using the last octet in the area ID, “area 1” is equivalent to
“area-id 0.0.0.1”.
Note: Although both types of area ID formats are supported, be sure that the area
IDs are in the same format throughout an area.
Note: OSPFv2 supports IPv4 only. IPv6 is supported in OSPFv3 (see “OSPFv3
Implementation in IBM N/OS” on page 356).
DR and BDR elections are made through the hello process. The election can be
influenced by assigning a priority value to the OSPF interfaces on the G8124. The
command is as follows:
A priority value of 255 is the highest, and 1 is the lowest. A priority value of 0
specifies that the interface cannot be used as a DR or BDR. In case of a tie, the
routing device with the highest router ID wins. Interfaces configured as passive do
not participate in the DR or BDR election process:
Summarizing Routes
Route summarization condenses routing information. Without summarization, each
routing device in an OSPF network would retain a route to every subnet in the
network. With summarization, routing devices can reduce some sets of routes to a
single advertisement, reducing both the load on the routing device and the
perceived complexity of the network. The importance of route summarization
increases with network size.
Summary routes can be defined for up to 16 IP address ranges using the following
command:
where <range number> is a number 1 to 16, <IP address> is the base IP address for
the range, and <mask> is the IP address mask for the range. For a detailed
configuration example, see “Example 3: Summarizing Routes” on page 354.
Each G8124 acting as an ABR automatically inserts a default route into stub and
NSSA attached areas. In simple OSPF stub areas or NSSAs with only one ABR
leading upstream (see Area 1 in Figure 39), any traffic for IP address destinations
outside the area is forwarded to the switch’s IP interface, and then into the
connected transit area (usually the backbone). Since this is automatic, no further
configuration is required for such areas.
Figure 39. Injecting Default Routes
If the switch is in a transit area and has a configured default gateway, it can inject a
default route into rest of the OSPF domain. Use the following command to configure
the switch to inject OSPF default routes (Router OSPF mode):
In this command, <metric value> sets the priority for choosing this switch for default
route. The value none sets no default and 1 sets the highest priority for default
route. Metric type determines the method for influencing routing decisions for
external routes.
When the switch is configured to inject a default route, an AS-external LSA with link
state ID 0.0.0.0 is propagated throughout the OSPF routing domain. This LSA is
sent with the configured metric value and metric type.
The OSPF default route configuration can be removed with the command:
RS G8124(config-router-ospf)# no default-information
The area which contains a virtual link must be a transit area and have full routing
information. Virtual links cannot be configured inside a stub area or NSSA. The area
type must be defined as transit using the following command:
The virtual link must be configured on the routing devices at each endpoint of the
virtual link, though they may traverse multiple routing devices. To configure a G8124
as one endpoint of a virtual link, use the following command:
where <link number> is a value between 1 and 3, <area index> is the OSPF area
index of the transit area, and <router ID> is the router ID of the virtual neighbor, the
routing device at the target endpoint. Another router ID is needed when configuring
a virtual link in the other direction. To provide the G8124 with a router ID, see the
following section Router ID.
For a detailed configuration example on Virtual Links, see “Example 2: Virtual Links”
on page 350.
Router ID
Routing devices in OSPF areas are identified by a router ID. The router ID is
expressed in IP address format. The IP address of the router ID is not required to be
included in any IP interface range or in any OSPF area, and may even use the
G8124 loopback interface.
OSPF allows packet authentication and uses IP multicast when sending and
receiving packets. Routers participate in routing domains based on pre-defined
passwords. N/OS supports simple password (type 1 plain text passwords) and MD5
cryptographic authentication. This type of authentication allows a password to be
configured per interface.
Figure 40 shows authentication configured for area 0 with the password test. Simple
authentication is also configured for the virtual link between area 2 and area 0. Area
1 is not configured for OSPF authentication.
Figure 40. OSPF Authentication
Switch 2
Switch 1 Switch 3
Switch 5
key=blade
Switch 4
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip ospf key test
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip ospf key test
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# ip ospf key test
RS G8124(config-ip-if)# exit
4. Configure a simple text password up to eight characters for the virtual link
between Area 2 and Area 0 on switches 2 and 4.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip ospf message-digest-key 1
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip ospf message-digest-key 1
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# ip ospf message-digest-key 1
RS G8124(config-ip-if)# exit
5. Configure MD5 key for the virtual link between Area 2 and Area 0 on switches
2 and 4.
If dynamic router ID selection is used (see “Router ID” on page 343) loopback
interfaces can be used to force router ID selection. If a loopback interface is
configured, its IP address is automatically selected as the router ID, even if other IP
interfaces have lower IP addresses. If more than one loopback interface is
configured, the lowest loopback interface IP address is selected.
Network Network
10.10.7.0/24 10.10.12.0/24
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 10.10.7.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 10.10.12.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
Note: OSPFv2 supports IPv4 only. IPv6 is supported in OSPFv3 (see “OSPFv3
Implementation in IBM N/OS” on page 356).
2. Enable OSPF.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip ospf area 0
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip ospf area 1
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
Switch 1 Switch 2
Note: OSPFv2 supports IPv4 only. IPv6 is supported in OSPFv3 (see “OSPFv3
Implementation in IBM N/OS” on page 356).
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 10.10.7.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 10.10.12.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
3. Enable OSPF.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip ospf area 0
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip ospf area 1
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 10.10.12.2
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# vlan 10
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 10.10.24.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# vlan 20
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
3. Enable OSPF.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip ospf area 1
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip ospf area 2
RS G8124(config-ip-if)# ip ospf enable
RS G8124(config-ip-if)# exit
The following example shows one summary route from area 1 (stub area) injected
into area 0 (the backbone). The summary route consists of all IP addresses from
36.128.192.0 through 36.128.254.255 except for the routes in the range
36.128.200.0 through 36.128.200.255.
Note: OSPFv2 supports IPv4 only. IPv6 is supported in OSPFv3 (see “OSPFv3
Implementation in IBM N/OS” on page 356).
Figure 43. Summarizing Routes
Note: You can specify a range of addresses to prevent advertising by using the
hide option. In this example, routes in the range 36.128.200.0 through
36.128.200.255 are kept private.
Use the following procedure to configure OSPF support as shown in Figure 43:
1. Configure IP interfaces for each network which will be attached to OSPF areas.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 10.10.7.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# vlan 10
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 36.128.192.1
RS G8124(config-ip-if)# ip netmask 255.255.255.0
RS G8124(config-ip-if)# vlan 20
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
2. Enable OSPF.
8. Use the hide command to prevent a range of addresses from advertising to the
backbone.
RS G8124(config)# router ospf
RS G8124(config-router-ospf)# area-range 2 address 36.128.200.0 255.255.255.0
RS G8124(config-router-ospf)# area-range 2 area 1
RS G8124(config-router-ospf)# area-range 2 hide
RS G8124(config-router-ospf)# exit
Although OSPFv2 and OSPFv3 are very similar, they represent independent
features on the G8124. They are configured separately, and both can run in parallel
on the switch with no relation to one another, serving different IPv6 and IPv4 traffic,
respectively.
See “Internet Protocol Version 6” on page 263 for configuring IPv6 interfaces.
Although Router IDs are written in dotted decimal notation, and may even be based
on IPv4 addresses from an original OSPFv2 network configuration, it is important to
realize that Router IDs are not IP addresses in OSPFv3, and can be assigned
independently of IP address space. However, maintaining Router IDs consistent
with any legacy OSPFv2 IPv4 addressing allows for easier implementation of both
protocols.
OSPFv3 Limitations
N/OS 7.11 does not currently support the following OSPFv3 features:
• Multiple interfaces of OSPFv3 on the same link.
In this example, one summary route from area 1 (stub area) is injected into area 0
(the backbone). The summary route consists of all IP addresses from the 36::0/32
portion of the 36::0/56 network, except for the routes in the 36::0/8 range.
Figure 44. Summarizing Routes
Backbone Stub Area
Area 0 Area 1
(0.0.0.0) (0.0.0.1)
IF 3 IF 4
10::1 36::1
ABR 36::0/32
Summary Route (- 36::0/8)
10::0/56 36::0/56
Network Network
Note: You can specify a range of addresses to prevent advertising by using the
hide option. In this example, routes in the 36::0/8 range are kept private.
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# ipv6 address 10:0:0:0:0:0:0:1
RS G8124(config-ip-if)# ipv6 prefixlen 56
RS G8124(config-ip-if)# vlan 10
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 4
RS G8124(config-ip-if)# ip address 36:0:0:0:0:0:1
RS G8124(config-ip-if)# ipv6 prefixlen 56
RS G8124(config-ip-if)# vlan 20
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
This is equivalent to configuring the IP address and netmask for IPv4 interfaces.
2. Enable OSPFv3.
This is equivalent to the OSPFv2 enable option in the router ospf command
path.
3. Define the backbone.
RS G8124(config-router-ospf3)# area 0 area-id 0.0.0.0
RS G8124(config-router-ospf3)# area 0 type transit
RS G8124(config-router-ospf3)# area 0 enable
The ipv6 command path is used instead of the OSPFv2 ip command path
6. Attach the network interface to the stub area.
RS G8124(config)# interface ip 4
RS G8124(config-ip-if)# ipv6 ospf area 1
RS G8124(config-ip-if)# ipv6 ospf enable
RS G8124(config-ip-if)# exit
The ipv6 command path is used instead of the OSPFv2 ip command path
This differs from OSPFv2 only in that the OSPFv3 command path is used, and
the address and prefix are specified in IPv6 format.
8. Use the hide command to prevent a range of addresses from advertising to the
backbone.
RS G8124(config-router-ospf)# area-range 2 address 36:0:0:0:0:0:0:0 8
RS G8124(config-router-ospf)# area-range 2 area 0
RS G8124(config-router-ospf)# area-range 2 hide
RS G8124(config-router-ospf)# exit
This differs from OSPFv2 only in that the OSPFv3 command path is used, and
the address and prefix are specified in IPv6 format.
2. Enable OSPFv3:
RS G8124(config# ipv6 router ospf
RS G8124(config-router-ospf3)# router-id 12.12.12.12
RS G8124(config-router-ospf3)# enable
The following sections discuss PIM support for the RackSwitch G8124:
• “PIM Overview” on page 362
• “Supported PIM Modes and Features” on page 363
• “Basic PIM Settings” on page 364
• “Additional Sparse Mode Settings” on page 366
• “Using PIM with Other Features” on page 369
• “PIM Configuration Examples” on page 370
PIM is used by multicast source stations, client receivers, and intermediary routers
and switches, to build and maintain efficient multicast routing trees. PIM is protocol
independent; It collects routing information using the existing unicast routing
functions underlying the IPv4 network, but does not rely on any particular unicast
protocol. For PIM to function, a Layer 3 routing protocol (such as BGP, OSPF, RIP,
or static routes) must first be configured on the switch.
Some routing and switching devices perform special PIM-SM functions. Within each
receiver domain, one router is elected as the Designated Router (DR) for handling
multicasts for the domain. DRs forward information to a similar device, the
Rendezvous Point (RP), which holds the root tree for the particular multicast group.
Receiver join requests as well as sender multicast content initially converge at the
RP, which generates and distributes multicast routing data for the DRs along the
delivery path. As the multicast content flows, DRs use the routing tree information
obtained from the RP to optimize the paths both to and from send and receive
stations, bypassing the RP for the remainder of content transactions if a more
efficient route is available.
DRs continue to share routing information with the RP, modifying the multicast
routing tree when new receivers join, or pruning the tree when all the receivers in
any particular domain are no longer part of the multicast group.
The following PIM modes and features are not currently supported in N/OS 7.11:
• Hybrid Sparse-Dense Mode (PIM-SM/DM). Sparse Mode and Dense Mode may
be configured on separate IP interfaces on the switch, but are not currently sup-
ported simultaneously on the same IP interface.
• PIM Source-Specific Multicast (PIM-SSM)
• Anycast RP
• PIM RP filters
• Only configuration via the switch ISCLI is supported. PIM configuration is cur-
rently not available using the menu-based CLI, the BBI, or via SNMP.
© Copyright IBM Corp. 2014 Chapter 26: Protocol Independent Multicast 363
Basic PIM Settings
To use PIM the following is required:
• The PIM feature must be enabled globally on the switch.
• PIM network components and PIM modes must be defined.
• IP interfaces must be configured for each PIM component.
• PIM neighbor filters may be defined (optional).
• If PIM-SM is used, define additional parameters:
– Rendezvous Point
– Designated Router preferences (optional)
– Bootstrap Router preferences (optional)
The sparse option will place the component in Sparse Mode (PIM-SM). The dense
option will place the component in Dense Mode (PIM-DM). By default, PIM
component 1 is configured for Sparse Mode. PIM component 2 is unconfigured by
default.
Note: A component using PIM-SM must also be configured with a dynamic or static
Rendezvous Point (see “Specifying the Rendezvous Point” on page 366).
Note: The PIM feature currently supports only one VLAN for each IP interface.
Configurations where different interfaces on different VLANs share IP
addresses are not supported.
Next, PIM must be enabled on the interface, and the PIM network component ID
must be specified:
To ensure that only the appropriate PIM neighbors are accepted by the switch, the
administrator can use PIM neighbor filters to specify which PIM neighbors may be
accepted or denied on a per-interface basis.
To turn PIM neighbor filtering on or off for a particular IP interface, use the following
commands:
When filtering is enabled, all PIM neighbor requests on the specified IP interface will
be denied by default. To allow a specific PIM neighbor, use the following command:
To remove a PIM neighbor from the accepted list, use the following command.
You can view configured PIM neighbor filters globally or for a specific IP interface
using the following commands:
© Copyright IBM Corp. 2014 Chapter 26: Protocol Independent Multicast 365
Additional Sparse Mode Settings
Specifying the Rendezvous Point
Using PIM-SM, at least one PIM-capable router must be a candidate for use as a
Rendezvous Point (RP) for any given multicast group. If desired, the G8124 can act
as an RP candidate. To assign a configured switch IP interface as a candidate, use
the following procedure.
1. Select the PIM component that will represent the RP candidate:
2. Configure the IPv4 address of the switch interface which will be advertised as a
candidate RP for the specified multicast group:
The switch interface will participate in the election of the RP that occurs on the
Bootstrap Router, or BSR (see “Specifying a Bootstrap Router” on page 367).
3. If using dynamic RP candidates, configure the amount of time that the elected
interface will remain the RP for the group before a re-election is performed:
Static RP
If RP no election is desired, the switch can provide a static RP. Use the following
commands:
1. Enable static RP configuration.
Use the following commands to configure the DR priority value (Interface IP mode):
Note: A value of 0 (zero) specifies that the G8124 will not act as the DR. This
setting requires the G8124 to be connected to a peer that has a DR priority
setting of 1 or higher to ensure that a DR will be present in the network.
A value of 255 highly prefers the local interface as a BSR. A value of -1 indicates
that the PIM CBSR preference is not configured on the switch.
interface loopback 1
ip address 55.55.1.1 255.255.255.0
enable
exit
ip pim component 1
rp-static rp-address 224.0.0.0 240.0.0.0 55.55.1.1
interface loopback 1
ip pim enable
exit
© Copyright IBM Corp. 2014 Chapter 26: Protocol Independent Multicast 367
• As a candidate RP
interface loopback 1
ip address 55.55.1.1 255.255.255.0
enable
exit
ip pim component 1
rp-candidate holdtime 60
rp-candidate rp-address 224.0.0.0 240.0.0.0 55.55.1.1
interface loopback 1
ip pim enable
exit
• As a BSR
interface loopback 1
ip address 55.55.1.1 255.255.255.0
enable
exit
interface loopback 1
ip pim enable
ip pim cbsr-preference 2
exit
If using ACLs or VMAPs, be sure to permit traffic for local hosts and routers.
• IGMP Querier is disabled by default. If IGMP Querier is needed with PIM, be sure
to enable the IGMP Query feature globally, as well as on each VLAN where it is
needed.
• If the switch is connected to multicast receivers and/or hosts, be sure to enable
IGMP snooping globally, as well as on each VLAN where PIM receivers are
attached.
© Copyright IBM Corp. 2014 Chapter 26: Protocol Independent Multicast 369
PIM Configuration Examples
Example 1: PIM-SM with Dynamic RP
This example configures PIM Sparse Mode for one IP interface, with the switch
acting as a candidate for dynamic Rendezvous Point (RP) selection.
1. Globally enable the PIM feature:
2. Configure a PIM network component with dynamic RP settings, and set it for
PIM Sparse Mode:
The IP interface represents the PIM network being connected to the switch. The
IPv4 addresses in the defined range must not be included in another IP interface
on the switch under a different VLAN.
4. Enable PIM on the IP interface and assign the PIM component:
The following commands can be used to modify the prior example configuration to
use a static RP:
Where 225.1.0.0 255.255.0.0 is the multicast group base address and mask, and
10.10.1.1 is the static RP address.
Note: The same static RP address must be configured for all switches in the group.
Example 3: PIM-DM
This example configures PIM Dense Mode (PIM-DM) on one IP interface. PIM-DM
can be configured independently, or it can be combined with the prior PIM-SM
examples (which are configured on a different PIM component) as shown in
Figure 45.
Figure 45. Network with both PIM-DM and PIM-SM Components
PIM-SM PIM-DM
Multicast Multicast
225.1.0.0/16 239.1.0.0/16
PIM Enabled
Switch
IP Interface 11 IP Interface 22
IP 10.10.1.1 IP 10.10.2.1
VLAN 101 VLAN 102
Component 1 Component 2
Media
Servers
© Copyright IBM Corp. 2014 Chapter 26: Protocol Independent Multicast 371
3. Define an IP interface for use with PIM:
RS G8124(config)# interface ip 22
RS G8124(config-ip-if)# ip address 10.10.2.1 255.255.255.255
RS G8124(config-ip-if)# vlan 102
RS G8124(config-ip-if)# enable
5. (Optional) Configure PIM border router if the IPMC traffic is flowing between
PIM domains:
Note: For PIM Dense Mode, the DR, RP, and BSR settings do not apply.
In Figure 46, four ports are trunked together between the switch and the enterprise
routing device. Connectivity is maintained as long as one of the links remain active.
The links to the server are also trunked, allowing the secondary NIC to take over in
the event that the primary NIC link fails.
Figure 46. Trunking Ports for Link Redundancy
Enterprise
Server
Routing Switch
NIC 1
Internet NIC 2
Trunk Trunk
For more information on trunking, see “Ports and Trunking” on page 109.
VLAGs are useful in multi-layer environments for both uplink and downlink
redundancy to any regular LAG-capable device. They can also be used in for
active-active VRRP connections.
You may select a physical port, static trunk, or an LACP adminkey as a Hot Link
interface.
Forward Delay
The Forward Delay timer allows Hot Links to monitor the Master and Backup
interfaces for link stability before selecting one interface to transition to the active
state. Before the transition occurs, the interface must maintain a stable link for the
duration of the Forward Delay interval.
For example, if you set the Forward delay timer to 10 seconds, the switch will select
an interface to become active only if a link remained stable for the duration of the
Forward Delay period. If the link is unstable, the Forward Delay period starts again.
Preemption
You can configure the Master interface to resume the active state whenever it
becomes available. With Hot Links preemption enabled, the Master interface
transitions to the active state immediately upon recovery. The Backup interface
immediately transitions to the standby state. If Forward Delay is enabled, the
transition occurs when an interface has maintained link stability for the duration of
the Forward Delay period.
FDB Update
Use the FDB update option to notify other devices on the network about updates to
the Forwarding Database (FDB). When you enable FDB update, the switch sends
multicasts of addresses in the forwarding database (FDB) over the active interface,
so that other devices on the network can learn the new path. The Hot Links FBD
update option uses the station update rate to determine the rate at which to send
FDB packets.
Configuration Guidelines
The following configuration guidelines apply to Hot links:
• When Hot Links is turned on, STP must be disabled on the hotlink ports.
• A port that is a member of the Master interface cannot be a member of the
Backup interface. A port that is a member of one Hot Links trigger cannot be a
member of another Hot Links trigger.
• An individual port that is configured as a Hot Link interface cannot be a member
of a trunk.
RS G8124(config)# [no] hotlinks bpdu (Enable or disable Hot Links BPDU flood)
RS G8124(config)# [no] hotlinks enable (Enable or disable Hot Links globally)
RS G8124(config)# [no] hotlinks fdb-update (Enable or disable Hot Links FDB update)
RS G8124(config)# hotlinks fdb-update-rate (Configure FDB update rate in packets per second)
RS G8124(config)# hotlinks trigger 1 enable (Enable Hot Links Trigger 1)
RS G8124(config)# hotlinks trigger 1 master port 1 (Add port to Master interface)
RS G8124(config)# hotlinks trigger 1 backup port 2 (Add port to Backup interface)
RS G8124(config)# hotlinks enable (Turn on Hot Links)
When the appropriate number of links in a monitor group return to service, the
switch enables the control ports. This causes the NIC team on the affected servers
to fail back to the primary switch (unless Auto-Fallback is disabled on the NIC team).
The backup switch processes traffic until the primary switch’s control links come up,
which can take up to five seconds.
Figure 47 is a simple example of Layer 2 Failover. One G8124 is the primary, and
the other is used as a backup. In this example, all ports on the primary switch belong
to a single trunk group, with Layer 2 Failover enabled, and Failover Limit set to 2. If
two or fewer links in trigger 1 remain active, the switch temporarily disables all
control ports. This action causes a failover event on Server 1 and Server 2.
Figure 47. Basic Layer 2 Failover
Enterprise Primary
Routing Switches Switch Server 1
Trigger 1
NIC 1
NIC 2
Backup
Internet Switch Server 2
Trigger 1
NIC 1
NIC 2
The switch automatically enables the control list items when the monitor list items
return to service.
A monitor port is considered operational as long as the following conditions are true:
• The port must be in the Link Up state.
• If STP is enabled, the port must be in the Forwarding state.
• If the port is part of an LACP trunk, the port must be in the Aggregated state.
If any of these conditions is false, the monitor port is considered to have failed.
A control port is considered Operational if the monitor trigger is up. As long as the
trigger is up, the port is considered operational from a teaming perspective, even if
the port itself is actually in the Down state, Blocking state (if STP is enabled on the
port), or Not Aggregated state (if part of an LACP trunk).
A control port is considered to have failed only if the monitor trigger is in the Down
state.
To view the state of any port, use one of the following commands:
LACP
Link Aggregation Control Protocol allows the switch to form dynamic trunks. You can
use the admin key to add up to 64 LACP trunks to a failover trigger using automatic
monitoring. When you add an admin key to a trigger, any LACP trunk with that
admin key becomes a member of the trigger.
When the switch determines that ports in the trigger are in STP Forwarding state in
any one of the STGs it belongs to, then it automatically enables the appropriate
control ports. The switch fails back to normal operation.
For example, if a monitor port is a member of STG1, STG2, and STG3, a failover will
be triggered only if the port is not in a forwarding state in all the three STGs. When
the port state in any of the three STGs changes to forwarding, then the control port
is enabled and normal switch operation is resumed.
With VRRP, Virtual Interface Routers (VIR) allow two VRRP routers to share an IP
interface across the routers. VIRs provide a single Destination IPv4 (DIP) address
for upstream routers to reach various servers, and provide a virtual default Gateway
for the servers.
VRRP Components
Each physical router running VRRP is known as a VRRP router.
Virtual Router
Two or more VRRP routers can be configured to form a virtual router (RFC 2338).
Each VRRP router may participate in one or more virtual routers. Each virtual router
consists of a user-configured virtual router identifier (VRID) and an IPv4 address.
The VRID is used to build the virtual router MAC Address. The five highest-order
octets of the virtual router MAC Address are the standard MAC prefix
(00-00-5E-00-01) defined in RFC 2338. The VRID is used to form the lowest-order
octet.
Only one of the VRRP routers in a virtual router may be configured as the IPv4
address owner. This router has the virtual router’s IPv4 address as its real interface
address. This router responds to packets addressed to the virtual router’s IPv4
address for ICMP pings, TCP connections, and so on.
There is no requirement for any VRRP router to be the IPv4 address owner. Most
VRRP installations choose not to implement an IPv4 address owner. For the
purposes of this chapter, VRRP routers that are not the IPv4 address owner are
called renters.
Within each virtual router, one VRRP router is selected to be the virtual router
master. See “Selecting the Master VRRP Router” on page 386 for an explanation of
the selection process.
Note: If the IPv4 address owner is available, it will always become the virtual router
master.
The virtual router master forwards packets sent to the virtual router. It also responds
to Address Resolution Protocol (ARP) requests sent to the virtual router's IPv4
address. Finally, the virtual router master sends out periodic advertisements to let
other VRRP routers know it is alive and its priority.
Within a virtual router, the VRRP routers not selected to be the master are known as
virtual router backups. If the virtual router master fails, one of the virtual router
backups becomes the master and assumes its responsibilities.
At Layer 3, a Virtual Interface Router (VIR) allows two VRRP routers to share an IP
interface across the routers. VIRs provide a single Destination IPv4 (DIP) address
for upstream routers to reach various destination networks, and provide a virtual
default Gateway.
Note: Every VIR must be assigned to an IP interface, and every IP interface must
be assigned to a VLAN. If no port in a VLAN has link up, the IP interface of
that VLAN is down, and if the IP interface of a VIR is down, that VIR goes
into INIT state.
VRRP Operation
Only the virtual router master responds to ARP requests. Therefore, the upstream
routers only forward packets destined to the master. The master also responds to
ICMP ping requests. The backup does not forward any traffic, nor does it respond to
ARP requests.
If the master is not available, the backup becomes the master and takes over
responsibility for packet forwarding and responding to ARP requests.
© Copyright IBM Corp. 2014 Chapter 29: Virtual Router Redundancy Protocol 385
Selecting the Master VRRP Router
Each VRRP router is configured with a priority between 1–254. A bidding process
determines which VRRP router is or becomes the master—the VRRP router with
the highest priority.
If, at any time, a backup determines that it has higher priority than the current
master does, it can preempt the master and become the master itself, unless
configured not to do so. In preemption, the backup assumes the role of master and
begins to send its own advertisements. The current master sees that the backup
has higher priority and will stop functioning as the master.
A backup router can stop receiving advertisements for one of two reasons—the
master can be down, or all communications links between the master and the
backup can be down. If the master has failed, it is clearly desirable for the backup
(or one of the backups, if there is more than one) to become the master.
Note: If the master is healthy but communication between the master and the
backup has failed, there will then be two masters within the virtual router. To
prevent this from happening, configure redundant links to be used between
the switches that form a virtual router.
Active-Active Redundancy
In an active-active configuration, shown in Figure 48, two switches provide
redundancy for each other, with both active at the same time. Each switch
processes traffic on a different subnet. When a failure occurs, the remaining switch
can process traffic on all subnets.
Servers
Internet
Enterprise
Routing Switch
Switch 2
Active (subnet B and D)
Each VRRP advertisement can include up to 16 addresses. All virtual routers are
advertised within the same packet, conserving processing and buffering resources.
© Copyright IBM Corp. 2014 Chapter 29: Virtual Router Redundancy Protocol 387
IBM N/OS Extensions to VRRP
This section describes VRRP enhancements that are implemented in N/OS.
N/OS supports a tracking function that dynamically modifies the priority of a VRRP
router, based on its current state. The objective of tracking is to have, whenever
possible, the master bidding processes for various virtual routers in a LAN converge
on the same switch. Tracking ensures that the selected switch is the one that offers
optimal network performance. For tracking to have any effect on virtual router
operation, preemption must be enabled.
N/OS can track the attributes listed in Table 31 (Router VRRP mode):
Table 31. VRRP Tracking Parameters
Parameter Description
Number of IP interfaces on the switch Helps elect the virtual routers with the
that are active (“up”) most available routes as the master. (An IP
interface is considered active when there
tracking-priority-increment is at least one active port on the same
interfaces VLAN.) This parameter influences the
VRRP router's priority in virtual interface
routers.
Number of active ports on the same Helps elect the virtual routers with the
VLAN most available ports as the master. This
parameter influences the VRRP router's
tracking-priority-increment priority in virtual interface routers.
ports
Number of virtual routers in master Useful for ensuring that traffic for any
mode on the switch particular client/server pair is handled by
the same switch, increasing routing
tracking-priority-increment efficiency. This parameter influences the
virtual-routers VRRP router's priority in virtual interface
routers.
Each tracked parameter has a user-configurable weight associated with it. As the
count associated with each tracked item increases (or decreases), so does the
VRRP router's priority, subject to the weighting associated with each tracked item. If
the priority level of a standby is greater than that of the current master, then the
standby can assume the role of the master.
See “Configuring the Switch for Tracking” on page 389 for an example on how to
configure the switch for tracking VRRP priority.
During the software upgrade process, VRRP virtual router IDs will be automatically
assigned if failover is enabled on the switch. When configuring virtual routers at any
point after upgrade, virtual router ID numbers must be assigned. The virtual router
ID may be configured as any number between 1 and 255. Use the following
command to configure the virtual router ID:
You can implement this behavior by configuring the switch for tracking as follows:
1. Set the priority for switch 1 to 101.
2. Leave the priority for switch 2 at the default value of 100.
3. On both switches, enable tracking based on ports, interfaces, or virtual routers.
You can choose any combination of tracking parameters, based on your
network configuration.
Note: There is no shortcut to setting tracking parameters. The goals must first be
set and the outcomes of various configurations and scenarios analyzed to
find settings that meet the goals.
© Copyright IBM Corp. 2014 Chapter 29: Virtual Router Redundancy Protocol 389
High Availability Configurations
VRRP High-Availability Using Multiple VIRs
Figure 49 shows an example configuration where two G8124s are used as VRRP
routers in an active-active configuration. In this configuration, both switches respond
to packets.
Figure 49. Active-Active Configuration using VRRP
VIR 1: 192.168.1.200 (Master) Server 1
L2 Switch VIR 2: 192.168.2.200 (Backup)
NIC 1: 10.0.1.1/24
1 NIC 2: 10.0.2.1/24
Server 2
2 Switch 1
Internet 4 NIC 1: 10.0.1.2/24
NIC 2: 10.0.2.2/24
Server 3
4 NIC 1: 10.0.1.3/24
Enterprise 1 Server 4 NIC 2: 10.0.2.3/24
Routing Switch
2
Switch 2
NIC 1: 10.0.1.4/24
L2 Switch VIR 1: 192.168.1.200 (Backup) NIC 2: 10.0.2.4/24
VIR 2: 192.168.2.200 (Master)
Although this example shows only two switches, there is no limit on the number of
switches used in a redundant configuration. It is possible to implement an
active-active configuration across all the VRRP-capable switches in a LAN.
In the scenario illustrated in Figure 49, traffic destined for IPv4 address 10.0.1.1 is
forwarded through the Layer 2 switch at the top of the drawing, and ingresses
G8124 1 on port 1. Return traffic uses default gateway 1 (192.168.1.1).
If the link between G8124 1 and the Layer 2 switch fails, G8124 2 becomes the
Master because it has a higher priority. Traffic is forwarded to G8124 2, which
forwards it to G8124 1 through port 4. Return traffic uses default gateway 2
(192.168.2.1), and is forwarded through the Layer 2 switch at the bottom of the
drawing.
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 192.168.1.100 255.255.255.0
RS G8124(config-ip-if)# vlan 10
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 192.168.2.101 255.255.255.0
RS G8124(config-ip-if)# vlan 20
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# ip address 10.0.1.100 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 4
RS G8124(config-ip-if)# ip address 10.0.2.101 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
4. Enable tracking on ports. Set the priority of Virtual Router 1 to 101, so that it
becomes the Master.
© Copyright IBM Corp. 2014 Chapter 29: Virtual Router Redundancy Protocol 391
5. Configure ports.
RS G8124(config)# vlan 10
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 1
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 10
RS G8124(config-if)# exit
RS G8124(config)# vlan 20
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 2
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 20
RS G8124(config-if)# exit
RS G8124(config)# interface ip 1
RS G8124(config-ip-if)# ip address 192.168.1.101 255.255.255.0
RS G8124(config-ip-if)# vlan 10
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 2
RS G8124(config-ip-if)# ip address 192.168.2.100 255.255.255.0
RS G8124(config-ip-if)# vlan 20
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 3
RS G8124(config-ip-if)# ip address 10.0.1.101 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
RS G8124(config)# interface ip 4
RS G8124(config-ip-if)# ip address 10.0.2.100 255.255.255.0
RS G8124(config-ip-if)# enable
RS G8124(config-ip-if)# exit
4. Enable tracking on ports. Set the priority of Virtual Router 2 to 101, so that it
becomes the Master.
5. Configure ports.
RS G8124(config)# vlan 10
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 1
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 10
RS G8124(config-if)# exit
RS G8124(config)# vlan 20
RS G8124(config-vlan)# exit
RS G8124(config)# interface port 2
RS G8124(config-if)# switchport mode trunk
RS G8124(config-if)# switchport trunk allowed vlan 20
RS G8124(config-if)# exit
© Copyright IBM Corp. 2014 Chapter 29: Virtual Router Redundancy Protocol 393
VRRP High-Availability Using VLAGs
VRRP can be used in conjunction with VLAGs and LACP-capable servers and
switches to provide seamless redundancy.
Figure 50. Active-Active Configuration using VRRP and VLAGs
VRRP Master
VLAG Peer 1 Server 1
Layer 3
Router VIR: 10.0.1.100 VLAG 1
10.0.1.1
1 10
11
2 Server 2
4 5 12 VLAG 2
Internet ISL 10.0.1.2
4 5 10
1 11 VLAG 3
Server 3
12
2
Layer 3 VRRP Backup 10.0.1.3
Router
VLAG Peer 2
VIR: 10.0.1.100 Network 10.0.1.0/24
See “VLAGs with VRRP” on page 150 for a detailed configuration example.
With LLDP, the G8124 can advertise the presence of its ports, their major
capabilities, and their current status to other LLDP stations in the same LAN. LLDP
transmissions occur on ports at regular intervals or whenever there is a relevant
change to their status. The switch can also receive LLDP information advertised
from adjacent LLDP-capable network devices.
The LLDP transmit function and receive function can be independently configured
on a per-port basis. The administrator can allow any given port to transmit only,
receive only, or both transmit and receive LLDP information.
The LLDP information to be distributed by the G8124 ports, and that which has been
collected from other LLDP stations, is stored in the switch’s Management
Information Base (MIB). Network Management Systems (NMS) can use Simple
Network Management Protocol (SNMP) to access this MIB information.
LLDP-related MIB information is read-only.
Changes, either to the local switch LLDP information or to the remotely received
LLDP information, are flagged within the MIB for convenient tracking by
SNMP-based management systems.
For LLDP to provide expected benefits, all network devices that support LLDP must
be consistent in their LLDP configuration.
To view the LLDP transmit and receive status, use the following commands:
© Copyright IBM Corp. 2014 Chapter 30: Link Layer Discovery Protocol 399
LLDP Transmit Features
Numerous LLDP transmit options are available, including scheduled and minimum
transmit interval, expiration on remote systems, SNMP trap notification, and the
types of information permitted to be shared.
Scheduled Interval
The G8124 can be configured to transmit LLDP information to neighboring devices
once each 5 to 32768 seconds. The scheduled interval is global; the same interval
value applies to all LLDP transmit-enabled ports. However, to help balance LLDP
transmissions and keep them from being sent simultaneously on all ports, each port
maintains its own interval clock, based on its own initialization or reset time. This
allows switch-wide LLDP transmissions to be spread out over time, though
individual ports comply with the configured interval.
The global transmit interval can be configured using the following command:
where interval is the number of seconds between LLDP transmissions. The range is
5 to 32768. The default is 30 seconds.
Minimum Interval
In addition to sending LLDP information at scheduled intervals, LLDP information is
also sent when the G8124 detects relevant changes to its configuration or status
(such as when ports are enabled or disabled). To prevent the G8124 from sending
multiple LLDP packets in rapid succession when port status is in flux, a transmit
delay timer can be configured.
The transmit delay timer represents the minimum time permitted between
successive LLDP transmissions on a port. Any interval-driven or change-driven
updates will be consolidated until the configured transmit delay expires.
The minimum transmit interval can be configured using the following command:
where multiplier is a value between 2 and 10. The default value is 4, meaning that
remote systems will hold the port’s LLDP information for 4 x the 30-second
msgtxint value, or 120 seconds, before removing it from their MIB.
Trap Notifications
If SNMP is enabled on the G8124 (see “Using Simple Network Management
Protocol” on page 31), each port can be configured to send SNMP trap notifications
whenever LLDP transmissions are sent. By default, trap notification is disabled for
each port. The trap notification state can be changed using the following commands
(Interface Port mode):
The trap delay timer represents the minimum time permitted between successive
trap notifications on any port. Any interval-driven or change-driven trap notices from
the port will be consolidated until the configured trap delay expires.
The minimum trap notification interval can be configured using the following
command:
If SNMP trap notification is enabled, the notification messages can also appear in
the system log. This is enabled by default. To change whether the SNMP trap
notifications for LLDP events appear in the system log, use the following command:
© Copyright IBM Corp. 2014 Chapter 30: Link Layer Discovery Protocol 401
Changing the LLDP Transmit State
When the port is disabled, or when LLDP transmit is turned off for the port using the
LLDP admin-status command options (see “Transmit and Receive Control” on
page 399), a final LLDP packet is transmitted with a time-to-live value of 0.
Neighbors that receive this packet will remove the LLDP information associated with
the G8124 port from their MIB.
In addition, if LLDP is fully disabled on a port and then later re-enabled, the G8124
will temporarily delay resuming LLDP transmissions on the port to allow the port
LLDP information to stabilize. The reinitialization delay interval can be globally
configured for all ports using the following command:
© Copyright IBM Corp. 2014 Chapter 30: Link Layer Discovery Protocol 403
LLDP Receive Features
Types of Information Received
When the LLDP receive option is enabled on a port (see “Enabling or Disabling
LLDP” on page 399), the port may receive the following information from
LLDP-capable remote systems:
• Chassis Information
• Port Information
• LLDP Time-to-Live
• Port Description
• System Name
• System Description
• System Capabilities Supported/Enabled
• Remote Management Address
The G8124 stores the collected LLDP information in the MIB. Each remote
LLDP-capable device is responsible for transmitting regular LLDP updates. If the
received updates contain LLDP information changes (to port state, configuration,
LLDP MIB structures, deletion), the switch will set a change flag within the MIB for
convenient notification to SNMP-based management systems.
Using the isCLI the following command displays remote LLDP information:
To view a summary of remote information, omit the Index number parameter. For
example:
System Name :
System Description: IBM Networking Operating System RackSwitch G8124, IBM
Networking OS: version 7.11, Boot Image: version 7.11
Note: Received LLDP information can change very quickly. When using show
commands, it is possible that flags for some expected events may be too
short-lived to be observed in the output.
© Copyright IBM Corp. 2014 Chapter 30: Link Layer Discovery Protocol 405
To view detailed information of all remote devices, use the following command:
System Name :
System Description : IBM Networking Operating System
RackSwitch G8124, IBM Networking OS: version 7.11, Boot Image: version 6.9.1.14
System Capabilities Supported : bridge, router
System Capabilities Enabled : bridge, router
System Name :
System Description : IBM Networking Operating System
RackSwitch G8124, IBM Networking OS: version 7.11, Boot Image: version 6.9.1.14
System Capabilities Supported : bridge, router
System Capabilities Enabled : bridge, router
Remote devices can also intentionally set their LLDP time-to-live to 0, indicating to
the switch that the LLDP information is invalid and must be immediately removed.
© Copyright IBM Corp. 2014 Chapter 30: Link Layer Discovery Protocol 407
408 RackSwitch G8124: Application Guide
Chapter 31. Simple Network Management Protocol
IBM Networking OS provides Simple Network Management Protocol (SNMP)
version 1, version 2, and version 3 support for access through any network
management software, such as IBM Director or HP-OpenView.
Note: SNMP read and write functions are enabled by default. For best security
practices, if SNMP is not needed for your network, it is recommended that
you disable these functions prior to connecting the switch to the network.
The read and write community strings on the switch can be changed using the
following commands on the CLI:
The SNMP manager must be able to reach the management interface or any one of
the IP interfaces on the switch.
For the SNMP manager to receive the SNMPv1 traps sent out by the SNMP agent
on the switch, configure the trap host on the switch with the following command:
Note: You can use a loopback interface to set the source IP address for SNMP
traps. Use the following command to apply a configured loopback interface:
RS G8124(config)# snmp-server trap-source loopback <1-5>
RS G8124(config)# snmp-server ?
For more information on SNMP MIBs and the commands used to configure SNMP
on the switch, see the IBM Networking OS 7.11 Command Reference.
Default Configuration
IBM N/OS has three SNMPv3 users by default. All the three users have access to
all the MIBs supported by the switch:
• User 1 name is adminmd5 (password adminmd5). Authentication used is MD5.
Privacy protocol used is DES.
• User 2 name is adminsha (password adminsha). Authentication used is SHA.
Privacy protocol used is DES.
• User 3 name is adminshaaes (password Edpq132x!#9Zpx432w). Authenti-
cation used is SHA. Privacy protocol used is AES-128.
In boot strict mode (See “Boot Strict Mode” on page 36), IBM N/OS has one
SNMPv3 user:
• User 1 name is adminshaaes (password Edpq132x!#9Zpx432w). Authenti-
cation used is SHA. Privacy protocol used is AES-128.
2. Configure a user access group, along with the views the group may access.
Use the access table to configure the group’s access level.
Because the read view, write view, and notify view are all set to “iso,” the user
type has access to all private and public MIBs.
3. Assign the user to the user group. Use the group table to link the user to a
particular access group.
© Copyright IBM Corp. 2014 Chapter 31: Simple Network Management Protocol 411
Configuring SNMP Trap Hosts
SNMPv1 Trap Host
1. Configure a user with no authentication and password.
2. Configure an access group and group table entries for the user. Use the
following menu to specify which traps can be received by the user:
In the following example the user will receive the traps sent by the switch.
4. Specify the IPv4 address and other trap parameters in the targetAddr and
targetParam tables. Use the following commands to specify the user name
associated with the targetParam table:
Note: N/OS 7.11 supports only IPv4 addresses for SNMPv1 and SNMPv2 trap
hosts.
5. Use the community table to specify which community string is used in the trap.
The SNMPv2 trap host configuration is similar to the SNMPv1 trap host
configuration. Wherever you specify the model, use snmpv2 instead of snmpv1.
Note: N/OS 7.11 supports only IPv4 addresses for SNMPv1 and SNMPv2 trap
hosts.
© Copyright IBM Corp. 2014 Chapter 31: Simple Network Management Protocol 413
SNMPv3 Trap Host Configuration
To configure a user for SNMPv3 traps, you can choose to send the traps with both
privacy and authentication, with authentication only, or without privacy or
authentication.
It is not necessary to configure the community table for SNMPv3 traps because the
community string is not used by SNMPv3.
The following example shows how to configure a SNMPv3 user v3trap with
authentication only:
The N/OS SNMP agent supports the following generic traps as defined in RFC
1215:
• ColdStart
• WarmStart
• LinkDown
• LinkUp
• AuthenticationFailure
The SNMP agent also supports two Spanning Tree traps as defined in RFC 1493:
• NewRoot
• TopologyChange
© Copyright IBM Corp. 2014 Chapter 31: Simple Network Management Protocol 415
The following are the enterprise SNMP traps supported in N/OS:
Table 33. IBM N/OS-Supported Enterprise SNMP Traps
© Copyright IBM Corp. 2014 Chapter 31: Simple Network Management Protocol 417
Table 33. IBM N/OS-Supported Enterprise SNMP Traps (continued)
© Copyright IBM Corp. 2014 Chapter 31: Simple Network Management Protocol 419
Table 33. IBM N/OS-Supported Enterprise SNMP Traps (continued)
The table lists the MIBS used to perform operations associated with the Switch
Image and Configuration files.
Table 34. MIBs for Switch Image and Configuration Files
agTransferServer 1.3.6.1.4.26543.2.5.1.1.7.1.0
agTransferImage 1.3.6.1.4.26543.2.5.1.1.7.2.0
agTransferImageFileName 1.3.6.1.4.26543.2.5.1.1.7.3.0
agTransferCfgFileName 1.3.6.1.4.26543.2.5.1.1.7.4.0
agTransferDumpFileName 1.3.6.1.4.26543.2.5.1.1.7.5.0
agTransferAction 1.3.6.1.4.26543.2.5.1.1.7.6.0
agTransferLastActionStatus 1.3.6.1.4.26543.2.5.1.1.7.7.0
agTransferUserName 1.3.6.1.4.26543.2.5.1.1.7.9.0
agTransferPassword 1.3.6.1.4.1.26543.2.5.1.1.7.10.0
agTransferTSDumpFileName 1.3.6.1.4.1.26543.2.5.1.1.7.11.0
The following SNMP actions can be performed using the MIBs listed in the table:
• Load a new Switch image (boot or running) from an FTP, SFTP, or TFTP server
• Load a previously saved switch configuration from an FTP, SFTP, or TFTP server
• Save the switch configuration to an FTP, SFTP, or TFTP server
• Save a switch dump to an FTP, SFTP, or TFTP server
© Copyright IBM Corp. 2014 Chapter 31: Simple Network Management Protocol 421
Loading a New Switch Image
To load a new switch image with the name “MyNewImage-1.img” into image2,
follow these steps. This example shows an FTP, SFTP, or TFTP server at IPv4
address 192.168.10.10, though IPv6 is also supported.
1. Set the FTP, SFTP, or TFTP server address where the switch image resides:
Set agTransferServer.0 "192.168.10.10"
2. Set the area where the new image will be loaded:
Set agTransferImage.0 "image2"
3. Set the name of the image:
Set agTransferImageFileName.0 "MyNewImage-1.img"
4. If you are using an FTP or SFTP server, enter a username:
Set agTransferUserName.0 "MyName"
5. If you are using an FTP or SFTP server, enter a password:
Set agTransferPassword.0 "MyPassword"
6. Initiate the transfer. To transfer a switch image, enter 2 (gtimg):
Set agTransferAction.0 "2"
© Copyright IBM Corp. 2014 Chapter 31: Simple Network Management Protocol 423
424 RackSwitch G8124: Application Guide
Chapter 32. NETCONF
The Network Configuration Protocol (NETCONF) provides a mechanism to manage
the G8124, retrieve or modify existing configuration data, and upload new
configuration data. See RFC 4741 for details on NETCONF.
The NETCONF protocol defines basic operations that are equivalent to the switch
ISCLI commands.
Note: The current implementation of NETCONF supports only ISCLI commands.
<hello>
<capabilities/>
</hello>
<hello>
<capabilities/>
</hello>
<rpc>
<operation/>
</rpc>
<rpc-reply>
<operation-response/>
NETCONF </rpc-reply> NETCONF
Client <rpc> Server
<close-session/>
</rpc>
<rpc-reply>
<ok/>
</rpc-reply>
Session
• Session-ID
Before installing the NETCONF client, ensure you have completed the following
tasks:
• Install a supported version of Python (Python 2.6 or higher, up to but not
including Python 3.0) in the folder C:\.
• Install the PyCrypto application appropriate to the Python version you are using.
Note: The following steps are for the Windows operating systems.
Follow these steps to install the Blade NETCONF Python Client (BNClient):
1. Extract the file blade-netconf-python-client-v0.1.zip to the
following folder: C:\
You will see two folders under the root folder
C:\blade-netconf-python-client-v0.1:
– blade-netconf-python-client
– python-ssh-library
Note: Ensure you see Paramiko version 1.7.4 or higher in the folder
C:\blade-netconf-python-client-v0.1\python-ssh-library\
2. Open the command prompt (Select Start > Run > cmd).
3. Enter the following command to install the SSH library:
python C:\blade-netconf-python-client-v0.1\python-ssh-library\
paramiko-1.7.6\setup.py install
Note: If the python command does not work from the command prompt, you may
need to add a system variable to set the path to the directory where you
have installed Python. You can add the system variable at the following
location: My Computer > Properties > Advanced > Environment
Variables
python C:\blade-netconf-python-client-v0.1\blade-netconf-python-
client\bnclient\bnclient.py –h
python C:\blade-netconf-python-client-v0.1\blade-netconf-python-
client\bnclient\bnclient.py {switch IP address} –u admin –p admin –o get
python C:\blade-netconf-python-client-v0.1\blade-netconf-python-
client\bnclient\bnclient.py {switch IP address}:22 –u admin –p admin –o get
As a python library:
a. Open the file
C:\blade-netconf-python-client-v0.1\blade-netconf-
python-client\example\get.py in a Python editor (For example, IDLE).
b. Change the IP address in the hostname field to the switch IP address, and
save the file.
c. Enter the following command to establish a session:
python C:\blade-netconf-python-client-v0.1\blade-netconf-python-
client\setup.py install
python C:\blade-netconf-python-client-v0.1\blade-netconf-python-
client\example\get.py
Note: get.py is an example of a NETCONF operation python script. You can edit
the script or write a new script as per your requirements.
Note: get.pl is an example of a NETCONF operation Perl script. You can edit the
script or write a new script as per your requirement.
Follow these steps to establish a NETCONF session. Enter commands in the client
Linux Shell.
Note: You can open a maximum of four simultaneous sessions.
1. Enter the following command to open an SSH connection:
<hello>
<capabilities>
<capability>urn:ietf:params:netconf:base:1.0</capability>
</capabilities>
</hello>
]]>]]>
<hello xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<capabilities>
<capability>urn:ietf:params:netconf:base:1.0</capability>
<capability>urn:ietf:params:netconf:capability:writable-running:1.0</c
apability>
<capability>urn:ietf:params:netconf:capability:rollback-on-error:1.0</
capability>
<capability>urn:ietf:params:netconf:capability:startup:1.0</capability
>
</capabilities>
<session-id>102</session-id>
</hello>
]]>]]>
<rpc message-id=“100”>
<get>
<filter type=“subtree”>
<configuration-text/>
</filter>
</get>
</rpc>
]]>]]>
<rpc-reply message-id=“100”>
<data>
<configuration-text
xmlns=“http://www.ibm.com/netconf/1.0/config-text”> version
“6.9.1”
switch-type “IBM Networking Operating System RackSwitch
G8124”
!
!
no system dhcp mgta
!
!
interface ip 127
ip address 172.31.36.51
enable
exit
!
ip gateway 3 address 172.31.1.1
ip gateway 3 enable
!
!
end
</configuration-text>
</data>
</rpc-reply>
]]>]]>
Note: Repeat Step 3 for each request you need to send to the switch.
4. Type or paste the following close-session message to close the NETCONF
session and terminate the SSH connection.
<rpc message-id=“101”>
<close-session/>
</rpc>
]]>]]>
<rpc-reply message-id=“101”>
<ok/>
</rpc-reply>
]]>]]>
Operation Description
<get-config>
Usage:
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<data>
<configuration-text
xmlns=“http://www.ibm.com/netconf/1.0/config-text”>
<!-- configuration text... -->
</configuration-text>
</data>
</rpc-reply>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<ok/>
</rpc-reply>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<ok/>
</rpc-reply>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<ok/>
</rpc-reply>
<lock>
Usage:
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<ok/>
</rpc-reply>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<ok/>
</rpc-reply>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<data>
<configuration-text
xmlns=“http://www.ibm.com/netconf/1.0/config-text”>
<!-- configuration text... -->
</configuration -text>
</data>
</rpc-reply>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<ok/>
</rpc-reply>
<kill-session>
Usage:
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<ok/>
</rpc-reply>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<data>
<configuration-text
xmlns=“http://www.ibm.com/netconf/1.0/config-text”>
<!-- configuration text... -->
</configuration -text>
</data>
</rpc-reply>
<rpc message-id=“101”>
<get-interface-information>
<interface-name> port xx </interface-name>
<brief/>
</get-interface-information>
</rpc>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<interface-information>
<physical-interface>
<name></name>
<admin-status></admin-status>
<oper-status></oper-status>
<local-index></local-index>
<if-type></if-type>
<link-level-type></link-level-type>
<mtu></mtu>
<speed></speed>
<link-type></link-type>
<traffic-statistics>
<input-bytes></input-bytes>
<output-bytes></output-bytes>
<input-packets></input-packets>
<output-packets></output-packets>
</traffic-statistics>
<input-error-list>
<input-errors></input-errors>
<framing-errors></framing-errors>
<input-giants></input-giants>
<input-discards></input-discards>
</input-error-list>
<output-error-list>
<output-collisions></output-collisions>
<output-errors></output-errors>
<output-drops></output-drops>
</output-error-list>
</physical-interface>
</interface-information>
</rpc-reply>
<rpc-reply message-id=“101”
xmlns=“urn:ietf:params:xml:ns:netconf:base:1.0”>
<interface-information>
<physical-interface>
<logical-interface>
<name></name>
<local-index></local-index>
<address-family>
<address-family-name></address-family-name>
<mtu></mtu>
<interface-address>
<ifa-destination></ifa-destination>
<ifa-local></ifa-local>
<ifa-broadcast></ifa-broadcast>
</interface-address>
</address-family>
</logical-interface>
</physical-interface>
</interface-information>
</rpc-reply>
link-level-type Ethernet
address-family-name inet
RMON Overview
The RMON MIB provides an interface between the RMON agent on the switch and
an RMON management application. The RMON MIB is described in RFC 1757.
The RMON standard defines objects that are suitable for the management of
Ethernet networks. The RMON agent continuously collects statistics and proactively
monitors switch performance. RMON allows you to monitor traffic flowing through
the switch.
The switch supports the following RMON Groups, as described in RFC 1757:
• Group 1: Statistics
• Group 2: History
• Group 3: Alarms
• Group 9: Events
RMON statistics are sampled every second, and new data overwrites any old data
on a given port.
Note: RMON port statistics must be enabled for the port before you can view
RMON statistics.
Example Configuration
1. Enable RMON on a port.
RS G8124(config)# interface port 1
RS G8124(config-if)# rmon
Data is stored in buckets, which store data gathered during discreet sampling
intervals. At each configured interval, the History index takes a sample of the current
Ethernet statistics, and places them into a bucket. History data buckets reside in
dynamic memory. When the switch is re-booted, the buckets are emptied.
Requested buckets are the number of buckets, or data slots, requested by the user
for each History Group. Granted buckets are the number of buckets granted by the
system, based on the amount of system memory available. The system grants a
maximum of 50 buckets.
The last digit (x) represents the number of the port to monitor.
where <x> is the number of the port to monitor. For example, the full OID for port
1 would be:
1.3.6.1.2.1.2.2.1.1.1
Index Owner
----- ----------------------------------------------
1 rmon port 1 history
Each Alarm index consists of a variable to monitor, a sampling time interval, and
parameters for rising and falling thresholds. The Alarm Group can be used to track
rising or falling values for a MIB object. The object must be a counter, gauge,
integer, or time interval.
Use one of the following commands to correlate an Alarm index to an Event index:
RS G8124(config)# rmon alarm <alarm number> rising-crossing-index <event number>
RS G8124(config)# rmon alarm <alarm number> falling-crossing-index <event number>
This value represents the alarm’s MIB OID, as a string. Note that for non-tables, you
must supply a .0 to specify end node.
RMON events use SNMP and syslogs to send notifications. Therefore, an SNMP
trap host must be configured for trap event notification to work properly.
RMON uses a syslog host to send syslog messages. Therefore, an existing syslog
host must be configured for event log notification to work properly. Each log event
generates a syslog of type RMON that corresponds to the event.
This configuration creates an RMON event that sends a syslog message each time
it is triggered by an alarm.
The G8124 supports a “many to one” mirroring model. As shown in Figure 52,
selected traffic for ports 1 and 2 is being monitored by port 3. In the example, both
ingress traffic and egress traffic on port 2 are copied and forwarded to the monitor.
However, port 1 mirroring is configured so that only ingress traffic is copied and
forwarded to the monitor. A device attached to port 3 can analyze the resulting
mirrored traffic.
Figure 52. Mirroring Ports
1 2 3 4
The G8124 supports four monitor ports. Each monitor port can receive mirrored
traffic from any number of target ports.
IBM N/OS does not support “one to many” or “many to many” mirroring models
where traffic from a specific port traffic is copied to multiple monitor ports. For
example, port 1 traffic cannot be monitored by both port 3 and 4 at the same time,
nor can port 2 ingress traffic be monitored by a different port than its egress traffic.
Ingress and egress traffic is duplicated and sent to the monitor port after processing.
The following procedure may be used to configure port mirroring for the example
shown in Figure 52 on page 457:
1. Specify the monitoring port, the mirroring port(s), and the port-mirror direction.
You can solve many problems without outside assistance by following the
troubleshooting procedures that IBM provides in the online help or in the
documentation that is provided with your IBM product. The documentation that
comes with IBM systems also describes the diagnostic tests that you can perform.
Most systems, operating systems, and programs come with documentation that
contains troubleshooting procedures and explanations of error messages and error
codes. If you suspect a software problem, see the documentation for the operating
system or program.
You can find service information for IBM systems and optional devices at
http://www.ibm.com/support/.
For more information about Support Line and other IBM services, see
http://www.ibm.com/services/, or see http://www.ibm.com/planetwide/ for support
telephone numbers. In the U.S. and Canada, call 1-800-IBM-SERV
(1-800-426-7378).
In the U.S. and Canada, hardware service and support is available 24 hours a day,
7 days a week. In the U.K., these services are available Monday through Friday,
from 9 a.m. to 6 p.m.
IBM may not offer the products, services, or features discussed in this document in
other countries. Consult your local IBM representative for information on the
products and services currently available in your area. Any reference to an IBM
product, program, or service is not intended to state or imply that only that IBM
product, program, or service may be used. Any functionally equivalent product,
program, or service that does not infringe any IBM intellectual property right may be
used instead. However, it is the user's responsibility to evaluate and verify the
operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter
described in this document. The furnishing of this document does not give you any
license to these patents. You can send license inquiries, in writing, to:
IBM may use or distribute any of the information you supply in any way it believes
appropriate without incurring any obligation to you.
Intel, Intel Xeon, Itanium, and Pentium are trademarks or registered trademarks of
Intel Corporation or its subsidiaries in the United States and other countries.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc., in
the United States, other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other
countries.
CD or DVD drive speed is the variable read rate. Actual speeds vary and are often
less than the possible maximum.
When referring to processor storage, real and virtual storage, or channel volume,
KB stands for 1024 bytes, MB stands for 1 048 576 bytes, and GB stands for
1 073 741 824 bytes.
Maximum internal hard disk drive capacities assume the replacement of any
standard hard disk drives and population of all hard disk drive bays with the largest
currently supported drives that are available from IBM.
Some software might differ from its retail version (if available) and might not include
user manuals or all program functionality.
Particulate • The room air must be continuously filtered with 40% atmospheric dust
spot efficiency (MERV 9) according to ASHRAE Standard 52.21.
• Air that enters a data center must be filtered to 99.97% efficiency or
greater, using high-efficiency particulate air (HEPA) filters that meet
MIL-STD-282.
• The deliquescent relative humidity of the particulate contamination
must be more than 60%2.
• The room must be free of conductive contamination such as zinc whis-
kers.
the dust absorbs enough water to become wet and promote ionic conduction.
3
ANSI/ISA-71.04-1985. Environmental conditions for process measurement and control systems:
Airborne contaminants. Instrument Society of America, Research Triangle Park, North Carolina,
U.S.A.
In the request, be sure to include the publication part number and title.
When you send information to IBM, you grant IBM a non-exclusive right to use or
distribute the information in any way it believes appropriate without incurring any
obligation to you.
Properly shielded and grounded cables and connectors must be used in order to
meet FCC emission limits. IBM is not responsible for any radio or television
interference caused by using other than recommended cables and connectors or by
unauthorized changes or modifications to this equipment. Unauthorized changes or
modifications could void the user's authority to operate the equipment.
This device complies with Part 15 of the FCC Rules. Operation is subject to the
following two conditions: (1) this device may not cause harmful interference, and (2)
this device must accept any interference received, including interference that may
cause undesired operation.
Responsible manufacturer:
Dieses Gerät ist berechtigt, in Übereinstimmung mit dem Deutschen EMVG das
EG-Konformitätszeichen - CE - zu führen.
Verantwortlich für die Einhaltung der EMV Vorschriften ist der Hersteller:
IBM Deutschland
Technical Regulations, Department M456
IBM-Allee 1, 71137 Ehningen, Germany
Telephone: +49 7032 15-2937
E-mail: tjahn@de.ibm.com
Generelle Informationen:
This is a Class A product based on the standard of the Voluntary Control Council for
Interference (VCCI). If this equipment is used in a domestic environment, radio
interference may occur, in which case the user may be required to take corrective
actions.
Please note that this equipment has obtained EMC registration for commercial use.
In the event that it has been mistakenly sold or purchased, please exchange it for
equipment certified for home use.