fabricpath: ce to fp vlan communication case study · 2018. 3. 21. · cisco systems fabricpath: ce...

Advanced Services

Cisco Systems

Fabricpath: CE to FP VLAN Communication Case study

V0.2 (Draft)

Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 CISCO PUBLIC

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL

STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT

WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.

THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED

WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED

WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.

The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to

part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This

equipment generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio

communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own

expense.

The following information is for FCC compliance of Class B devices: The equipment described in this manual generates and may radiate radio-frequency energy. If it is not installed

in accordance with Cisco’s installation instructions, it may cause interference with radio and television reception. This equipment has been tested and found to comply with the limits

for a Class B digital device in accordance with the specifications in part 15 of the FCC rules. These specifications are designed to provide reasonable protection against such

interference in a residential installation. However, there is no guarantee that interference will not occur in a particular installation.

You can determine whether your equipment is causing interference by turning it off. If the interference stops, it was probably caused by the Cisco equipment or one of its peripheral

devices. If the equipment causes interference to radio or television reception, try to correct the interference by using one or more of the following measures:

Turn the television or radio antenna until the interference stops.

Move the equipment to one side or the other of the television or radio.

Move the equipment farther away from the television or radio.

Plug the equipment into an outlet that is on a different circuit from the television or radio. (That is, make certain the equipment and the television or radio are on circuits controlled

by different circuit breakers or fuses.)

Modifications to this product not authorized by Cisco Systems, Inc. could void the FCC approval and negate your authority to operate the product.

The following third-party software may be included with your product and will be subject to the software license agreement:

CiscoWorks software and documentation are based in part on HP OpenView under license from the Hewlett-Packard Company. HP OpenView is a trademark of the Hewlett-Packard

Company. Copyright 1992, 1993 Hewlett-Packard Company.

The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain

version of the UNIX operating system. All rights reserved. Copyright 1981, Regents of the University of California.

Network Time Protocol (NTP). Copyright 1992, David L. Mills. The University of Delaware makes no representations about the suitability of this software for any purpose.

Point-to-Point Protocol. Copyright 1989, Carnegie-Mellon University. All rights reserved. The name of the University may not be used to endorse or promote products derived

from this software without specific prior written permission.

The Cisco implementation of TN3270 is an adaptation of the TN3270, curses, and termcap programs developed by the University of California, Berkeley (UCB) as part of the UCB’s

public domain version of the UNIX operating system. All rights reserved. Copyright 1981-1988, Regents of the University of California.

Cisco incorporates Fastmac and TrueView software and the RingRunner chip in some Token Ring products. Fastmac software is licensed to Cisco by Madge Networks Limited, and

the RingRunner chip is licensed to Cisco by Madge NV. Fastmac, RingRunner, and TrueView are trademarks and in some jurisdictions registered trademarks of Madge Networks

Limited. Copyright 1995, Madge Networks Limited. All rights reserved.

Xremote is a trademark of Network Computing Devices, Inc. Copyright 1989, Network Computing Devices, Inc., Mountain View, California. NCD makes no representations

about the suitability of this software for any purpose.

The X Window System is a trademark of the X Consortium, Cambridge, Massachusetts. All rights reserved.

NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL

FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE

OF MERCHANTABILITY, FITNESS FOR A PRACTICAL PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE

PRACTICE.

IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING,

WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR

ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

AccessPath, AtmDirector, Browse with Me, CCDE, CCIP, CCSI, CD-PAC, CiscoLink, the Cisco NetWorks logo, the Cisco Powered Network logo, Cisco Systems Networking

Academy, Fast Step, Follow Me Browsing, FormShare, FrameShare, GigaStack, IGX, Internet Quotient, IP/VC, iQ Breakthrough, iQ Expertise, iQ FastTrack, the iQ logo, iQ Net

Readiness Scorecard, MGX, the Networkers logo, Packet, RateMUX, ScriptBuilder, ScriptShare, SlideCast, SMARTnet, TransPath, Unity, Voice LAN, Wavelength Router, and

WebViewer are trademarks of Cisco Systems, Inc.; Changing the Way We Work, Live, Play, and Learn, Discover All That’s Possible, and Empowering the Internet Generation, are

service marks of Cisco Systems, Inc.; and Aironet, ASIST, BPX, Catalyst, CCDA, CCDP, CCIE, CCNA, CCNP, Cisco, the Cisco Certified Internetwork Expert Logo, Cisco IOS,

the Cisco IOS logo, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Enterprise/Solver, EtherChannel, EtherSwitch, FastHub, FastSwitch, IOS, IP/TV, LightStream,

MICA, Network Registrar, PIX, Post-Routing, Pre-Routing, Registrar, StrataView Plus, Stratm, SwitchProbe, TeleRouter, and VCO are registered trademarks of Cisco Systems, Inc.

and/or its affiliates in the U.S. and certain other countries.

All other trademarks mentioned in this document or Web site are the property of their respective owners. The use of the word partner does not imply a partnership relationship

between Cisco and any other company. (0105R)

INTELLECTUAL PROPERTY RIGHTS:

THIS DOCUMENT CONTAINS VALUABLE TRADE SECRETS AND CONFIDENTIAL INFORMATION OF CISCO SYSTEMS, INC. AND IT’S SUPPLIERS, AND SHALL

NOT BE DISCLOSED TO ANY PERSON, ORGANIZATION, OR ENTITY UNLESS SUCH DISCLOSURE IS SUBJECT TO THE PROVISIONS OF A WRITTEN NON-

DISCLOSURE AND PROPRIETARY RIGHTS AGREEMENT OR INTELLECTUAL PROPERTY LICENSE AGREEMENT APPROVED BY CISCO SYSTEMS, INC. THE

DISTRIBUTION OF THIS DOCUMENT DOES NOT GRANT ANY LICENSE IN OR RIGHTS, IN WHOLE OR IN PART, TO THE CONTENT, THE PRODUCT(S),

TECHNOLOGY OF INTELLECTUAL PROPERTY DESCRIBED HEREIN.

Fabricpath: CE to FP VLAN Communication Case study V0.2

Copyright 2010, Cisco Systems, Inc.

All rights reserved.

COMMERCIAL IN CONFIDENCE.

Cisco Systems Fabricpath: CE to FP VLAN Communication Case study CISCO PUBLIC

3 (Draft) V0.2

A printed copy of this document is considered uncontrolled

1. Contents

1. Contents 3

2. Figures 5

3. Tables 6

4. Document Information 7

4.1. Review and Distribution 7

4.2. Modification History 7

5. Introduction 8

5.1. Preface 8

5.2. Audience 8

5.3. Scope 8

5.4. FP Implementation Requirements 8

5.5. Assumptions 9

5.6. Related Documents 9

5.7. References 9

6. Fabricpath Technology Introduction 10

7. Fabricpath Terminologies 11

8. FP VLAN Design Considerations 12

9. Lab Topology 14

10. Hardware and Software Details 15

11. Hardware & Software Verification 16

12. Scenario-1: Extending CE VLAN on FP Domain 17

12.1. Device Configurations 18 12.1.1. N7K-1 18 12.1.2. N7K-2 19 12.1.3. N55K-1 21 12.1.4. N55K-2 22

12.2. Configuration Verification 23 12.2.5. N7K-1 23 12.2.6. N7K-2 26 12.2.7. N55K-1 29 12.2.8. N55K-2 30

12.3. Test Result 31 12.3.9. CE VLAN on N55K-1 Reaching the CE VLAN on N55K-2 31

Contents

Cisco Systems Fabricpath: CE to FP VLAN Communication Case study

CISCO PUBLIC

4 (Draft) V0.2


13. Scenario 2: FP to CE VLAN Routed Traffic 32



13.3. Test Result 49 13.3.9. CE VLAN on N55K-2 Reaching the FP VLAN on N55K-1 49 13.3.10. FP VLAN on N55K-1 Reaching the CE VLAN on N55K-2 50

14. Scenario 3: FP to CE VLAN Routed traffic to the Single homed edge device 51



14.3. Test Result 66 14.3.9. FP VLAN on N55K-1 Reaching the CE VLAN on N55K-2 66 14.3.10. CE VLAN on N55K-2 Reaching the FP VLAN on N55K-1 66

15. Scenario 4: FP VLAN Routed traffic to Single homed FP edge Device 67



15.3. Test Result 82 15.3.9. FP VLAN on N55K-1 Reaching N55K-2 FP edge device 82 15.3.10. Single Homed N55K-2 Reaching the N55K-1 part of FP VLAN 83

16. Summary 84


5 (Draft) V0.2


2. Figures

Figure 1 CE and FP Vlan in Fabric Path 12 Figure 2 Base Topology 14 Figure 3 Extending CE VLAN over vPC+ doamin 17 Figure 4 FP to CE inter vlan Communication 32 Figure 5 FP VLAN talking to the Single homed CE VLAN device 51 Figure 6 FP VLAN talking to the Single homed FP VLAN device 67


6 (Draft) V0.2


3. Tables

Table 1 Equipment details. 15 Table 2 Nexus 7010 Slot Allocation 15 Table 3 Software Details 15


7 (Draft) V0.2


4. Document Information

Author: Muhammed M Change Authority: Advanced Services Change Forecast: High Template Version: 5.2 (09-Sep-2010)

4.1. Review and Distribution Organisation Name Title

4.2. Modification History Rev Date Originator Status Comment 0.1 29-July-2012 Muhammed M Draft/Release Initial version

0.2 07-Aug-2012 Bijoy Antony Draft/Release Added FP Implementation Requirement


8 (Draft) V0.2


5. Introduction

5.1. Preface The purpose of this document is to provide the information necessary to carry out the fabricpath design and implementation and testing in an enterprise environment. The main focus for this document is to provide a tested result of Classical ethernet vlan (CE) interaction with the Fabric path VLAN in a mixed environment. Please note that scenario considered in this document may not be as per the best practices however instead it is convering some of the possible scenarios based on the customer requirement

5.2. Audience This document is intended for use by network engineers who are familiar with Cisco Fabricpath technology and Cisco Nexus platform. It is recommended to use this document as a baseline and do further testing based on customer specific scenarios.

5.3. Scope The scope of this document will cover topology based case study of Fabricpath vlan interacting to the classical ethernet vlan. Also provide various test result based on the given topology. Fabricpath is now supported on wider number of platforms including Neuxs 7000 (F1 card or F2 Card), Nexus 5500, Nexus 2000 attached to Nexus 5500 or Nexus 7000 with F2 card. Particular scope of this document covers only Nexus 7000 with F2 module and Nexus 5500 in a specific LAB setup.

5.4. FP Implementation Requirements

FabricPath requires L2 enhanced Lience one per chassis. Minimum NX-OS support for fabricpath with F2 module is NX-OS 6.0 F2 Lince Card needs to be its own VDC. Please note that it is not recommended to mix

F1 or M1 with F2 in the same VDC. When running FP Core and CE Edge ports must be on an F1/F2 modules or Nexus 5500 FabricPath mode VLANs can only be enabled on F1/F2 modules or Nexus 5500. It is mandatory to enable the same FP mode VLAN EVERYWHERE on all the switches in

the FP Fabric otherwise, FP multidestination trees will be incorrectly built)

Introduction


CISCO PUBLIC

9 (Draft) V0.2


5.5. Assumptions It is assumed that whoever reading this document has a basic understanding of Network concepts and also has basic idea of fabric path technology.

5.6. Related Documents [1] Stick a list of related documents here such as other design info [2] Client Service Descriptions… [3] The [x] will automatically increment

5.7. References [2] Place references to relevant technical documents [3] And standards …. The [REF-x] will automatically increment


10 (Draft) V0.2


6. Fabricpath Technology Introduction

Cisco FabricPath technology on the Cisco Nexus 7000 Series Switches introduces new capabilities and design options that allow customers to create Ethernet fabrics that increase bandwidth availability, provide design flexibility, and simplify and reduce the costs of network and application deployment and operation. Cisco FabricPath uses many of the best characteristics of traditional Layer 2 and Layer 3 technologies, combining them into a new control-plane and data-plane implementation that combines the immediately operational “plug-and-play” deployment model of a bridged spanning-tree environment with the stability, reconvergence characteristics, and ability to use multiple parallel paths typical of a Layer 3 routed environment. The result is a scalable, flexible, and highly available Ethernet fabric suitable for even the most demanding data center environments. FabricPath do not have limitations which spanning tree has. In fact FabricPath is using benefits from both layer 2 and 3 technologies. It is first time when layer 2 protocols uses well known routing protocol (ISIS) to forward frames. At the same time FabricPath limits number of the MAC addresses stored on each device on the network. That is done with the FabricPath feature called “conversational learning”. FabricPath allow building and easily expanding large layer 2 domain. With FabricPath, Layer 2 domain could be built ones and do not require any significant changes for long period of time. Having “flat” network will allow us to utilize network port capacity in most effective and flexible way.


11 (Draft) V0.2


7. Fabricpath Terminologies

Cisco FabricPath domain – is layer 2 domain, formed by interconnected fabric path core interfaces and carrying fabricpath VLANs traffic. All traffic in Cisco FabricPath domain is Cisco FabricPath encapsulated. Cisco FabricPath core port – Interface connected another FabricPath Device. FabricPath Core ports sends/receives traffic with FabricPath header. FabricPatch Core Ports does not participate in spanning tree. FabricPatch Core Ports does not perform MAC learning instead it exchange topology info through L2 ISIS adjacency. FabricPatch forwarding is based on “Swtich ID Table” FabricPath core interface carry traffic encapsulated into Cisco FabricPath frame and could also be referred as FabricPath (FP) port. FabricPath core port must be connected to another FabricPath core port. FabricPath core port carries all FabricPath VLANs and therefore can conceptually consider as a trunk port. Cisco FabricPath edge port - Interface at the edge of the Cisco FabricPath domain or Interface connected to traditional network device. FabricPath Edge ports sends/receives traffic in standard 802.3 Ethernet frame format & participate in STP domain. FabricPatch Edge Por forwarding is based on MAC table. CE Edge port can be configured as switchport mode access or switchport mode trunk. FabricPath edge port may be connected to any standard Ethernet port. Cisco FabricPath edge port will be used to attach any regular Ethernet device to the Cisco FabricPath domain. FabricPath vlan – vlan allowed crossing Cisco FabricPath domain. Classical Ethernet vlan – vlan which will not be allowed to cross Cisco FabricPath domain, but will be allowed to exist on the edge interfaces of the Cisco FabricPath attached device. Spine – switch configured as part of fabricpath domain with all interfaces configured in fabricpath mode Leaf – switch configured as part of fabricpath domain with some interfaces configured in fabricpath mode and other interfaces configured in classical Ethernet mode FTAG – (forwarding tag) is the 10-bit field in fabricpath encapsulation identifying topology and/or distribution tree


12 (Draft) V0.2


8. FP VLAN Design Considerations

Once the feature FabricPath is enabled, Vlans should be define as Fabricpath mode Vlans and put the relevant interface in fabricpath mode. If the VLAN is defined as mode FP, same vlan can be extended across the switching domain with vpc+ or a non vPC configuration. By default, when you create Vlan on Nexus 7k, the vlan operates in Classic Ethernet or CE mode. Only Fabricpath-mode vlans are carried over FP interfaces. However that fabricpath edge ports (i.e., CE interfaces or 802.1q trunk ports) can be part of Fabric path domain if the vlan defined as FP vlan. The mode (CE or FabricPath) of a given VLAN has only VDC-local significance. Other VDC’s or other switches in the network have no knowledge of the mode of a VLAN on any other switches. If there is a range of Vlans on CE switch and then you connect that switch to a Fabricpath edge port, the FP switch will have the same VLAN IDs defined but it should be defined as mode fabricpath show in the following figure:

Figure 1 CE and FP Vlan in Fabric Path

vPC+

Vlan 10,20 Vlan 10,20

F2

F2

F2

F2

802.1Q trunk 802.1Q trunk

Fabricpath Core Port

VLAN 10,20

All VLANs that are meant to be forwarded across FabricPath cloud must be defined as FabricPath VLANs. By default, all VLANs are in CE mode. These CE VLANs are not brought up on FabricPath links. They can be forwarded on the FabricPath edge ports (802.1q trunk ports) locally or to other Classic Ethernet switches.

Ingress FabricPath switch determines destination Switch ID and imposes FabricPath header to the normal Frame.

Destination Switch ID used to make routing decisions through FabricPath core

No MAC learning or lookups required inside core

Egress FabricPath switch removes FabricPath header and forwards to CE

FP VLAN Design Considerations


CISCO PUBLIC

13 (Draft) V0.2


In a mixed environment the import difference between a CE and FP VLAN is where the traffic flooded is, a packet arriving on a port (FP VLAN) is flooded across the fabric, a packet on another port (CE VLAN) is forwarded locally but not flooded across the fabric


14 (Draft) V0.2


9. Lab Topology

The Figure 2 is the baseline topology used for testing the deffernt FP to CE communication scenarios. The scope of this figure is to help reader about the physical connectivity between the devices. The logical topology including the VLAN and IP details will be covered in each scenarios sperately.

Figure 2 Base Topology

N7010-1 N7010-2

8/1

8/2

8/1

8/2

8/3

8/4

8/3

8/4

8/98/10

1/2 1/21/1

1/1

8/10 8/9

N5548-01 N5548-02

Po120(Non-vPC trunk)

Po110 (Peer-link)

10 Gig Interface

As shown in the figure there are two port-channels connected back to back between the Nexus 7010 switches .The vPC peer-link is configured as fabricpath core port to pass all the fabric path mode vlans. The non-vPC trunk port is used to allow the vlans defined as CE and also to pass vPC keep-alive traffic.

Note The physical connectivity details including vPC peer-link, NonvPC trunk Link and Port-channel configuration between the Nexus 7010 switches shown in the above figure will be common for all the topologies.


15 (Draft) V0.2


10. Hardware and Software Details

Table 1 Equipment details.

Platform Details Qty

Nexus7000 C7010 (10 Slot) Chassis 2

N7K-SUP1 4

N7K-F248XP-25 2

N7K-C7010-FAB-2 10

Nexus5548 Chassis 2

Table 2 Nexus 7010 Slot Allocation

Slot Product Description

5 Sup1(N7K-SUP1)

6 Sup1(N7K-SUP1)

7 Empty

8 N7K-F248XP-25

9 Empty

10 Empty

Table 3 Software Details

Platform Software version/Feature Set/License Image Name

Nexus 7010 6.0(3) n7000-s1-dk9.6.0.3.bin

n7000-s1-kickstart.6.0.3.bin

Nexus 7000 Advanced LAN Enterprise License (VDC, CTS ONLY)

Enhanced Layer 2 License ( FabricPath)

Nexus 5548 5.1(3)N2(1) n5000-uk9.5.1.3.N2.1.bin

n5000-uk9-kickstart.5.1.3.N2.1.bin


16 (Draft) V0.2


11. Hardware & Software Verification

The status details of the Hardware modules and software version used on the Nexus 7010 boxes are given below. The

same modules and software are utilized on both Nexus 7010 chassis

!

N7K-1

N7K-1# sh module

Mod Ports Module-Type Model Status

--- ----- ----------------------------------- ------------------ ----------

4 48 10/100/1000 Mbps Ethernet Module N7K-M148GT-11 ok

5 0 Supervisor module-1X N7K-SUP1 ha-standby

6 0 Supervisor module-1X N7K-SUP1 active *

8 48 1/10 Gbps Ethernet Module N7K-F248XP-25 ok

Mod Sw Hw

--- -------------- ------

4 6.0(3) 1.4

5 6.0(3) 1.6

6 6.0(3) 1.6

8 6.0(3) 1.0

------------------------------

N7K-2

N7K-2(config-if)# sh mac address-table dynamic

Legend:

* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC

age - seconds since last seen,+ - primary entry using vPC Peer-Link

VLAN MAC Address Type age Secure NTFY Ports/SWID.SSID.LID

---------+-----------------+--------+---------+------+----+------------------

* 200 f866.f206.fb43 dynamic 0 F F Po120

N7K-2(config-if)# sh module

Mod Ports Module-Type Model Status

--- ----- ----------------------------------- ------------------ ----------

4 48 10/100/1000 Mbps Ethernet Module N7K-M148GT-11 ok

5 0 Supervisor module-1X N7K-SUP1 active *

6 0 Supervisor module-1X N7K-SUP1 ha-standby

8 48 1/10 Gbps Ethernet Module N7K-F248XP-25 ok

Mod Sw Hw

--- -------------- ------

4 6.0(3) 1.4

5 6.0(3) 1.6

6 6.0(3) 1.6

8 6.0(3) 1.0

Scenario-1: Extending CE VLAN on FP Domain


CISCO PUBLIC

17 (Draft) V0.2


12. Scenario-1: Extending CE VLAN on FP Domain

In this scenario the focus is to demonstrate how the CE vlan can be extended across fabric path domain. As shown in

figure 3: Vlan 20 is configured as CE vlan on Nexus 5500 access switches, where as the same vlan is configured as

fabricpath vlan on both Nexus 7010 switches.

The connectivity between the Nexus 7010 and Nexus 5500 switches are configured as normal trunk/Farbric edge port.

Figure 3 Extending CE VLAN over vPC+ doamin

SVI 20: 20.1.1.1 SVI 20: 20.1.1.2

vPC+

N55K-1 N55K-2

vPC peer-link

vPC keep-alive Link

FP VLAN 20 FP VLAN 20

CE VLAN 20CE VLAN 20

N7K-1N7K-2

Po 51Po 52

USE CASE:

The above topology is relevant when non-fabric path device need to connect to the fabric path domain. I.e the same

vlan need to be available across the fabricpath enable devices and non fabricpath devices.



CISCO PUBLIC

18 (Draft) V0.2


12.1. Device Configurations

12.1.1. N7K-1

!Command: show running-config

!Time: Fri Aug 3 17:43:06 2012

version 6.0(3)

feature-set fabricpath

hostname N7K-1

feature tacacs+

cfs eth distribute

feature interface-vlan

feature hsrp

feature lacp

feature vpc

feature lldp

username admin password 5 $1$auCnf9aG$Z0neTlzasmESXCAVlRgD// role vdc-admin

vlan 1

vlan 20

mode fabricpath

name N5K-SERVER-VLAN

vlan 200

name vPC-keepalive

spanning-tree pathcost method long

spanning-tree port type edge bpduguard default

spanning-tree vlan 1-3967 priority 8192

vpc domain 30

role priority 20

peer-keepalive destination 200.1.1.3 source 200.1.1.4 vrf KA

auto-recovery

fabricpath switch-id 3

interface Vlan200

no shutdown

vrf member KA

ip address 200.1.1.4/24

interface port-channel51

Description To_N55K-1

switchport

switchport mode trunk

switchport trunk allowed vlan 20

vpc 51



switchport



vpc 52


Description vPC-peer-link

switchport

switchport mode fabricpath

vpc peer-link



CISCO PUBLIC

19 (Draft) V0.2



Description Non-vPC-trunk

switchport



interface Ethernet8/1

switchport


channel-group 110 mode active

no shutdown


switchport



no shutdown


switchport




no shutdown


switchport




no shutdown


switchport




no shutdown


switchport




no shutdown

fabricpath domain default

root-priority 254


12.1.2. N7K-2

!


!Time: Fri Aug 3 14:40:26 2012

version 6.0(3)


hostname N7K-2

feature tacacs+

cfs eth distribute




CISCO PUBLIC

20 (Draft) V0.2


feature hsrp

feature lacp

feature vpc

feature lldp

username admin password 5 $1$tEWzhPMP$cHBm2mrwkag1Yqpz4gCSC. role vdc-admin

ip domain-lookup

vlan 1

vlan 20

mode fabricpath


vlan 200

name vPC-keepalive




vpc domain 30

role priority 10


auto-recovery


interface Vlan200

no shutdown

vrf member KA

ip address 200.1.1.3/24



switchport



vpc 51



switchport



vpc 52



switchport


vpc peer-link


Description Non-vPC-Trunk

switchport




switchport



no shutdown


switchport




CISCO PUBLIC

21 (Draft) V0.2



no shutdown


switchport




no shutdown


switchport




no shutdown


switchport




no shutdown


switchport




no shutdown

line vty


root-priority 255


N7K-1#

12.1.3. N55K-1

!


!Time: Fri Aug 3 05:33:47 2012

version 5.1(3)N2(1)

hostname N55K-1

feature telnet

feature tacacs+

cfs eth distribute


feature lacp

feature lldp

username admin password 5 $1$up6VlJix$8E/6RphXw8ehWHx0Pf9UG0 role network-admin

username Cisco.123 password 5 ! role network-admin

username Cisco@123 password 5 $1$Hv6f0NFz$hE3qBt7958S9M/IB5I0Ps0 role network-admi

ssh key rsa 2048

ip domain-lookup

vlan 20




CISCO PUBLIC

22 (Draft) V0.2




spanning-tree vlan 1-3967,4048-4093 priority 61440

interface Vlan20

no shutdown

ip address 20.1.1.1/24


Description To_N7K-1&N7K-2



switchport




no shutdown


switchport




no shutdown

boot kickstart bootflash:/n5000-uk9-kickstart.5.1.3.N2.1.bin

boot system bootflash:/n5000-uk9.5.1.3.N2.1.bin

!

!

12.1.4. N55K-2

!


!Time: Thu Apr 9 12:05:48 2009

version 5.1(3)N2(1)

hostname N55K-2

feature telnet

feature tacacs+

cfs eth distribute


feature lacp

username admin password 5 $1$tt6xvpX8$Lgh9CgRYnzc8Hfh.tHYrk1 role network-admin

ssh key rsa 2048

ip domain-lookup

vlan 20





interface Vlan20

no shutdown





CISCO PUBLIC

23 (Draft) V0.2













line console

line vty



logging logfile syslog.log 5

logging timestamp milliseconds

no logging console

N55K-2#

12.2. Configuration Verification

12.2.5. N7K-1

!

Configuration terminal

VLAN verification:

N7K-1# sh vlan

VLAN Name Status Ports

---- -------------------------------- --------- -------------------------------

1 default active

20 N55K-SERVER-VLAN active Po51, Po52, Po110, Eth8/1

Eth8/2, Eth8/9, Eth8/10

200 vPC-keepalive active Po120, Eth8/3, Eth8/4

VLAN Type Vlan-mode

---- ----- ----------

1 enet CE

20 enet FABRICPATH

200 enet CE

Remote SPAN VLANs

-------------------------------------------------------------------------------

Primary Secondary Type Ports

------- --------- --------------- -------------------------------------------

vPC verification:

N7K-1# sh vpc

Legend:

(*) - local vPC is down, forwarding via vPC peer-link

vPC domain id : 30

vPC+ switch id : 3



CISCO PUBLIC

24 (Draft) V0.2


Peer status : peer adjacency formed ok

vPC keep-alive status : peer is alive

vPC fabricpath status : peer is reachable through fabricpath

Configuration consistency status : success

Per-vlan consistency status : success

Type-2 consistency status : success

vPC role : primary, operational secondary

Number of vPCs configured : 2

Peer Gateway : Disabled

Dual-active excluded VLANs : -

Graceful Consistency Check : Enabled

Auto-recovery status : Enabled (timeout = 240 seconds)

Fabricpath load balancing : Disabled

vPC Peer-link status

---------------------------------------------------------------------

id Port Status Active vlans

-- ---- ------ --------------------------------------------------

1 Po110 up 20

vPC status

----------------------------------------------------------------------------

id Port Status Consistency Reason Active vlans vPC+ Attribute

-- ---- ------ ----------- ------ ------------ --------------

51 Po51 up success success 20 DF: No, FP

MAC:

3.12.65535


MAC:

3.11.65535

Port-channel verification:

N7K-1# sh por

port-channel port-profile

N7K-1# sh port-channel summary

Flags: D - Down P - Up in port-channel (members)

I - Individual H - Hot-standby (LACP only)

s - Suspended r - Module-removed

S - Switched R - Routed

U - Up (port-channel)

M - Not in use. Min-links not met

--------------------------------------------------------------------------------

Group Port- Type Protocol Member Ports

Channel

--------------------------------------------------------------------------------

51 Po51(SU) Eth LACP Eth8/10(P)


110 Po110(SU) Eth LACP Eth8/1(P) Eth8/2(P)


N7K-1#

FP Topology verification:

N7K-1# sh fabricpath topology

Topo-Description Topo-ID Topo-State

-------------------------------- ---------- --------------------

0 0 Up

N7K-1# sh fabricpath route

FabricPath Unicast Route Table

'a/b/c' denotes ftag/switch-id/subswitch-id

'[x/y]' denotes [admin distance/metric]

ftag 0 is local ftag

subswitch-id 0 is default subswitch-id

FabricPath Unicast Route Table for Topology-Default

0/3/11, number of next-hops: 1



CISCO PUBLIC

25 (Draft) V0.2


via Po52, [80/0], 0 day/s 03:07:06, vpcm


via Po51, [80/0], 0 day/s 00:44:34, vpcm


via ---- , [60/0], 2 day/s 19:01:20, local


via ---- , [60/0], 2 day/s 19:00:56, local


via Po110, [115/20], 0 day/s 03:07:07, isis_fabricpath-default


via ---- , [60/0], 2 day/s 19:00:56, local

ISIS Adjacency Verification:

N7K-1# sh fabricpath isis adjacency

Fabricpath IS-IS domain: default Fabricpath IS-IS adjacency database:

System ID SNPA Level State Hold Time Interface

18ef.63e3.dcc3 N/A 1 UP 00:00:27 port-channel110

N7K-1#

Fabricpath Switchid Verification:

N7K-1# show fabricpath switch-id

FABRICPATH SWITCH-ID TABLE

Legend: '*' - this system

=========================================================================

SWITCH-ID SYSTEM-ID FLAGS STATE STATIC EMULATED

----------+----------------+------------+-----------+--------------------

3 18ef.63e3.dcc3 Primary Confirmed No Yes

3 f866.f206.fb43 Primary Confirmed No Yes

*123 f866.f206.fb43 Primary Confirmed Yes No

124 18ef.63e3.dcc3 Primary Confirmed Yes No

Total Switch-ids: 4

N7K-1# show fabricpath isis switch-id

Fabricpath IS-IS domain: default

Fabricpath IS-IS Switch-ID Database

Legend: C - Confirmed, T - tentative, W - swap

S - sticky, E - Emulated Switch

'*' - this system

System-ID Primary Secondary Reachable Bcast-Priority

MT-0

18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]

f866.f206.fb43* 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43* 3 [C] 0[C] Yes 0 [E]

N7K-1# show fabricpath isis interface brief


Interface Type Idx State Circuit MTU Metric Priority Adjs/AdjsUp

--------------------------------------------------------------------------------

port-channel110 P2P 1 Up/Ready 0x01/L1 1500 20 64 1/1

Fabricpath ISIS protocol Verification:

N7K-1# sh fabricpath isis trees


Note: The metric mentioned for multidestination tree is from the root of that tr

ee to that switch-id

MT-0

Topology 0, Tree 1, Swid routing table

3, L1

via port-channel110, metric 20

124, L1



124, L1



CISCO PUBLIC

26 (Draft) V0.2



MAC Address Details:

N7K-1# sh mac address-table dynamic

Legend:




---------+-----------------+--------+---------+------+----+------------------

* 20 547f.ee90.1501 dynamic 1590 F F Po52

* 20 547f.ee93.61bc dynamic 1590 F F Po51

* 200 18ef.63e3.dcc3 dynamic 0 F F Po120

N7K-1#

12.2.6. N7K-2

!

VLAN Verification:

N7K-2(config-if)# sh vlan


---- -------------------------------- --------- -------------------------------

1 default active

20 N55K-SERVER-VLAN active Po51, Po52, Po110, Eth8/1

Eth8/2, Eth8/9, Eth8/10


VLAN Type Vlan-mode

---- ----- ----------

1 enet CE

20 enet FABRICPATH

200 enet CE

Remote SPAN VLANs

-------------------------------------------------------------------------------


------- --------- --------------- -------------------------------------------

vPC verification:

N7K-2(config-if)# sh vpc

Legend:


vPC domain id : 30

vPC+ switch id : 3







vPC role : secondary, operational primary







CISCO PUBLIC

27 (Draft) V0.2





---------------------------------------------------------------------


-- ---- ------ --------------------------------------------------

1 Po110 up 20

vPC status

----------------------------------------------------------------------------


-- ---- ------ ----------- ------ ------------ --------------

51 Po51 up success success 20 DF: Yes, FP

MAC:

3.12.65535


MAC:

3.11.65535


N7K-2(config-if)# sh port

port-channel port-profile

N7K-2(config-if)# sh port-channel summary







--------------------------------------------------------------------------------


Channel

--------------------------------------------------------------------------------





N7K-2(config-if)#

FP Topology Verification:

N7K-2(config-if)# sh fabricpath topology


-------------------------------- ---------- --------------------

0 0 Up

N7K-2(config-if)# sh fabricpath route








via Po52, [80/0], 14 day/s 04:30:40, vpcm


via Po51, [80/0], 0 day/s 00:50:40, vpcm


via ---- , [60/0], 14 day/s 10:15:59, local


via ---- , [60/0], 14 day/s 10:11:34, local




via ---- , [60/0], 14 day/s 10:11:34, local



CISCO PUBLIC

28 (Draft) V0.2


ISIS adjacency verification:

N7K-2(config-if)# sh fabricpath isis adjacency



f866.f206.fb43 N/A 1 UP 00:00:28 port-channel110

N7K-2(config-if)#

FP Switch-ID Verification:

N7K-2(config-if)# show fabricpath switch-id



=========================================================================


----------+----------------+------------+-----------+--------------------



123 f866.f206.fb43 Primary Confirmed Yes No

*124 18ef.63e3.dcc3 Primary Confirmed Yes No

Total Switch-ids: 4

N7K-2(config-if)#

N7K-2(config-if)# show fabricpath isis switch-id





'*' - this system


MT-0

18ef.63e3.dcc3* 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3* 3 [C] 0[C] Yes 0 [E]

f866.f206.fb43 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43 3 [C] 0[C] Yes 0 [E]

N7K-2(config-if)# sh fabricpath isis trees




MT-0


123, L1



3, L1


123, L1


MAC address details:


Legend:




---------+-----------------+--------+---------+------+----+------------------


N7K-2(config-if)#



CISCO PUBLIC

29 (Draft) V0.2


12.2.7. N55K-1

!

IP address verification:

N55K-1# sh ip int brief | ex unas

IP Interface Status for VRF "default"(1)

Interface IP Address Interface Status

Vlan20 20.1.1.1 protocol-up/link-up/admin-up









--------------------------------------------------------------------------------


Channel

--------------------------------------------------------------------------------


VLAN verification:

N55K-1# sh vlan id 20


---- -------------------------------- --------- -------------------------------

20 N5K-SERVER-VLAN active Po51

VLAN Type Vlan-mode

---- ----- ----------

20 enet CE

Remote SPAN VLAN

----------------

Disabled


------- --------- --------------- -------------------------------------------

N55K-1#


N55K-2# sh interfa vlan 20 | in Hardw

Hardware is EtherSVI, address is 547f.ee90.1501

N55K-2# sh mac add dyn

Legend:




---------+-----------------+--------+---------+------+----+------------------

* 20 547f.ee93.61bc dynamic 140 F F Po52

N55K-2#



CISCO PUBLIC

30 (Draft) V0.2


12.2.8. N55K-2

!














--------------------------------------------------------------------------------


Channel

--------------------------------------------------------------------------------


VLAN verification:

N55K-2# sh vlan id 20


---- -------------------------------- --------- -------------------------------

20 N5K-SERVER-VLAN active Po52

VLAN Type Vlan-mode

---- ----- ----------

20 enet CE

Remote SPAN VLAN

----------------

Disabled


------- --------- --------------- -------------------------------------------

N55K-2#


N55K-1# sh inter vlan 20 | in Hard

Hardware is EtherSVI, address is 547f.ee93.61bc

N55K-1# sh mac add dyn

Legend:




---------+-----------------+--------+---------+------+----+------------------

* 20 547f.ee90.1501 dynamic 50 F F Po51

N55K-1#



CISCO PUBLIC

31 (Draft) V0.2


12.3. Test Result

12.3.9. CE VLAN on N55K-1 Reaching the CE VLAN on N55K-2

!

N55K-1# ping 20.1.1.2

PING 20.1.1.2 (20.1.1.2): 56 data bytes

64 bytes from 20.1.1.2: icmp_seq=0 ttl=254 time=3.116 ms





--- 20.1.1.2 ping statistics ---

5 packets transmitted, 5 packets received, 0.00% packet loss

round-trip min/avg/max = 3.116/4.591/4.983 ms

N55K-1#


32 (Draft) V0.2


13. Scenario 2: FP to CE VLAN Routed Traffic

This scenario is used for demonstrating how the CE and FP intervlan communication happens. As shown in Figure 4:

Vlan 100 is configured as CE vlan on N55K-1 access switch and Vlan 30 is configured as CE vlan on N55K-2; where

as the same vlans are configured as fabricpath vlan on both Nexus 7010 switches.

The connectivity between the Nexus 7010 and Nexus N55K-1 switch is configured as fabricpath core ports and the

connectivity between the Nexus 7010 switches and Nexus N55K-2 is configured as fabricpath edge port/normal trunk

interfaces

Figure 4 FP to CE inter vlan Communication

SVI 20: 100.1.1.2 SVI 20: 30.1.1.5

vPC+

N55K-1 N55K-2

vPC peer-link

vPC keep-alive Link

FP VLAN 100: 100.1.1.3

FP VLAN 30: 30.1.1.4

CE VLAN 100CE VLAN 30

Fabricpath Link

802.1Q Trunk

N7K-1 N7K-1

Po 52

FP VLAN 30: 30.1.1.3

FP VLAN 100: 30.1.1.4

( HSRP VIP=.1)

USE CASE:

This scenario is relevant when two defferent CE vlan on the non fabricpath device have their default gateway

configured on the fabricpath enabled switches.

Scenario 2: FP to CE VLAN Routed Traffic


CISCO PUBLIC

33 (Draft) V0.2



13.1.1. N7K-1


!Time: Fri Aug 3 17:43:06 2012

version 6.0(3)


hostname N7K-1

feature tacacs+

cfs eth distribute


feature hsrp

feature lacp

feature vpc

feature lldp


vlan 100

mode fabricpath

name N55K-1-SERVER-VLAN

vlan 30

mode fabricpath


vlan 200

name vPC-keepalive




vpc domain 30

role priority 20


auto-recovery


interface Vlan30

no shutdown


hsrp 30

priority 120

preempt

ip 30.1.1.1

interface Vlan100

no shutdown

ip address 100.1.1.4/24

hsrp 10

priority 120

preempt

ip 100.1.1.1

interface Vlan200

no shutdown

vrf member KA

ip address 200.1.1.4/24



switchport




CISCO PUBLIC

34 (Draft) V0.2



vpc 52



switchport


vpc peer-link



switchport




switchport



no shutdown


switchport



no shutdown


switchport




no shutdown


switchport




no shutdown


switchport




no shutdown


Description To-N55K-1

switchport


no shutdown


root-priority 254




CISCO PUBLIC

35 (Draft) V0.2


13.1.2. N7K-2

!


!Time: Fri Aug 3 14:40:26 2012

version 6.0(3)


hostname N7K-2

feature tacacs+

cfs eth distribute


feature hsrp

feature lacp

feature vpc

feature lldp


ip domain-lookup

vlan 100

mode fabricpath


vlan 30

mode fabricpath


vlan 200

name vPC-keepalive




vpc domain 30

role priority 10


auto-recovery


interface Vlan30

no shutdown


hsrp 30

priority 120

ip 30.1.1.1

interface Vlan100

no shutdown

ip address 100.1.1.3/24

hsrp 10

ip 100.1.1.1

interface Vlan200

no shutdown

vrf member KA

ip address 200.1.1.3/24



switchport



vpc 52



CISCO PUBLIC

36 (Draft) V0.2




switchport


vpc peer-link



switchport




switchport



no shutdown


switchport



no shutdown


switchport




no shutdown


switchport




no shutdown


switchport




no shutdown


switchport


line vty


root-priority 255


N7K-1#



CISCO PUBLIC

37 (Draft) V0.2


13.1.3. N55K-1

!


!Time: Fri Aug 3 05:33:47 2012

version 5.1(3)N2(1)

install feature-set fabricpath


hostname N55K-1

feature telnet

no feature http-server

feature tacacs+

cfs eth distribute


feature lacp

feature lldp



username Cisco@123 password 5 $1$Hv6f0NFz$hE3qBt7958S9M/IB5I0Ps0 role network-

admi

ssh key rsa 2048

ip domain-lookup

vlan 100

mode fabricpath





interface Vlan100

no shutdown

ip address 100.1.1.2/24




speed 10000









ip route 0.0.0.0/0 100.1.1.1

!


!



CISCO PUBLIC

38 (Draft) V0.2


13.1.4. N55K-2

!


!Time: Thu Apr 9 12:05:48 2009

version 5.1(3)N2(1)


hostname N55K-2

feature telnet


feature tacacs+

cfs eth distribute


feature lacp


ssh key rsa 2048

ip domain-lookup

vlan 30

name N55K-2-Server-VLAN




interface Vlan30

no shutdown














line console

line vty



ip route 0.0.0.0/0 3.1.1.1



no logging console

N55K-2#



CISCO PUBLIC

39 (Draft) V0.2



13.2.5. N7K-1

!


VLAN verification:

N7K-1# sh vlan


---- -------------------------------- --------- -------------------------------

1 default active

30 N55K2-SERVER-VLAN active Po52, Po110, Eth8/1, Eth8/2

Eth8/9

100 N55K1-SERVER-VLAN active Po110, Eth8/1, Eth8/2


VLAN Type Vlan-mode

---- ----- ----------

1 enet CE

30 enet FABRICPATH

100 enet FABRICPATH

200 enet CE

Remote SPAN VLANs

-------------------------------------------------------------------------------


------- --------- --------------- -------------------------------------------

N7K-1#

vPC verification:

N7K-1# sh vpc

Legend:


vPC domain id : 30

vPC+ switch id : 3















---------------------------------------------------------------------


-- ---- ------ --------------------------------------------------

1 Po110 up 30,100

vPC status

----------------------------------------------------------------------------




CISCO PUBLIC

40 (Draft) V0.2


-- ---- ------ ----------- ------ ------------ --------------


MAC:

3.11.65535


N7K-1# sh ip int brief





N7K-1#

HSRP verification:

N7K-1# sh hsrp

Vlan30 - Group 30 (HSRP-V1) (IPv4)

Local state is Active, priority 120 (Cfged 120), may preempt

Forwarding threshold(for vPC), lower: 1 upper: 120

Hellotime 3 sec, holdtime 10 sec

Next hello sent in 1.946000 sec(s)

Virtual IP address is 30.1.1.1 (Cfged)

Active router is local

Standby router is 30.1.1.4 , priority 100 expires in 1.957000 sec(s)

Authentication text "cisco"

Virtual mac address is 0000.0c07.ac1e (Default MAC)

2 state changes, last state change 00:01:43

IP redundancy name is hsrp-Vlan30-30 (default)










Virtual mac address is 0000.0c07.ac0a (Default MAC)



N7K-1#

FP Topology verifications:



-------------------------------- ---------- --------------------

0 0 Up









via Po52, [80/0], 0 day/s 01:25:39, vpcm


via ---- , [60/0], 2 day/s 17:19:53, local


via ---- , [60/0], 2 day/s 17:19:29, local





CISCO PUBLIC

41 (Draft) V0.2





via ---- , [60/0], 2 day/s 17:19:29, local

ISIS adjacency verifications:

N7K-1# sh fabricpath isis adjacency




N7K-1#

FP Switch-ID verification




=========================================================================


----------+----------------+------------+-----------+--------------------





2768 547f.ee93.61bc Primary Confirmed No No

Total Switch-ids: 5

N7K-1#






'*' - this system


MT-0

18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]

547f.ee93.61bc 2768[C] 0[C] Yes 64

f866.f206.fb43* 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43* 3 [C] 0[C] Yes 0 [E]

N7K-1# show fabricpath isis protocol

Fabricpath IS-IS domain : default

System ID : f866.f206.fb43 IS-Type : L1

SAP : 432 Queue Handle : 11

Maximum LSP MTU: 1492

Graceful Restart enabled. State: Inactive

Last graceful restart status : none

Metric-style : advertise(wide), accept(wide)

Start-Mode: Complete [Start-type configuration]

Area address(es) :

00

Process is up and running

CIB ID: 3

Interfaces supported by Fabricpath IS-IS :

port-channel110

Level 1

Authentication type and keychain not configured

Authentication check specified

MT-0 Ref-Bw: 400000

Address family Swid unicast :

Number of interface : 1

Distance : 115

L1 Next SPF: Inactive



CISCO PUBLIC

42 (Draft) V0.2


FP Interface Verification:




--------------------------------------------------------------------------------


N7K-1# show fabricpath isis trees multidestination 1




MT-0


3, L1


124, L1


2768, L1






MT-0


124, L1


2768, L1


N7K-1#

FP ISIS protocol Verification

N7K-1(config)# sh fabricpath isis trees




MT-0


3, L1


124, L1


2768, L1



124, L1


2768, L1


N7K-1(config)#

MAC Details Verification:

N7K-1(config)# sh mac address-table dynamic

Legend:






CISCO PUBLIC

43 (Draft) V0.2


---------+-----------------+--------+---------+------+----+------------------

* 30 547f.ee90.1501 dynamic 30 F F Po52


N7K-1(config)#

N7K-1(config)# sh inter vla 100 | in Hardware

Hardware is EtherSVI, address is f866.f206.fb43

N7K-1(config)# sh inter vla 30 | in Hardware


N7K-1(config)#

13.2.6. N7K-2

!

VLAN verifications:

N7K-2# sh vlan


---- -------------------------------- --------- -------------------------------

1 default active

30 N55K2-SERVER-VLAN active Po52, Po110, Eth8/1, Eth8/2

Eth8/9, Eth8/10

100 N55K-1-SERVER-VLAN active Po110, Eth8/1, Eth8/2, Eth8/10


300 VLAN0300 active Eth8/10

VLAN Type Vlan-mode

---- ----- ----------

1 enet CE

30 enet FABRICPATH

100 enet FABRICPATH

200 enet CE

300 enet FABRICPATH

Remote SPAN VLANs

-------------------------------------------------------------------------------


------- --------- --------------- -------------------------------------------

vPC verifications:

N7K-2# sh vpc

Legend:


vPC domain id : 30

vPC+ switch id : 3
















CISCO PUBLIC

44 (Draft) V0.2



---------------------------------------------------------------------


-- ---- ------ --------------------------------------------------

1 Po110 up 30,100

vPC status

----------------------------------------------------------------------------


-- ---- ------ ----------- ------ ------------ --------------


MAC:

3.11.65535

HSRP verifications:

N7K-2# sh hsrp


Local state is Standby, priority 100 (Cfged 100)





Active router is 30.1.1.3, priority 120 expires in 1.797000 sec(s)

Standby router is local


Virtual mac address is 0000.0c07.ac1e (Default MAC)




Local state is Standby, priority 100 (Cfged 100)








Virtual mac address is 0000.0c07.ac0a (Default MAC)



N7K-2#

IP address verifications:

N7K-2# sh ip int brief





N7K-2#


N7K-2# show fabricpath topology


-------------------------------- ---------- --------------------

0 0 Up

N7K-2# sh f

fabricpath feature-set fips forwarding

feature file flow









CISCO PUBLIC

45 (Draft) V0.2




via Po52, [80/0], 14 day/s 02:44:59, vpcm


via ---- , [60/0], 14 day/s 08:30:18, local


via ---- , [60/0], 14 day/s 08:25:53, local




via Eth8/10, [115/40], 13 day/s 23:52:37, isis_fabricpath-default


via ---- , [60/0], 14 day/s 08:25:53, local

ISIS Adjacency verifications:

N7K-2# show fabricpath isis adjacency




547f.ee93.61bc N/A 1 UP 00:00:31 Ethernet8/10

N7K-2#





=========================================================================


----------+----------------+------------+-----------+--------------------






Total Switch-ids: 5






'*' - this system


MT-0

18ef.63e3.dcc3* 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3* 3 [C] 0[C] Yes 0 [E]

547f.ee93.61bc 2768[C] 0[C] Yes 64

f866.f206.fb43 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43 3 [C] 0[C] Yes 0 [E]

N7K-2#

N7K-2# show fabricpath isis protocol


System ID : 18ef.63e3.dcc3 IS-Type : L1







Area address(es) :

00



CISCO PUBLIC

46 (Draft) V0.2



CIB ID: 3


port-channel110

Ethernet8/10

Level 1



MT-0 Ref-Bw: 400000



Distance : 115


N7K-2#

FP internface verifications:




--------------------------------------------------------------------------------


Ethernet8/10 P2P 2 Up/Ready 0x01/L1 1500 40 64 1/1

N7K-2#

N7K-2# show fabricpath isis topology summary

Fabricpath IS-IS domain: default FabricPath IS-IS Topology Summary

MT-0

Configured interfaces: port-channel110 Ethernet8/10

Number of trees: 2

Tree id: 1, ftag: 1, root system: f866.f206.fb43, 123

Tree id: 2, ftag: 2 [transit-traffic-only], root system: 18ef.63e3.dcc3, 124

N7K-2#





MT-0


123, L1


2768, L1

via Ethernet8/10, metric 60





MT-0


3, L1


123, L1


2768, L1


N7K-2#

N7K-2# sh fabricpath isis trees






CISCO PUBLIC

47 (Draft) V0.2


MT-0


123, L1


2768, L1



3, L1


123, L1


2768, L1


N7K-2#



Legend:




---------+-----------------+--------+---------+------+----+------------------

* 30 547f.ee90.1501 dynamic 30 F F Po52

100 547f.ee93.61bc dynamic 30 F F 2768.0.0


N7K-2#

N7K-2# sh inter vlan 100 | in Hardwa

Hardware is EtherSVI, address is 18ef.63e3.dcc3

N7K-2# sh inter vlan 30 | in Hardwa


N7K-2#

13.2.7. N55K-1

!

IP Address verifications:





N55K-1#



-------------------------------- ---------- --------------------

0 0 Up









via ---- , [60/0], 14 day/s 02:37:03, local





CISCO PUBLIC

48 (Draft) V0.2






N55K-1#


N55K-1# sh interface vlan 100 | in Hardware


FP ISIS protocol verification:

N55K-1(config)# show fabricpath isis trees




MT-0


3, L1


123, L1


124, L1



3, L1


123, L1


124, L1


N55K-1(config)#

MAC Details:


Legend:




---------+-----------------+--------+---------+------+----+------------------

* 100 0000.0c07.ac0a dynamic 0 F F 3.0.2047

* 100 18ef.63e3.dcc3 dynamic 0 F F 124.0.1054

* 100 f866.f206.fb43 dynamic 0 F F 123.0.2047

N55K-1(config)#

13.2.8. N55K-2

!


VLAN verifications:

N55K-2# sh vlan | in 30

Eth1/29, Eth1/30, Eth1/31

30 VLAN0030 active Po52

30 enet CE






CISCO PUBLIC

49 (Draft) V0.2



Port-channel verifications:








--------------------------------------------------------------------------------


Channel

--------------------------------------------------------------------------------


N55K-2#

MAC Address of Vlan 30

N55K-2# sh interface vlan 30 | in Hardware


N55K-2#

MAC Table:


Legend:




---------+-----------------+--------+---------+------+----+------------------

* 30 0000.0c07.ac1e dynamic 10 F F Po52


N55K-2#

13.3. Test Result

13.3.9. CE VLAN on N55K-2 Reaching the FP VLAN on N55K-1

!


N55K-2# ping 100.1.1.2

PING 100.1.1.2 (100.1.1.2): 56 data bytes









N55K-2#



CISCO PUBLIC

50 (Draft) V0.2


13.3.10. FP VLAN on N55K-1 Reaching the CE VLAN on N55K-2

!


N55K-1# ping 30.1.1.5

PING 30.1.1.5 (30.1.1.5): 56 data bytes









N55K-1#


51 (Draft) V0.2


14. Scenario 3: FP to CE VLAN Routed traffic to the Single homed edge device

This scenario is used for demonstrating how the CE and FP intervlan communication happens when it co-exist on the

Nexus 7010 swiches. As shown in Figure 5: Vlan 20 is configured as FP vlan on N55K-1 access switch and Vlan 40

is configured as CE vlan on N55K-2; where as the vlan 40 is defined as CE vlan on Nexus 7010 switches and Vlan 20

is configured as FP vlan.

The connectivity between the Nexus 7010 switches and Nexus N55K-1 switch is configured as fabricpath core ports

and the connectivity between the N7K-2 switch and Nexus N55K-2 is configured as fabricpath edge port/normal

trunk interfaces.

Figure 5 FP VLAN talking to the Single homed CE VLAN device

SVI 20: 20.1.1.1 SVI 20: 40.1.1.1

vPC+

N5548-01 N5548-02

vPC peer-link

Non-vPC Trunk

FP VLAN 20: 20.1.1.2 FP VLAN 20:20.1.1.3

FP VLAN 20CE VLAN 40

CE VLAN 40: 40.1.1.2 CE VLAN 40:40.1.1.3HSRP VIP= . 4

802.1Q Trunk

USE CASE:

In a multi vendor environment there could be a possibility that the services hosted on the network is single homed to

the aggregation layer and the traffic from fabricpth get routed to the CE vlan which is part of the third party device.

Also note that the VLAN which is for the Single homed services may not be making use of the peer-link because of

some potential failure scenario consideration in vPC environment. Eg: vPC peer link failure

Scenario 3: FP to CE VLAN Routed traffic to the

Single homed edge device


CISCO PUBLIC

52 (Draft) V0.2



14.1.1. N7K-1


!Time: Fri Aug 3 17:43:06 2012

version 6.0(3)


hostname N7K-1

feature tacacs+

cfs eth distribute

feature ospf


feature hsrp

feature lacp

feature vpc

feature lldp


vlan 20

mode fabricpath

name N5K1-SERVER-VLAN

vlan 40


vlan 200

name vPC-keepalive




vpc domain 30

role priority 20


auto-recovery


interface Vlan20

no shutdown


hsrp 20

priority 120

preempt

ip 20.1.1.4

interface Vlan40

no shutdown


hsrp 40

priority 120

preempt

ip 40.1.1.4

interface Vlan200

no shutdown

vrf member KA

ip address 200.1.1.4/24




CISCO PUBLIC

53 (Draft) V0.2




switchport


vpc peer-link



switchport


switchport trunk allowed vlan 40,200


switchport



no shutdown


switchport



no shutdown


switchport




no shutdown


switchport




no shutdown


switchport

shutdown



switchport


no shutdown


root-priority 254


14.1.2. N7K-2

!


!Time: Fri Aug 3 14:40:26 2012

version 6.0(3)


hostname N7K-2

feature tacacs+




CISCO PUBLIC

54 (Draft) V0.2


cfs eth distribute

feature ospf


feature hsrp

feature lacp

feature vpc

feature lldp


ip domain-lookup

vlan 20

mode fabricpath


vlan 40


vlan 200

name vPC-keepalive




vpc domain 30

role priority 10


auto-recovery


interface Vlan20

no shutdown


hsrp 20

ip 20.1.1.4

interface Vlan40

no shutdown


hsrp 40

ip 40.1.1.4

interface Vlan200

no shutdown

vrf member KA

ip address 200.1.1.3/24



switchport


vpc peer-link



switchport


switchport trunk allowed vlan 40,200


switchport



no shutdown


switchport




CISCO PUBLIC

55 (Draft) V0.2




no shutdown


switchport




no shutdown


switchport




no shutdown



switchport



no shutdown



switchport


no shutdown

line vty


root-priority 255


N7K-1#

14.1.3. N55K-1

!


!Time: Fri Aug 3 05:33:47 2012

version 5.1(3)N2(1)



hostname N55K-1

feature telnet


feature tacacs+

cfs eth distribute


feature lacp

feature lldp




ssh key rsa 2048




CISCO PUBLIC

56 (Draft) V0.2


ip domain-lookup

vlan 20

mode farbripath





interface Vlan20

no shutdown






switchport




switchport


no shutdown



ip route 0.0.0.0 0.0.0.0 20.1.1.4

!

!

14.1.4. N55K-2

!


!Time: Thu Apr 9 12:05:48 2009

version 5.1(3)N2(1)

hostname N55K-2

feature telnet


feature tacacs+

cfs eth distribute


feature lacp


ssh key rsa 2048

ip domain-lookup

vlan 40








CISCO PUBLIC

57 (Draft) V0.2


interface Vlan40

no shutdown



shutdown





no shutdown

line console

line vty



ip route 0.0.0.0 0.0.0.0 40.1.1.4



no logging console

N55K-2#


14.2.5. N7K-1

!


VLAN verifications:

N7K-1(config)# sh vlan


---- -------------------------------- --------- -------------------------------

1 default active

20 N55K1-SERVER-VLAN active Po51, Po52, Po110, Eth8/1

Eth8/2, Eth8/10


200 vPC-keep-alive active Po120, Eth8/3, Eth8/4

VLAN Type Vlan-mode

---- ----- ----------

1 enet CE

20 enet FABRICPATH

40 enet CE

200 enet CE

Remote SPAN VLANs

-------------------------------------------------------------------------------


------- --------- --------------- -------------------------------------------




CISCO PUBLIC

58 (Draft) V0.2


vPC verifications:

N7K-1(config)# sh vpc

Legend:


vPC domain id : 30

vPC+ switch id : 3















---------------------------------------------------------------------


-- ---- ------ --------------------------------------------------

1 Po110 up 20

N7K-1(config)# sh ip int brief





HSRP verifications:

N7K-1(config)# sh hsrp


Local state is Standby, priority 120 (Cfged 120), may preempt








Virtual mac address is 0000.0c07.ac14 (Default MAC)















N7K-1(config)# sh inter vlan 20 | in Hardwa





CISCO PUBLIC

59 (Draft) V0.2


N7K-1(config)# sh inter vlan 40 | in Hardwa


MAC Address verifications:


Legend:




---------+-----------------+--------+---------+------+----+------------------

20 547f.ee93.61bc dynamic 5 F F 2768.0.0


* 40 547f.ee90.1501 dynamic 990 F F Po120


N7K-1(config)#

FP Topology verifications:

N7K-1(config)# sh fabricpath topology


-------------------------------- ---------- --------------------

0 0 Up

N7K-1(config)# sh fabricpath route








via ---- , [60/0], 2 day/s 22:05:07, local


via ---- , [60/0], 2 day/s 22:04:43, local






via ---- , [60/0], 2 day/s 22:04:43, local

N7K-1(config)#


N7K-1(config)# sh fabricpath isis adjacency





N7K-1(config)#

FP Switch-ID verification:

N7K-1(config)# show fabricpath switch-id



=========================================================================


----------+----------------+------------+-----------+--------------------







CISCO PUBLIC

60 (Draft) V0.2




Total Switch-ids: 5

N7K-1(config)# show fabricpath isis switch-id





'*' - this system


MT-0

18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]

547f.ee93.61bc 2768[C] 0[C] Yes 64

f866.f206.fb43* 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43* 3 [C] 0[C] Yes 0 [E]

N7K-1(config)# show fabricpath isis protocol









Area address(es) :

00


CIB ID: 3


port-channel110

Ethernet8/10

Level 1



MT-0 Ref-Bw: 400000



Distance : 115


N7K-1(config)# show fabricpath isis interface brief



--------------------------------------------------------------------------------


Ethernet8/10 P2P 2 Up/Ready 0x01/L1 1500 40 64 1/1





MT-0


3, L1


124, L1


2768, L1



124, L1


2768, L1




CISCO PUBLIC

61 (Draft) V0.2



N7K-1(config)#

14.2.6. N7K-2

!

VLAN verifications:



---- -------------------------------- --------- -------------------------------

1 default active

20 N55K1-SERVER-VLAN active Po110, Eth8/1, Eth8/2, Eth8/10


200 vPC-keep-alive active Po120, Eth8/3, Eth8/4

VLAN Type Vlan-mode

---- ----- ----------

1 enet CE

20 enet FABRICPATH

40 enet CE

200 enet CE

Remote SPAN VLANs

-------------------------------------------------------------------------------


------- --------- --------------- -------------------------------------------

vPC verifications:


Legend:


vPC domain id : 30

vPC+ switch id : 3















---------------------------------------------------------------------


-- ---- ------ --------------------------------------------------

1 Po110 up 20









CISCO PUBLIC

62 (Draft) V0.2



HSRP verifications:

N7K-2(config)# show hsrp

























N7K-2(config)# sh interf vla 20 | in Hard


N7K-2(config)# sh interf vla 40 | in Hard



Legend:




---------+-----------------+--------+---------+------+----+------------------

20 547f.ee93.61bc dynamic 420 F F 2768.0.0

* 40 547f.ee90.1501 dynamic 5 F F Eth8/9




N7K-2(config)# show fabricpath topology


-------------------------------- ---------- --------------------

0 0 Up

N7K-2(config)# show fabricpath route








via ---- , [60/0], 14 day/s 13:20:12, local


via ---- , [60/0], 14 day/s 13:15:47, local






CISCO PUBLIC

63 (Draft) V0.2





via ---- , [60/0], 14 day/s 13:15:47, local

N7K-2(config)# show fabricpath isis adjacency





N7K-2(config)#

FP Switch-ID Verification

N7K-2(config)# sh fabricpath switch-id



=========================================================================


----------+----------------+------------+-----------+--------------------






Total Switch-ids: 5

N7K-2(config)# sh fabricpath isis switch-id





'*' - this system


MT-0

18ef.63e3.dcc3* 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3* 3 [C] 0[C] Yes 0 [E]

547f.ee93.61bc 2768[C] 0[C] Yes 64

f866.f206.fb43 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43 3 [C] 0[C] Yes 0 [E]

ISIS Protocol verifications:

N7K-2(config)# sh fabricpath isis protocol









Area address(es) :

00


CIB ID: 3


port-channel110

Ethernet8/10

Level 1



MT-0 Ref-Bw: 400000



Distance : 115





CISCO PUBLIC

64 (Draft) V0.2


ISIS Tree verifications:





MT-0


123, L1


2768, L1



3, L1


123, L1


2768, L1


N7K-2(config)#

14.2.7. N55K-1

!


N55K-1(config)# sh ip int brief | ex unas




N55K-1(config)# sh vlan | in FABRIC

20 enet FABRICPATH

100 enet FABRICPATH

N55K-1(config)# sh int vlan 20 | in Hard




Legend:




---------+-----------------+--------+---------+------+----+------------------

* 20 0000.0c07.ac14 dynamic 0 F F 3.0.2047

* 20 f866.f206.fb43 dynamic 0 F F 123.0.1054





f866.f206.fb43 N/A 1 UP 00:00:27 Ethernet1/1

18ef.63e3.dcc3 N/A 1 UP 00:00:23 Ethernet1/2

FP Switch-ID verifications:






CISCO PUBLIC

65 (Draft) V0.2





'*' - this system


MT-0

18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]

547f.ee93.61bc* 2768[C] 0[C] Yes 64

f866.f206.fb43 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43 3 [C] 0[C] Yes 0 [E]




=========================================================================


----------+----------------+------------+-----------+--------------------





*2768 547f.ee93.61bc Primary Confirmed No No

Total Switch-ids: 5

FP Route-table verifications:









via ---- , [60/0], 14 day/s 07:55:26, local








N55K-1(config)#

14.2.8. N55K-2

!

VLAN verifications:

N55K-2(config)# sh vlan | in 40


40 enet CE

N55K-2(config)# sh ip int brief | ex un




Trunk verifications:

N55K-2(config)# sh interface trunk | in 40

Eth1/2 40




CISCO PUBLIC

66 (Draft) V0.2


Eth1/2 40


N55K-2(config)# sh inter vla 40 | in Hard


N55K-2(config)# sh mac add dynamic

Legend:




---------+-----------------+--------+---------+------+----+------------------

* 40 0000.0c07.ac28 dynamic 10 F F Eth1/2

* 40 f866.f206.fb43 dynamic 10 F F Eth1/2

N55K-2(config)#

14.3. Test Result

14.3.9. FP VLAN on N55K-1 Reaching the CE VLAN on N55K-2

!

N55K-1(config)# ping 40.1.1.1

PING 40.1.1.1 (40.1.1.1): 56 data bytes









N55K-1(config)#

14.3.10. CE VLAN on N55K-2 Reaching the FP VLAN on N55K-1

!


PING 20.1.1.1 (20.1.1.1): 56 data bytes









N55K-2(config)#


67 (Draft) V0.2


15. Scenario 4: FP VLAN Routed traffic to Single homed FP edge Device

This scenario is used for demonstrating how the FP intervlan communication happens when it co-exist on the Nexus

7010 swiches. As shown in Figure 6: Vlan 20 is configured as FP vlan on N55K-1 access switch and Vlan 40 is

configured as CE vlan on N55K-2; where as the vlan 20 & 40 is defined as FP vlan on Nexus 7010 switches.

The connectivity between the Nexus 7010 switches and Nexus N55K-1 switch is configured as fabricpath core ports

and the connectivity between the N7K-2 switch and Nexus N55K-2 is configured as fabricpath edge port/normal

trunk interfaces

Figure 6 FP VLAN talking to the Single homed FP VLAN device

SVI 20: 20.1.1.1 SVI 20: 40.1.1.1

vPC+

N55K-1 N55K-2

vPC peer-link

Vpc Keep-alive

FP VLAN 20: 20.1.1.2 FP VLAN 20:20.1.1.2

FP VLAN 20CE VLAN 40

FP VLAN 40: 40.1.1.2 FP VLAN 40:40.1.1.3HSRP VIP= . 1

802.1Q Trunk

N7K-1 N7K-2

USE CASE:

In a multi vendor environment, single homed devices (Eg: Third party FW) may need to be connected to the

aggregation switch where all the VLANs are defined as Fabricpath.

Scenario 4: FP VLAN Routed traffic to Single

homed FP edge Device


CISCO PUBLIC

68 (Draft) V0.2



15.1.1. N7K-1


!Time: Fri Aug 3 17:43:06 2012

version 6.0(3)


hostname N7K-1

feature tacacs+

cfs eth distribute

feature ospf


feature hsrp

feature lacp

feature vpc

feature lldp


vlan 20

mode fabricpath


vlan 40

mode fabricpath


vlan 200

name vPC-keepalive




vpc domain 30

role priority 20


auto-recovery


interface Vlan20

no shutdown


hsrp 20

priority 120

preempt

ip 20.1.1.4

interface Vlan40

no shutdown


hsrp 40

priority 120

preempt

ip 40.1.1.4

interface Vlan200

no shutdown

vrf member KA

ip address 200.1.1.4/24





CISCO PUBLIC

69 (Draft) V0.2



switchport


vpc peer-link



switchport




switchport



no shutdown


switchport



no shutdown


switchport




no shutdown


switchport




no shutdown


switchport

shutdown



switchport


no shutdown


root-priority 254


15.1.2. N7K-2

!


!Time: Fri Aug 3 14:40:26 2012

version 6.0(3)


hostname N7K-2

feature tacacs+

cfs eth distribute




CISCO PUBLIC

70 (Draft) V0.2


feature ospf


feature hsrp

feature lacp

feature vpc

feature lldp


ip domain-lookup

vlan 1

vlan 20

mode fabricpath


vlan 40

mode fabricpath


vlan 200

name vPC-keepalive




vpc domain 30

role priority 10


auto-recovery


interface Vlan20

no shutdown


hsrp 20

ip 20.1.1.4

interface Vlan40

no shutdown


hsrp 40

ip 40.1.1.4

interface Vlan200

no shutdown

vrf member KA

ip address 200.1.1.3/24



switchport


vpc peer-link



switchport




switchport



no shutdown




CISCO PUBLIC

71 (Draft) V0.2



switchport



no shutdown


switchport




no shutdown


switchport




no shutdown



switchport



no shutdown



switchport


no shutdown

line vty


root-priority 255


N7K-1#

15.1.3. N55K-1

!


!Time: Fri Aug 3 05:33:47 2012

version 5.1(3)N2(1)



hostname N55K-1

feature telnet


feature tacacs+

cfs eth distribute


feature lacp

feature lldp







CISCO PUBLIC

72 (Draft) V0.2


ssh key rsa 2048

ip domain-lookup

vlan 20

mode farbripath





interface Vlan20

no shutdown






switchport




switchport


no shutdown



ip route 0.0.0.0 0.0.0.0 20.1.1.4

!

!

15.1.4. N55K-2

!


!Time: Thu Apr 9 12:05:48 2009

version 5.1(3)N2(1)

hostname N55K-2

feature telnet


feature tacacs+

cfs eth distribute


feature lacp


ssh key rsa 2048

ip domain-lookup

vlan 40





interface Vlan40




CISCO PUBLIC

73 (Draft) V0.2


no shutdown



shutdown





no shutdown

line console

line vty



ip route 0.0.0.0 0.0.0.0 40.1.1.4



no logging console

N55K-2#


15.2.5. N7K-1

!


VLAN verifications:



---- -------------------------------- --------- -------------------------------

1 default active

20 N55K1-SERVER-VLAN active Po51, Po52, Po110, Eth8/1

Eth8/2, Eth8/10



VLAN Type Vlan-mode

---- ----- ----------

1 enet CE

20 enet FABRICPATH

40 enet FABRICPATH

200 enet CE

Remote SPAN VLANs

-------------------------------------------------------------------------------


------- --------- --------------- -------------------------------------------

vPC verifications:




CISCO PUBLIC

74 (Draft) V0.2



Legend:


vPC domain id : 30

vPC+ switch id : 3















---------------------------------------------------------------------


-- ---- ------ --------------------------------------------------

1 Po110 up 20,40







HSRP verifications:

N7K-1(config)# sh hsrp

























MAC address verifications:


Legend:





CISCO PUBLIC

75 (Draft) V0.2




---------+-----------------+--------+---------+------+----+------------------

20 547f.ee93.61bc dynamic 990 F F 2768.0.0

40 547f.ee90.1501 dynamic 840 F F 124.0.45

40 547f.ee93.61bc dynamic 150 F F 2768.0.0


N7K-1(config-if)# sh int vl 20 | in Hard




N7K-1(config-if)#

FP Topology verification:



-------------------------------- ---------- --------------------

0 0 Up









via ---- , [60/0], 3 day/s 17:39:45, local


via ---- , [60/0], 3 day/s 17:39:21, local






via ---- , [60/0], 3 day/s 17:39:21, local






N7K-1(config-if)#





=========================================================================


----------+----------------+------------+-----------+--------------------






Total Switch-ids: 5






'*' - this system




CISCO PUBLIC

76 (Draft) V0.2



MT-0

18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]

547f.ee93.61bc 2768[C] 0[C] Yes 64

f866.f206.fb43* 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43* 3 [C] 0[C] Yes 0 [E]


N7K-1(config-if)# show fabricpath isis protocol









Area address(es) :

00


CIB ID: 3


port-channel110

Ethernet8/10

Level 1



MT-0 Ref-Bw: 400000



Distance : 115


N7K-1(config-if)# show fabricpath isis tr

traffic trees

N7K-1(config-if)# show fabricpath isis trees




MT-0


3, L1


124, L1


2768, L1



124, L1


2768, L1


N7K-1(config-if)#

!




CISCO PUBLIC

77 (Draft) V0.2


15.2.6. N7K-2

!

VLAN verifications:



---- -------------------------------- --------- -------------------------------

1 default active




VLAN Type Vlan-mode

---- ----- ----------

1 enet CE

20 enet FABRICPATH

40 enet FABRICPATH

200 enet CE

Remote SPAN VLANs

-------------------------------------------------------------------------------


------- --------- --------------- -------------------------------------------

vPC verifications:


Legend:


vPC domain id : 30

vPC+ switch id : 3















---------------------------------------------------------------------


-- ---- ------ --------------------------------------------------

1 Po110 up 20,40







HSRP verifications:

N7K-2(config)# show hsrp




CISCO PUBLIC

78 (Draft) V0.2



























N7K-2(config-if)# show mac add dynamic

Legend:




---------+-----------------+--------+---------+------+----+------------------

20 547f.ee93.61bc dynamic 0 F F 2768.0.0

* 40 547f.ee90.1501 dynamic 90 F F Eth8/9

40 547f.ee93.61bc dynamic 90 F F 2768.0.0






N7K-2(config-if)#




-------------------------------- ---------- --------------------

0 0 Up

FP Route-table verifications:









via ---- , [60/0], 15 day/s 08:54:09, local





CISCO PUBLIC

79 (Draft) V0.2


via ---- , [60/0], 15 day/s 08:49:44, local






via ---- , [60/0], 15 day/s 08:49:44, local







N7K-2(config-if)#





=========================================================================


----------+----------------+------------+-----------+--------------------






Total Switch-ids: 5






'*' - this system


MT-0

18ef.63e3.dcc3* 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3* 3 [C] 0[C] Yes 0 [E]

547f.ee93.61bc 2768[C] 0[C] Yes 64

f866.f206.fb43 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43 3 [C] 0[C] Yes 0 [E]

N7K-2(config-if)#


N7K-2(config-if)# show fabricpath isis protocol









Area address(es) :

00


CIB ID: 3


port-channel110

Ethernet8/10




CISCO PUBLIC

80 (Draft) V0.2


Level 1



MT-0 Ref-Bw: 400000



Distance : 115


ISIS Tree verifications:

N7K-2(config-if)# show fabricpath isis trees




MT-0


123, L1


2768, L1



3, L1


123, L1


2768, L1


N7K-2(config-if)#

15.2.7. N55K-1

!


N55K-1(config)# sh ip int brief | ex unas




VLAN verifications:

N55K-1(config)# sh vlan | in FABRIC

20 enet FABRICPATH

100 enet FABRICPATH

N55K-1(config)# sh int vlan 20 | in Hard




Legend:




---------+-----------------+--------+---------+------+----+------------------

* 20 0000.0c07.ac14 dynamic 0 F F 3.0.2047

* 20 f866.f206.fb43 dynamic 0 F F 123.0.1054







CISCO PUBLIC

81 (Draft) V0.2



f866.f206.fb43 N/A 1 UP 00:00:27 Ethernet1/1

18ef.63e3.dcc3 N/A 1 UP 00:00:23 Ethernet1/2

FP Switch-ID verifications:






'*' - this system


MT-0

18ef.63e3.dcc3 124 [C] 0[C] Yes 254 [S]

18ef.63e3.dcc3 3 [C] 0[C] Yes 0 [E]

547f.ee93.61bc* 2768[C] 0[C] Yes 64

f866.f206.fb43 123 [C] 0[C] Yes 255 [S]

f866.f206.fb43 3 [C] 0[C] Yes 0 [E]




=========================================================================


----------+----------------+------------+-----------+--------------------





*2768 547f.ee93.61bc Primary Confirmed No No

Total Switch-ids: 5

FP Route table verifications:









via ---- , [60/0], 14 day/s 07:55:26, local








N55K-1(config)#




CISCO PUBLIC

82 (Draft) V0.2


15.2.8. N55K-2

!

VLAN verifications:

N55K-2(config)# sh vlan | in 40


40 enet CE


N55K-2(config)# sh ip int brief | ex un




Trunk verifications:

N55K-2(config)# sh interface trunk | in 40

Eth1/2 40

Eth1/2 40


N55K-2(config)# sh inter vla 40 | in Hard


N55K-2(config)# sh mac add dynamic

Legend:




---------+-----------------+--------+---------+------+----+------------------

* 40 0000.0c07.ac28 dynamic 10 F F Eth1/2

* 40 f866.f206.fb43 dynamic 10 F F Eth1/2

N55K-2(config)#

15.3. Test Result

15.3.9. FP VLAN on N55K-1 Reaching N55K-2 FP edge device

!


PING 40.1.1.1 (40.1.1.1): 56 data bytes









N55K-1(config)#




CISCO PUBLIC

83 (Draft) V0.2


15.3.10. Single Homed N55K-2 Reaching the N55K-1 part of FP VLAN

!


PING 20.1.1.1 (20.1.1.1): 56 data bytes









N55K-2(config)#


84 (Draft) V0.2


16. Summary

Cisco fabric path toplogy is extensively flexible and can be adopted for L2 extension even in the mixed vendor

environment. Thourough analysis must be made to ensure that L2 domains are extended properly in the production

environment to avoid any kind of traffic blackholes.

Corporate Headquarters

Cisco Systems, Inc.

170 West Tasman Drive San Jose, CA 95134-1706

USA

www.cisco.com Tel: 408 526-4000

800 553-NETS (6387)

Fax: 408 526-4100

European Headquarters

Cisco Systems Europe

11 Rue Camille Desmoulins 92782 Issy-Les-Moulineaux

Cedex 9

France www-europe.cisco.com

Tel: 33 1 58 04 60 00

Fax: 33 1 58 04 61 00

Americas Headquarters

Cisco Systems, Inc.

170 West Tasman Drive San Jose, CA 95134-1706

USA

www.cisco.com Tel: 408 526-7660

Fax: 408 527-0883

Asia Pacific Headquarters

Cisco Systems Australia, Pty., Ltd

Level 9, 80 Pacific Highway P.O. Box 469

North Sydney

NSW 2060 Australia www.cisco.com

Tel: +61 2 8448 7100

Fax: +61 2 9957 4350

Cisco Systems has more than 200 offices in the following countries and regions. Addresses, phone numbers, and fax numbers are listed on the

Cisco Web site at www.cisco.com/go/offices.

Argentina • Australia • Austria • Belgium • Brazil • Bulgaria • Canada • Chile • China • Colombia • Costa Rica • Croatia • Czech Republic Denmark • Dubai, UAE Finland •

France • Germany • Greece • Hong Kong SAR • Hungary • India • Indonesia • Ireland • Israel • Italy • Japan • Korea • Luxembourg • Malaysia • Mexico

The Netherlands • New Zealand • Norway • Peru • Philippines • Poland • Portugal • Puerto Rico • Romania • Russia • Saudi Arabia • Singapore • Slovakia • Slovenia South

Africa • Spain • Sweden • Switzerland • Taiwan • Thailand • Turkey • Ukraine • United Kingdom • United States • Venezuela • Vietnam • Zimbabwe

http://www.cisco.com/go/offices