1、 Page * MERGEFORMAT 1CIDC系統網絡實施文檔 DOCPROPERTY Project ID * MERGEFORMAT 騰云天下IDC實施文檔上海華訊網絡系統有限公司II上海華訊網絡系統有限公司I目錄 TOC o 3-5 h z t 標題 1,1,標題 2,2 HYPERLINK l _Toc418087411 第1章設備信息 PAGEREF _Toc418087411 h 3 HYPERLINK l _Toc418087412 第2章拓撲介紹 PAGEREF _Toc418087412 h 3 HYPERLINK l _Toc418087413 2.1L3-Pod VX

2、LAN BGP EVPN拓撲 PAGEREF _Toc418087413 h 3 HYPERLINK l _Toc418087414 第3章VXLAN BGP EVPN配置方法 PAGEREF _Toc418087414 h 4 HYPERLINK l _Toc418087415 3.1N95-1配置及說明 PAGEREF _Toc418087415 h 4 HYPERLINK l _Toc418087416 3.2N95-2配置及說明 PAGEREF _Toc418087416 h 9 HYPERLINK l _Toc418087417 3.3N93-1配置及說明 PAGEREF _Toc4

3、18087417 h 14 HYPERLINK l _Toc418087418 3.4N93-2配置及說明 PAGEREF _Toc418087418 h 21版本控制信息文檔屬性屬性內容項目名稱文檔標題騰云天下IDC實施文檔文檔版本號1.0版本日期2015-04-23作者常驍審核人文檔變更過程版本更新日期更新人主要更新內容1.02015-04-23常驍文檔生成 設備信息表1.設備信息設備型號設備名稱NX-OS版本管理地址用戶名/密碼Nexus 9504N95-17.0(3)I1(1a)1.1.1.1admin/ciscoNexus 9504N95-27.0(3)I1(1a)1.1.1.2ad

4、min/ciscoNexus 9372N93-17.0(3)I1(1a)2.1.1.1admin/ciscoNexus 9372N93-27.0(3)I1(1a)2.1.1.2admin/cisco拓撲介紹L3-Pod VXLAN BGP EVPN拓撲2臺N93與2臺N95采用L3互聯（10.200.1.0/24）并使用OSPF協議作為underlay層用于互通；2臺N93與2臺N95運行BGP協議作為overlay層用于傳遞VTEP下掛的終端到VTEP網關的流量；2臺N93上運行VXLAN協議保證下聯終端可以跨上面L3網絡實現L2通信；（172.16.16.0/20）N93-1上使用1個端口

5、配置為L3口用于與用戶外部網絡連接；VXLAN BGP EVPN配置方法將VXLAN gateway 建立在Nexus 9372上，在N93-1上通過寫靜態路由的方式與客戶原有網絡進行聯通；保證VXLAN下掛用戶間L2通信走VXLAN網絡，去10.10.0.0/18網絡走到N93上再通過BGP聯通； 注釋只有NX-OS版本為7.0以上才支持VXLAN BGP EVPNN95-1配置及說明設備配置配置內容!Command: show running-config!Time: Fri Apr 24 13:57:13 2015version 7.0(3)I1(1a)hostname N95-1vdc

6、 N95-1 id 1 limit-resource vlan minimum 16 maximum 4094 limit-resource vrf minimum 2 maximum 4096 limit-resource port-channel minimum 0 maximum 768 limit-resource u4route-mem minimum 248 maximum 248 limit-resource u6route-mem minimum 96 maximum 96 limit-resource m4route-mem minimum 58 maximum 58 lim

7、it-resource m6route-mem minimum 8 maximum 8feature telnet 開啟telnetnv overlay evpn 開啟evpnfeature ospf 開啟OSPFfeature bgp 開啟BGPfeature pim 開啟pimfeature interface-vlan 開啟SVIfeature lacp 開啟lacpfeature lldp 開啟lldpusername admin password 5 $1$bZjikP9F$yR89Z2u3LRgdaqFe1i16l. role network-adminno password st

8、rength-checkip domain-lookupcopp profile strictsnmp-server user admin network-admin auth md5 0 x3a367acf836e9daa858eaea628047f1b priv 0 x3a367acf836e9daa858eaea628047f1b localizedkeyrmon event 1 log trap public description FATAL(1) owner PMONFATALrmon event 2 log trap public description CRITICAL(2)

9、owner PMONCRITICALrmon event 3 log trap public description ERROR(3) owner PMONERRORrmon event 4 log trap public description WARNING(4) owner PMONWARNINGrmon event 5 log trap public description INFORMATION(5) owner PMONINFOip pim rp-address 100.1.1.1 group-list 225.0.0.0/8 指定RP地址ip pim rp-candidate l

10、oopback1 group-list 225.0.0.0/8 指定RP地址 ip pim ssm range 232.0.0.0/8ip pim anycast-rp 100.1.1.1 1.1.1.1 指定RP冗余ip pim anycast-rp 100.1.1.1 1.1.1.2 指定RP冗余vlan 1vrf context managementinterface Vlan1interface Ethernet1/1 description N93-1:E1/49 speed 40000 duplex full mtu 9216 ip address 10.200.1.2/30 ip

11、 router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能 no shutdowninterface Ethernet1/2 description N93-2:E1/49 speed 40000 duplex full mtu 9216 ip address 10.200.1.10/30 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能 no shutdowninterface Ethernet1/3 no shutdowninterface Ethernet1/4 no s

12、hutdowninterface Ethernet1/5 no shutdowninterface Ethernet1/6 no shutdowninterface Ethernet1/7 no shutdowninterface Ethernet1/8 no shutdowninterface Ethernet1/9 no shutdowninterface Ethernet1/10 no shutdowninterface Ethernet1/11 no shutdowninterface Ethernet1/12 no shutdowninterface Ethernet1/13 no

13、shutdowninterface Ethernet1/14 no shutdowninterface Ethernet1/15 no shutdowninterface Ethernet1/16 no shutdowninterface Ethernet1/17 no shutdowninterface Ethernet1/18 no shutdowninterface Ethernet1/19 no shutdowninterface Ethernet1/20 no shutdowninterface Ethernet1/21 no shutdowninterface Ethernet1/

14、22 no shutdowninterface Ethernet1/23 no shutdowninterface Ethernet1/24 no shutdowninterface Ethernet1/25 no shutdowninterface Ethernet1/26 no shutdowninterface Ethernet1/27 no shutdowninterface Ethernet1/28 no shutdowninterface Ethernet1/29 no shutdowninterface Ethernet1/30 no shutdowninterface Ethe

15、rnet1/31 no shutdowninterface Ethernet1/32 no shutdowninterface mgmt0 vrf member management ip address 192.168.1.1/30interface loopback0 ip address 1.1.1.1/32 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能interface loopback1 ip address 100.1.1.1/32 ip router ospf 100 area 0.0.0.0 ip pim s

16、parse-mode 開啟組播功能line consoleline vtyboot nxos bootflash:/n9000-dk9.7.0.3.I1.1a.bin sup-1router ospf 100 router-id 1.1.1.1router bgp 65535 啟用BGP作為overlay層協議 router-id 1.1.1.1 log-neighbor-changes address-family ipv4 unicast 開啟iPv4功能 address-family l2vpn evpn 開啟L2vpn功能 retain route-target all 保留路由標記

17、neighbor 2.1.1.1 remote-as 65535 與N93-1建立IBGP鄰居 log-neighbor-changes update-source loopback0 源端口選擇loopback0 address-family ipv4 unicast 開啟iPv4功能 address-family l2vpn evpn 開啟L2vpn功能 send-community both 傳遞所有community route-reflector-client 作為N93-1的RR neighbor 2.1.1.2 remote-as 65535 與N93-2建立IBGP鄰居 log

18、-neighbor-changes update-source loopback0 源端口選擇loopback0 address-family ipv4 unicast 開啟iPv4功能 address-family l2vpn evpn 開啟L2vpn功能 send-community both 傳遞所有community route-reflector-client 作為N93-2的RRN95-2配置及說明!Command: show running-config!Time: Fri Apr 24 13:57:08 2015version 7.0(3)I1(1a)hostname N95-

19、2vdc N95-2 id 1 limit-resource vlan minimum 16 maximum 4094 limit-resource vrf minimum 2 maximum 4096 limit-resource port-channel minimum 0 maximum 768 limit-resource u4route-mem minimum 248 maximum 248 limit-resource u6route-mem minimum 96 maximum 96 limit-resource m4route-mem minimum 58 maximum 58

20、 limit-resource m6route-mem minimum 8 maximum 8feature telnet 開啟telnetnv overlay evpn 開啟evpnfeature ospf 開啟OSPFfeature bgp 開啟BGPfeature pim 開啟PIMfeature interface-vlan 開啟SVIfeature lacp 開啟lacpfeature lldp 開啟lldpusername admin password 5 $1$EsgoPddD$xlhuSuUJEWF3UtUes2wHE1 role network-adminno passwor

21、d strength-checkip domain-lookupcopp profile strictsnmp-server user admin network-admin auth md5 0 x90d4dc45822ab254147c4f7dd900b547 priv 0 x90d4dc45822ab254147c4f7dd900b547 localizedkeyrmon event 1 log trap public description FATAL(1) owner PMONFATALrmon event 2 log trap public description CRITICAL

22、(2) owner PMONCRITICALrmon event 3 log trap public description ERROR(3) owner PMONERRORrmon event 4 log trap public description WARNING(4) owner PMONWARNINGrmon event 5 log trap public description INFORMATION(5) owner PMONINFOip pim rp-address 100.1.1.1 group-list 225.0.0.0/8 指定RP地址ip pim rp-candida

23、te loopback1 group-list 225.0.0.0/8 指定RP地址ip pim ssm range 232.0.0.0/8ip pim anycast-rp 100.1.1.1 1.1.1.1 指定RP冗余ip pim anycast-rp 100.1.1.1 1.1.1.2 指定RP冗余vlan 1vrf context managementinterface Vlan1interface Ethernet1/1 description N93-1:E1/2 speed 40000 duplex full mtu 9216 ip address 10.200.1.6/30

24、ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能 no shutdowninterface Ethernet1/2 description N93-2:E1/2 speed 40000 duplex full mtu 9216 ip address 10.200.1.14/30 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能 no shutdowninterface Ethernet1/3 no shutdowninterface Ethernet1/4 no

25、shutdowninterface Ethernet1/5 no shutdowninterface Ethernet1/6 no shutdowninterface Ethernet1/7 no shutdowninterface Ethernet1/8 no shutdowninterface Ethernet1/9 no shutdowninterface Ethernet1/10 no shutdowninterface Ethernet1/11 no shutdowninterface Ethernet1/12 no shutdowninterface Ethernet1/13 no

26、 shutdowninterface Ethernet1/14 no shutdowninterface Ethernet1/15 no shutdowninterface Ethernet1/16 no shutdowninterface Ethernet1/17 no shutdowninterface Ethernet1/18 no shutdowninterface Ethernet1/19 no shutdowninterface Ethernet1/20 no shutdowninterface Ethernet1/21 no shutdowninterface Ethernet1

27、/22 no shutdowninterface Ethernet1/23 no shutdowninterface Ethernet1/24 no shutdowninterface Ethernet1/25 no shutdowninterface Ethernet1/26 no shutdowninterface Ethernet1/27 no shutdowninterface Ethernet1/28 no shutdowninterface Ethernet1/29 no shutdowninterface Ethernet1/30 no shutdowninterface Eth

28、ernet1/31 no shutdowninterface Ethernet1/32 no shutdowninterface mgmt0 vrf member management ip address 192.168.1.1/30interface loopback0 ip address 1.1.1.2/32 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能interface loopback1 ip address 100.1.1.1/32 ip router ospf 100 area 0.0.0.0 ip pim

29、sparse-mode 開啟組播功能line consoleline vtyboot nxos bootflash:/n9000-dk9.7.0.3.I1.1a.bin sup-1router ospf 100 啟用OSPF作為underlay層協議 router-id 1.1.1.2router bgp 65535 啟用BGP作為overlay層協議 router-id 1.1.1.2 log-neighbor-changes address-family ipv4 unicast 開啟iPv4功能 address-family l2vpn evpn 開啟L2vpn功能 retain rou

30、te-target all 保留路由標記 neighbor 2.1.1.1 remote-as 65535 與N93-1建立IBGP鄰居 log-neighbor-changes update-source loopback0 源端口選擇loopback0 address-family ipv4 unicast 開啟iPv4功能 address-family l2vpn evpn 開啟L2vpn功能 send-community both 傳遞所有community route-reflector-client 作為N93-1的RR neighbor 2.1.1.2 remote-as 655

31、35 與N93-2建立IBGP鄰居 log-neighbor-changes update-source loopback0 源端口選擇loopback0 address-family ipv4 unicast 開啟iPv4功能 address-family l2vpn evpn 開啟L2vpn功能 send-community both 傳遞所有community route-reflector-client 作為N93-2的RRN93-1配置及說明設備配置配置內容!Command: show running-config!Time: Fri Apr 24 05:56:03 2015vers

32、ion 7.0(3)I1(1a)hostname N93-1vdc N93-1 id 1 limit-resource vlan minimum 16 maximum 4094 limit-resource vrf minimum 2 maximum 4096 limit-resource port-channel minimum 0 maximum 512 limit-resource u4route-mem minimum 248 maximum 248 limit-resource u6route-mem minimum 96 maximum 96 limit-resource m4ro

33、ute-mem minimum 58 maximum 58 limit-resource m6route-mem minimum 8 maximum 8feature telnet 開啟telnetnv overlay evpn 開啟evpnfeature ospf 開啟OSPFfeature bgp 開啟BGPfeature pim 開啟PIMfeature interface-vlan 開啟SVIfeature vn-segment-vlan-based 開啟VN-segmentfeature lacp 開啟lacpfeature dhcp 開啟DHCPfeature lldp 開啟lld

34、pfeature nv overlay 開啟nv overlay username admin password 5 $1$8WQwoQlf$GH3S/c4PEFtuPvvW1qzCy/ role network-adminno password strength-checkip domain-lookupcopp profile strictsnmp-server user admin network-admin auth md5 0 x319af30c28464fb01da525458c81f50f priv 0 x319af30c28464fb01da525458c81f50f loca

35、lizedkeyrmon event 1 log trap public description FATAL(1) owner PMONFATALrmon event 2 log trap public description CRITICAL(2) owner PMONCRITICALrmon event 3 log trap public description ERROR(3) owner PMONERRORrmon event 4 log trap public description WARNING(4) owner PMONWARNINGrmon event 5 log trap

36、public description INFORMATION(5) owner PMONINFOfabric forwarding anycast-gateway-mac 0000.1111.2222 設置forwarding mac地址（網關的mac地址）ip pim rp-address 100.1.1.1 group-list 225.0.0.0/8 指定RP地址ip pim ssm range 232.0.0.0/8vlan 1,101,1001vlan 101 定義vlan 101作為L3層NVE端口 vn-segment 900001 設定VLAN與VXLAN的關系vlan 100

37、1 定義vlan 1001作為L2層NVE透傳VLAN vn-segment 2001001 設定VLAN與VXLAN的關系route-map static2BGP permit 10 新建route-map匹配所有靜態路由service dhcp 開啟DHCP服務ip dhcp relay 開啟DHCP中繼服務ipv6 dhcp relayvrf context managementvrf context vxlan-900001 定義一個vxlan的vrf vni 900001 與VLAN 10001使用vn-segment匹配 ip route 0.0.0.0/0 10.10.0.1 與

38、外部網絡互連的靜態路由 rd auto 定義RD address-family ipv4 unicast 開啟ipv4功能 route-target both auto 定義RT route-target both auto evpn 定義evpn RTinterface Vlan1interface Vlan101 定義L3層NVE SVI no shutdown vrf member vxlan-900001 劃入vxlan的vrf中interface Vlan1001 定義L2層NVE透傳SVI no shutdown vrf member vxlan-900001 劃入vxlan的vr

39、f中 ip address 172.16.16.1/20 定義網關 ip proxy-arp 開啟arp代理功能 fabric forwarding mode anycast-gateway 調用網關mac ip dhcp relay address 10.10.32.54 開啟dhcp中繼interface nve1 定義NVE端口 mtu 9216 修改MTU值 no shutdown source-interface loopback0 定義源端口 host-reachability protocol bgp使用BGP作為overlay協議 member vni 900001 assoc

40、iate-vrf 指定vni 900001為L3 nve端口 member vni 2001001 指定vni 2001001用組播225.4.0.1地址透傳 mcast-group 225.4.0.1interface Ethernet1/1 switchport access vlan 1001 將端口劃入vlan 1001中interface Ethernet1/2 switchport access vlan 1001interface Ethernet1/3 switchport access vlan 1001interface Ethernet1/4 switchport acc

41、ess vlan 1001interface Ethernet1/5 switchport access vlan 1001interface Ethernet1/6 switchport access vlan 1001interface Ethernet1/7 switchport access vlan 1001interface Ethernet1/8 switchport access vlan 1001interface Ethernet1/9 switchport access vlan 1001interface Ethernet1/10 switchport access v

42、lan 1001interface Ethernet1/11 switchport access vlan 1001interface Ethernet1/12 switchport access vlan 1001interface Ethernet1/13 switchport access vlan 1001interface Ethernet1/14 switchport access vlan 1001interface Ethernet1/15 switchport access vlan 1001interface Ethernet1/16 switchport access v

43、lan 1001interface Ethernet1/17 switchport access vlan 1001interface Ethernet1/18 switchport access vlan 1001interface Ethernet1/19 switchport access vlan 1001interface Ethernet1/20 switchport access vlan 1001interface Ethernet1/21 switchport access vlan 1001interface Ethernet1/22 switchport access v

44、lan 1001interface Ethernet1/23 switchport access vlan 1001interface Ethernet1/24 switchport access vlan 1001interface Ethernet1/25 switchport access vlan 1001interface Ethernet1/26 switchport access vlan 1001interface Ethernet1/27 switchport access vlan 1001interface Ethernet1/28 switchport access v

45、lan 1001interface Ethernet1/29 switchport access vlan 1001interface Ethernet1/30 switchport access vlan 1001interface Ethernet1/31 switchport access vlan 1001interface Ethernet1/32 switchport access vlan 1001interface Ethernet1/33 switchport access vlan 1001interface Ethernet1/34 switchport access v

46、lan 1001interface Ethernet1/35 switchport access vlan 1001interface Ethernet1/36 switchport access vlan 1001interface Ethernet1/37 switchport access vlan 1001interface Ethernet1/38 switchport access vlan 1001interface Ethernet1/39 switchport access vlan 1001interface Ethernet1/40 switchport access v

47、lan 1001interface Ethernet1/41 switchport access vlan 1001interface Ethernet1/42 switchport access vlan 1001interface Ethernet1/43 switchport access vlan 1001interface Ethernet1/44 switchport access vlan 1001interface Ethernet1/45 switchport access vlan 1001interface Ethernet1/46 switchport access v

48、lan 1001interface Ethernet1/47 switchport access vlan 1001interface Ethernet1/48 switchport access vlan 1001interface Ethernet1/49 description N95-1:E1/1 no switchport speed 40000 duplex full mtu 9216 ip address 10.200.1.1/30 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能 no shutdowninter

49、face Ethernet1/50 description N95-2:E1/1 no switchport speed 40000 duplex full mtu 9216 ip address 10.200.1.5/30 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能 no shutdowninterface Ethernet1/51 連接客戶10.0網絡端口 description link to N3K no switchport vrf member vxlan-900001 ip address 10.10.3.1

50、0/18 ip proxy-arp no shutdowninterface Ethernet1/52interface Ethernet1/53interface Ethernet1/54interface mgmt0 vrf member managementinterface loopback0 ip address 2.1.1.1/32 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 開啟組播功能line consoleline vtyboot nxos bootflash:/n9000-dk9.7.0.3.I1.1a.bin ro

51、uter ospf 100 啟用OSPF作為underlay層協議 router-id 2.1.1.1router bgp 65535 啟用BGP作為overlay層協議 router-id 2.1.1.1 address-family ipv4 unicast 開啟ipv4功能 address-family l2vpn evpn 開啟evpn功能 retain route-target all 保留所有RT標記 neighbor 1.1.1.1 remote-as 65535 與N95-1建立IBGP鄰居 update-source loopback0 指定源端口 address-famil

52、y ipv4 unicast 開啟ipv4功能 address-family l2vpn evpn 開啟evpn功能 send-community both 傳遞所有community neighbor 1.1.1.2 remote-as 65535 與N95-2建立IBGP鄰居 update-source loopback0 指定源端口 address-family ipv4 unicast 開啟ipv4功能 address-family l2vpn evpn 開啟evpn功能 send-community both 傳遞所有community vrf vxlan-900001 addres

53、s-family ipv4 unicast advertise l2vpn evpn 定義vrf vxlan-900001傳遞evpn redistribute static route-map static2BGP 10.0網絡路由重分布進BGP中進行傳遞evpn vni 2001001 l2 定義vni 2001001 為L2類型 rd auto 定義RD route-target import auto 定義進流量RT route-target export auto 定義出流量RTN93-2配置及說明設備配置配置內容!Command: show running-config!Time:

54、 Fri Apr 24 05:57:05 2015version 7.0(3)I1(1a)hostname N93-2vdc N93-2 id 1 limit-resource vlan minimum 16 maximum 4094 limit-resource vrf minimum 2 maximum 4096 limit-resource port-channel minimum 0 maximum 512 limit-resource u4route-mem minimum 248 maximum 248 limit-resource u6route-mem minimum 96 m

55、aximum 96 limit-resource m4route-mem minimum 58 maximum 58 limit-resource m6route-mem minimum 8 maximum 8feature telnet 開啟telnetnv overlay evpn 開啟evpnfeature ospf 開啟OSPFfeature bgp 開啟BGPfeature pim 開啟PIMfeature interface-vlan 開啟SVIfeature vn-segment-vlan-based 開啟VN-segmentfeature lacp 開啟lacpfeature

56、dhcp 開啟DHCPfeature lldp 開啟lldpfeature nv overlay 開啟nv overlay username admin password 5 $1$FMoBigOA$QqUqFV/9AFSJGSSMJ1yH8. role network-adminno password strength-checkip domain-lookupcopp profile strictsnmp-server user admin network-admin auth md5 0 x6e2e1f589c198fd709c83b695c507659 priv 0 x6e2e1f58

57、9c198fd709c83b695c507659 localizedkeyrmon event 1 log trap public description FATAL(1) owner PMONFATALrmon event 2 log trap public description CRITICAL(2) owner PMONCRITICALrmon event 3 log trap public description ERROR(3) owner PMONERRORrmon event 4 log trap public description WARNING(4) owner PMON

58、WARNINGrmon event 5 log trap public description INFORMATION(5) owner PMONINFOfabric forwarding anycast-gateway-mac 0000.1111.2222 設置forwarding mac地址（網關的mac地址）ip pim rp-address 100.1.1.1 group-list 225.0.0.0/8 指定RP地址ip pim ssm range 232.0.0.0/8vlan 1,101,1001vlan 101 定義vlan 101作為L3層NVE端口 vn-segment 9

59、00001 設定VLAN與VXLAN的關系vlan 1001 定義vlan 1001作為L2層NVE透傳VLAN vn-segment 2001001 設定VLAN與VXLAN的關系vrf context managementvrf context vxlan-900001 定義一個vxlan的vrf vni 900001 與VLAN 10001使用vn-segment匹配 rd auto address-family ipv4 unicast 開啟ipv4功能 route-target both auto 定義RTroute-target both auto evpn 定義evpn RT i

60、nterface Vlan1interface Vlan101 定義L3層NVE SVI no shutdown vrf member vxlan-900001 劃入vxlan的vrf中interface Vlan1001 no shutdown vrf member vxlan-900001 劃入vxlan的vrf中ip address 172.16.16.1/20 定義網關 ip proxy-arp fabric forwarding mode anycast-gateway 調用網關mac interface nve1 定義NVE端口 mtu 9216 修改MTU值 no shutdow