banner motd # *************************************************************************** * NetApp Reference Configuration File (RCF) * * Switch : 3132Q-V * Filename : 1.4-Cluster-HA-Breakout * Date : 21-May-2019 * * 40G Port Usage: * Ports 1- 6: Breakout mode (4x10G) Intra-Cluster/HA Ports, VLAN 17/18, QoS/PFC ON * Ports 7-30: 40G Intra-Cluster/HA Ports, VLAN 17/18, QoS/PFC/ECN ON * Ports 31-32: Intra-Cluster ISL Ports * * * NOTES: Description of VLAN Information and Usage: * * DEFAULT VLAN 1: The default VLAN 1 is used for control protocols VTP, CDP, PagP, and * DTP by default. Each remain on VLAN 1 regardless if native vlan changes, the packets for CDP * and the others remain marked as vlan 1 (except for DTP which always remains on the native). * When trunked with native VLAN 1, it is untagged. On a trunk with native VLAN * other than 1, CDP is tagged VLAN 1. However, if the trunk has not got * VLAN 1 in its allowed set, CDP still gets through, tagged as VLAN 1. * * NATIVE VLAN 92: The native VLAN is typically untagged on 802.1Q trunk ports. * We used best practice to explicitly tag the native VLAN in order to prevent * against crafted 802.1Q double-tagged packets from traversing VLANs. * * VLAN 17/18: To operate in this environment, ONTAP will need to share a single * pair of high speed Ethernet ports for both intra-cluster networking and HA * interconnect. Cluster traffic will continue to utilize the same IP networking * that has in the past, while HA interconnect will utilize hardware accelerated * RDMA (RoCE) over the same physical Ethernet cable. Each type of interconnect * will continue to be isolated in a separate IPspace with cluster networking * utilizing untagged traffic (the "base port") on VLAN 1/Native VLAN 92 and * HA interconnect utilizing a hard-coded VLAN tag (a "VLAN port") on VLAN 17/18. * ****************************************************************************** # interface breakout module 1 port 1-6 map 10g-4x feature lacp feature lldp vlan 92 name native exit vlan 1,17,18 exit cdp enable cdp advertise v1 cdp timer 5 system default switchport snmp-server community cshm1! group network-operator errdisable recovery interval 30 spanning-tree port type edge default port-channel load-balance src-dst ip-l4port-vlan ip domain-lookup interface port-channel1 switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,92 mtu 9216 no shutdown #******************* PFC/QoS/ECN ************************# class-map type qos match-all ROCEv2 match cos 5 policy-map type qos HA_TRAFFIC class ROCEv2 set qos-group 5 class class-default set qos-group 0 policy-map type queuing QOS_EGRESS_PORT class type queuing c-out-8q-q7 priority level 1 class type queuing c-out-8q-q6 bandwidth remaining percent 0 class type queuing c-out-8q-q5 bandwidth remaining percent 60 random-detect threshold burst-optimized ecn class type queuing c-out-8q-q4 bandwidth remaining percent 0 class type queuing c-out-8q-q3 bandwidth remaining percent 0 class type queuing c-out-8q-q2 bandwidth remaining percent 0 class type queuing c-out-8q-q1 bandwidth remaining percent 0 class type queuing c-out-8q-q-default bandwidth remaining percent 40 random-detect threshold burst-optimized ecn policy-map type network-qos QOS_NETWORK class type network-qos c-8q-nq5 pause pfc-cos 5 mtu 9216 class type network-qos c-8q-nq-default mtu 9216 system qos service-policy type network-qos QOS_NETWORK service-policy type queuing output QOS_EGRESS_PORT copp profile strict hardware access-list tcam region span 0 hardware access-list tcam region racl 256 hardware access-list tcam region e-racl 256 hardware access-list tcam region qos 256 hardware qos include ipg #********************* End of PFC/QoS/ECN *********************# #******************* 10G Cluster/HA breakout ports ********************# interface Ethernet1/1/1 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/1/2 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/1/3 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/1/4 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/2/1 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/2/2 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/2/3 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/2/4 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/3/1 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/3/2 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/3/3 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/3/4 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/4/1 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/4/2 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/4/3 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/4/4 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/5/1 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/5/2 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/5/3 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/5/4 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/6/1 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/6/2 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/6/3 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/6/4 description 10G Cluster/HA breakout port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown #******************* End of 10G Cluster/HA breakout ports *************# #****************** 40G Cluster/HA ports ********************************# interface Ethernet1/7 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/8 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/9 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/10 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/11 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/12 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/13 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/14 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/15 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/16 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/17 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/18 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/19 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/20 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/21 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/22 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/23 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/24 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/25 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/26 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/27 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/28 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/29 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown interface Ethernet1/30 description 40G Cluster/HA port switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,17-18,92 priority-flow-control mode on spanning-tree port type edge trunk spanning-tree bpduguard enable mtu 9216 service-policy type qos input HA_TRAFFIC no shutdown #******************* End of 40G Cluster/HA ports ********************# #**************** Intra-Cluster ISL ports **********************# interface Ethernet1/31 description Intra-Cluster Switch ISL Port 1/31 (port channel) switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,92 mtu 9216 channel-group 1 mode active no shutdown interface Ethernet1/32 description Intra-Cluster Switch ISL Port 1/32 (port channel) switchport mode trunk switchport trunk native vlan 92 switchport trunk allowed vlan 1,92 mtu 9216 channel-group 1 mode active no shutdown #***************** End of Intra-Cluster ISL ports ****************#