昇腾HCCN组网-双节点单交换机

各种教程·supo的文章 · 昨天 · 17 人浏览

参考链接：https://support.huawei.com/enterprise/zh/doc/EDOC1100543351/aecf5cf0?idPath=23710424#ZH-CN_TOPIC_0000002200951177

环境

双节点：atlas 800T A2

node1用一分二线接参数交换机1-4口

node2用一分二线接参数交换机5-8口

配置

npu网口地址

NPU网口 Node 1 Node 2
NPU0 10.20.0.2/24 10.20.0.10/24
NPU1 10.20.0.3/24 10.20.0.11/24
NPU2 10.20.0.4/24 10.20.0.12/24
NPU3 10.20.0.5/24 10.20.0.13/24
NPU4 10.20.0.6/24 10.20.0.14/24
NPU5 10.20.0.7/24 10.20.0.15/24
NPU6 10.20.0.8/24 10.20.0.16/24
NPU7 10.20.0.9/24 10.20.0.17/24

Leaf交换机 IP地址

interface IP
vlanif 100 10.20.0.1/24
LoopBack0 10.10.10.101/32

实施

node1

配置npu网卡ip

hccn_tool -i 0 -ip -s address 10.20.0.2 netmask 255.255.255.0
hccn_tool -i 1 -ip -s address 10.20.0.3 netmask 255.255.255.0
hccn_tool -i 2 -ip -s address 10.20.0.4 netmask 255.255.255.0
hccn_tool -i 3 -ip -s address 10.20.0.5 netmask 255.255.255.0
hccn_tool -i 4 -ip -s address 10.20.0.6 netmask 255.255.255.0
hccn_tool -i 5 -ip -s address 10.20.0.7 netmask 255.255.255.0
hccn_tool -i 6 -ip -s address 10.20.0.8 netmask 255.255.255.0
hccn_tool -i 7 -ip -s address 10.20.0.9 netmask 255.255.255.0

配置npu网卡网关

hccn_tool -i 0 -gateway -s gateway 10.20.0.1
hccn_tool -i 1 -gateway -s gateway 10.20.0.1
hccn_tool -i 2 -gateway -s gateway 10.20.0.1
hccn_tool -i 3 -gateway -s gateway 10.20.0.1
hccn_tool -i 4 -gateway -s gateway 10.20.0.1
hccn_tool -i 5 -gateway -s gateway 10.20.0.1
hccn_tool -i 6 -gateway -s gateway 10.20.0.1
hccn_tool -i 7 -gateway -s gateway 10.20.0.1

其他

将0-7口设置侦测地址设置为网关10.20.0.1
for i in {0..7}; do hccn_tool -i $i -netdetect -s address 10.20.0.1; done

node2

配置npu网卡ip

hccn_tool -i 0 -ip -s address 10.20.0.10 netmask 255.255.255.0
hccn_tool -i 0 -ip -s address 10.20.0.11 netmask 255.255.255.0
hccn_tool -i 0 -ip -s address 10.20.0.12 netmask 255.255.255.0
hccn_tool -i 1 -ip -s address 10.20.0.13 netmask 255.255.255.0
hccn_tool -i 2 -ip -s address 10.20.0.14 netmask 255.255.255.0
hccn_tool -i 3 -ip -s address 10.20.0.15 netmask 255.255.255.0
hccn_tool -i 4 -ip -s address 10.20.0.16 netmask 255.255.255.0
hccn_tool -i 5 -ip -s address 10.20.0.17 netmask 255.255.255.0

配置npu网卡网关

hccn_tool -i 0 -gateway -s gateway 10.20.0.1
hccn_tool -i 1 -gateway -s gateway 10.20.0.1
hccn_tool -i 2 -gateway -s gateway 10.20.0.1
hccn_tool -i 3 -gateway -s gateway 10.20.0.1
hccn_tool -i 4 -gateway -s gateway 10.20.0.1
hccn_tool -i 5 -gateway -s gateway 10.20.0.1
hccn_tool -i 6 -gateway -s gateway 10.20.0.1
hccn_tool -i 7 -gateway -s gateway 10.20.0.1

其他

将0-7口设置侦测地址设置为网关10.20.0.1
for i in {0..7}; do hccn_tool -i $i -netdetect -s address 10.20.0.1; done

交换机配置

  1. （Leaf交换机端口为400GE时需要配置）将Leaf交换机连接计算节点的400GE端口拆分为2*200GE。
Leaf 1
port split dimension interface 400GE1/0/1 to 400GE1/0/32 split-type 2*200GE
  1. 全局使能LLDP。
Leaf 1 命令说明
plain lldp enable lldp mdn enable 使能LLDP功能
使能全局的MDN功能，使所有接口都支持接收非标准发现协议报文，并根据报文的源MAC地址信息唯一地识别MDN邻居
  1. 通过DSCP值映射来承载RoCEv2流量，华为交换机默认配置DSCP 33映射到优先级队列4，因此本步骤设置DSCP映射功能即可。
Leaf 1
dcb pfc dscp-mapping enable slot 1
  1. 配置DCB PFC。
Leaf 1 命令说明
qos buffer headroom-pool size 6 mbytes slot 1 手工配置芯片级Headroom缓存空间大小
- 线缆长度500米及以内：6 mbytes
- 线缆长度500米至2000米：8 mbytes
如果组网环境和流量模型复杂，发生设备丢包，需要调大芯片级的Headroom缓存空间，如果丢包依然存在，请联系技术支持人员
plain dcb pfc server priority 4 undo priority 3 priority 4 turn-off threshold 90 全局使能PFC
使能无损队列为4队列（priority命令是累增式命令，多次配置时，配置结果按多次累加生效）
缺省情况下，优先级队列3已使能PFC功能，取消优先级队列3的PFC功能
20s之内检测到90次死锁就关闭端口PFC功能
说明：
首次触发自动关闭PFC功能后，间隔20s会自动重新开启PFC功能。
若首次自动重新开启PFC功能后，连续触发自动关闭PFC功能，则每次自动重新开启的时间间隔会递增20s，当间隔时间达到180s后，时间间隔不再增加。
  1. 开启PFC死锁监控。
Leaf 1 命令说明
plain dcb pfc deadlock-detect interval 10 dcb pfc priority 4 deadlock-detect time 10 priority 4 deadlock-recovery time 10 dcb pfc deadlock recovery-behavior forwarding slot 1 # 指定PFC硬件死锁检测周期精度和死锁恢复时间精度为10ms（设备缺省已配置，需要使用display current-configuration include-default命令查看）
配置死锁检测周期，检测时间为10时间精度，即100ms
配置死锁恢复周期，恢复时间为10时间精度，即100ms
缺省情况下，死锁检测周期和死锁恢复周期为100ms
（设备缺省已配置，需要使用display current-configuration include-default命令查看）
配置硬件死锁恢复期间设备转发报文（设备缺省已配置，需要使用display current-configuration include-default命令查看）
  1. 配置VLAN，VLAN子接口和LoopBack子接口。
Leaf 1
plain vlan 100 interface Vlanif100 ip address 10.20.0.1 255.255.255.0 interface LoopBack0 ip address 10.10.10.101 255.255.255.255
  1. 配置拆分后的端口，以400GE1/0/1:1、400GE1/0/1:2、400GE1/0/2:1、400GE1/0/2:2四个端口为例，其他端口配置命令相同。
参考命令

interface 400GE1/0/1:1
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/1:2
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/2:1
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/2:2
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/3:1
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/3:2
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/4:1
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/4:2
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/5:1
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/5:2
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/6:1
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/6:2
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/7:1
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/7:2
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/8:1
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

interface 400GE1/0/8:2
 port default vlan 100
 stp edged-port enable
 carrier down-hold-time 1000
 storm suppression unknown-unicast cir 10 mbps
 storm suppression multicast cir 1 mbps
 storm suppression broadcast cir 1 mbps
 trust dscp
 dcb pfc enable server mode manual
 dcb pfc buffer 4 guaranteed 5 kbytes
dcb pfc buffer 4 hdrm 1024 kbytes
dcb pfc buffer 4 xoff dynamic 4 xon offset 6 kbytes
 qos buffer queue 4 shared-threshold static 33280 kbytes
qos drr 0 4
 qos queue 0 drr weight 10
 qos queue 4 drr weight 90

  1. 设备优化配置。
Leaf 1 说明
plain vlan 1 storm suppression multicast cir 64 kbps storm suppression broadcast cir 64 kbps storm suppression unknown-unicast cir 64 kbps 配置VLAN1的BUM报文允许通过的承诺信息速率为64kbps，避免发生ARP协议风暴影响正常业务。
plain qos buffer overrun alarm enable qos buffer overrun threshold 80 + 使能队列缓存超限告警。
+ 配置缓存超限告警门限，当队列缓存占用超过队列阈值的80%，触发告警。
error-down auto-recovery cause link-flap interval 60 + 使能处于Error-Down状态的接口状态自动恢复为Up的功能。
+ 指定引起接口状态变为Error-Down的原因为链路振荡。
+ 接口状态自动恢复为Up的延迟时间为60秒。
  1. 提交
在系统视图
commit
在用户视图
save

验证

以下图片仅为参考输出，非本笔记配置输出

检查物理链接

for i in {0..7}; do hccn_tool -i $i -lldp -g | grep Ifname; done

检查链接情况

for i in {0..7}; do hccn_tool -i $i -link -g ; done

检查网络健康情况

for i in {0..7}; do hccn_tool -i $i -net_health -g ; done

查看侦测ip的配置是否正确

for i in {0..7}; do hccn_tool -i $i -gateway -g ; done

获取每张卡的ip地址

ping测试连接

for j in {0..7}; do for i in {0..7}; do hccn_tool -i ${j} -ping -g address 10.0.3.1${i} ; done; done

跨节点ping测试

hccn_tool -i 0 -ping -g address x.x.x.x

查看npu配置文件

cat /etc/hccn.conf
欢迎交流 admin@supome.cn
未经授权禁止转载
笔记地址：https://www.yuque.com/supo/bkrtrv/fqf2n3nwwwlkr5pn?singleDoc
2020 - 2026 Supo's blog. All Rights Reserved.
Theme Jasmine by Kent Liao