華為交換下誤接TP-LINK交換導致監控畫面藍屏的解決方案
原標題:華為交換下誤接TP-LINK交換導致監控畫面藍屏的解決方案
1,問題描述
客戶在監控網路中私自接了一台TP-LINK,TP-LINK頻繁的向上游交換機發送TCN BPDU,導致每過一段時間網路監控系統就出現一次藍屏或者閃斷等現象;
S3700版本為:V100R006C05
< BL-1F-SZ-10.17>dis ver
Huawei Versatile Routing Platform Software
VRP (R) software, Version 5.70 (S3700 V100R006C05)
Copyright (C) 2003-2013 HUAWEI TECH CO., LTD
Quidway S3700-28TP-EI-AC Routing Switch uptime is 0 week, 2 days, 2 hours, 55 minutes
EOFEA 0(Master) : uptime is 0 week, 2 days, 2 hours, 54 minutes
128M bytes DDR Memory
16M bytes FLASH
Pcb Version : VER B
Basic BOOTROM Version : 349 Compiled at Mar 15 2013, 11:00:55
Software Version : VRP (R) Software, Version 5.70 (V100R006C05)
圖1-1組網拓撲
2,告警信息
監控系統藍屏、閃斷現象截圖如下:
3,處理過程
1、監控系統出現藍屏或者閃斷時,立刻查看網路有無異常告警,結果在核心交換機上發現如下告警信息:
<HX-S12708>dis trapbuffer
#Jan 13 2016 13:22:50 HX-S12708 MSTP/4/TCGUARD:OID 1.3.6.1.4.1.2011.5.25.42.4.2.15 The instance received TC message exceeded the threshold will be deferred to deal with at the end of TC protection time. (InstanceID=0)
2、通過上述信息初步懷疑是網路 STP震蕩,然後在核心交換機上查看STP-BPDU統計信息如下:
<HX-S12708>display stp tc-bpdu statistics
-------------------------- STP TC/TCN information --------------------------
MSTID Port TC(Send/Receive) TCN(Send/Receive)
0 XGigabitEthernet1/3/0/0 1006/0 0/0
0 XGigabitEthernet1/3/0/1 771/0 0/0
0 GigabitEthernet1/2/1/1 209/0 0/0
0 GigabitEthernet1/2/1/4 218/0 0/0
0 GigabitEthernet1/2/1/5 244/0 0/0
0 GigabitEthernet1/1/1/1 225/0 0/0
0 GigabitEthernet1/1/1/3 212/0 0/0
0 GigabitEthernet1/1/1/4 239/0 0/0
0 GigabitEthernet1/1/1/5 256/0 0/0
0 GigabitEthernet1/1/1/6 218/0 0/0
0 GigabitEthernet1/1/1/7 233/0 0/0
0 XGigabitEthernet2/3/0/0 985/0 0/0
0 XGigabitEthernet2/3/0/1 1022/0 0/0
0 GigabitEthernet2/1/1/0 225/0 0/0
0 GigabitEthernet2/2/1/2 254/0 0/0
0 GigabitEthernet2/2/1/3 218/0 0/0
0 Eth-Trunk1 768/4 0/0
0 Eth-Trunk2 799/3 0/0
0 Eth-Trunk3 819/7 0/0
0 Eth-Trunk4 31/661 0/0
0 Eth-Trunk5 879/10 0/0
0 Eth-Trunk6 907/3 0/0
0 Eth-Trunk7 979/0 0/0
在核心S12708上查看stp拓撲改變,最近一次是10分鐘之前,也是從Eth-Trunk4收到的。
<HX-S12708>display stp topology-change
CIST topology change information
Number of topology changes :443
Time since last topology change :0 days 0h:10m:18s
Topology change initiator(notified) :Eth-Trunk4
Topology change last received from :845b-1236-5090
Number of generated topologychange traps : 96
Number of suppressed topologychange traps: 59
3、然後登錄到核心S12708的Eth-Trunk4口下接匯聚交換機<BLSZ-HJ-10.7>上查看stp tc-bpdu統計,GigabitEthernet0/0/2口收到的TC報文最多。
<BLSZ-HJ-10.7>display stp tc-bpdu statistics
-------------------------- STP TC/TCN information --------------------------
MSTID Port TC(Send/Receive) TCN(Send/Receive)
0 GigabitEthernet0/0/1 534/0 0/0
0 GigabitEthernet0/0/2 21/324 0/0
0 GigabitEthernet0/0/3 569/0 0/0
0 GigabitEthernet0/0/4 588/0 0/0
0 GigabitEthernet0/0/5 607/0 0/0
0 Eth-Trunk0 463/11 0/0
然後查看stp拓撲變更,最近一次拓撲改變也是GigabitEthernet0/0/2口。
<BLSZ-HJ-10.7>disp stp topology-change
CIST topology change information
Number of topology changes :385
Time since last topology change :0 days 0h:15m:23s
Topology change initiator(notified) :GigabitEthernet0/0/2
Topology change last received from :845b-1235-3ff0
Number of generated topologychange traps : 44
Number of suppressed topologychange traps: 14
4、在匯聚交換機<BLSZ-HJ-10.7>上找到GigabitEthernet0/0/2口下聯交換機<BL-1F-SZ-10.17>,在<BL-1F-SZ-10.17>上查看stp tc-bpdu統計,發現Ethernet0/0/8口收到最多的TC報文。
<BL-1F-SZ-10.17>display stp tc-bpdu statistics
-------------------------- STP TC/TCN information --------------------------
MSTID Port TC(Send/Receive) TCN(Send/Receive)
0 Ethernet0/0/8 3362/911 6/256
0 Ethernet0/0/20 2218/0 0/0
0 GigabitEthernet0/0/1 1949/267 0/0
然後再查看stp拓撲變更,最近一次即是<BL-1F-SZ-10.17>的Ethernet0/0/8口。
<BL-1F-SZ-10.17>display stp topology-change
CIST topology change information
Number of topology changes :1435
Time since last topology change :0 days 0h:29m:55s
Topology change initiator(notified) :Ethernet0/0/8
Topology change last received from :0019-e8da-d088
5、查看Ethernet0/0/8口配置,發現是個邊緣埠,配置如下:
interface Ethernet0/0/8
port link-type access
port default vlan 15
stp edged-port enable
6、詢問客戶Ethernet0/0/8下接的是什麼設備,經過客戶確認是他們最近自己私自接的一台TP-LINK交換機,用於其他業務。然後和客戶協調關閉該介面觀察一段時間,發現關閉介面後一切正常,問題沒有復現。
4,根因
監控網路中私接的一台TP-LINK頻繁的向上游交換機發送TCN BPDU,導致每過一段時間網路監控系統就出現一次藍屏或者閃斷等現象
5,解決方案
1.當網路中出現故障,多分析告警信息,通過display trapbuffer,display logbuffer等。
2.規範網路配置,shutdown沒有使用的埠,可以有效避免私接交換機導致的網路故障。
6,建議與總結
在原有的網路中新接入其它設備應該充分考慮對現網的影響,有的時候多插了一根網線就會導致網路出現環路,導致網路癱瘓。另外,工程師服務完後一些注意事項應該和客戶說明。


TAG:第一監控 |