案例分析一次C4506交换机CPU利用率过高的处理过程.docx

案例分析一次C4506交换机CPU利用率过高的处理过程.docx

《案例分析一次C4506交换机CPU利用率过高的处理过程.docx》由会员分享，可在线阅读，更多相关《案例分析一次C4506交换机CPU利用率过高的处理过程.docx（12页珍藏版）》请在冰豆网上搜索。

案例分析一次C4506交换机CPU利用率过高的处理过程

案例分析一次C4506交换机CPU利用率过高的处理过程

案例分析：

一次C4506交换机CPU利用率过高的处理过程刚处理过一次C4506交换机CPU利用率过高

（1）

通过交换机showproccpu的命令输出的信息可以看到：

在5秒、1分钟、5分钟内Cat4kMgmtLoPri进程的CPU占用率分别为91.69%92.18%92.23%

显然是这个进程消耗了大量的CPU运行资源，从而导致交换机没有新的资源处理新的请求。

处理器运行两个进程，Cat4kMgmtHiPri和Cat4kMgmtLoPri，这两个进程同其他进程一样要占用cpu时间。

当Cat4k平台上某项进程占用cpu超出了应分配的cpu时间，Cat4kMgmtLoPri会接管这项进程，使其他进程能够得到cpu时间。

同样当某个进程占用cpu时间没有超过规定的cpu利用率，Cat4kMgmtHiPri会接管这个进程。

而Cat4kMgmtLoPri进程CPU占用率超过90%，我们判断一定是某一个进程大大超过了CPU应分配的时间，而Cat4kMgmtLoPri进程试图接管这一进程，而导致了Cat4kMgmtLoPri进程的CPU占用时间超过了90%。

根据这一思路只要我们找出这个进程，将其关闭或找出这个进程的作用，就可以解决这个问题并能够找出CPU占用率过高的原因。

showproccpu

CPUutilizationforfiveseconds:

99%/0%;oneminute:

99%;fiveminutes:

99%

PIDRuntime（ms）InvokeduSecs5Sec1Min5MinTTYProcess101300.00%0.00%0.00%0ChunkManager

2552*****250.00%0.00%0.00%0LoadMeter

316013112210.00%0.00%0.00%0SpanTreeHelper

40100.00%0.00%0.00%0DeferredEvents

5**********70540.00%0.06%0.05%0Checkheaps

64220000.00%0.00%0.00%0PoolManager

70200.00%0.00%0.00%0Timers80200.00%0.00%0.00%0SerialBackgroun

90100.00%0.00%0.00%0AAA_SERVER_DEADT

100200.00%0.00%0.00%0AAAhigh-capacit

110100.00%0.00%0.00%0Policy

Manager

1216182580.00%0.00%0.00%0IPCDynamicCach

130100.00%0.00%0.00%0IPCZoneManager

14644*****50.00%0.00%0.00%0IPCPeriodicTim

15412*****30.00%0.00%0.00%0IPCDeferredPor

160100.00%0.00%0.00%0IPCSeatManager

170100.00%0.00%0.00%0IFSAgentManage

18**********3160.23%0.21%0.22%0ARPInput

19681161810.00%0.00%0.00%0EntityMIBAPI

200100.00%0.00%0.00%0SERIALA'detect

21856*****70.00%0.00%0.00%0DynamicARPInsp

222060*****750.00%0.00%0.00%0HCCounterTimer

230100.00%0.00%0.00%0CriticalBkgnd

241716*****180.00%0.00%0.00%0NetBackground

250500.00%0.00%0.00%0Logger26716*****60.00%0.00%0.00%0TTYBackground

272072*****180.00%0.00%0.00%0Per-SecondJobs

28*****1947*****0.00%0.04%0.00%0Per-minuteJobs

29***-********-*****3244.63%3.81%3.72%0Cat4kMgmtHiPri

30***-********-*****125091.69%92.18%92.23%0Cat4kMgmtLoPri

31260*****50.00%0.00%0.00%0GaliosReschedul

320200.00%0.00%0.00%0Helper

330200.00%0.00%0.00%0NAMManager

IOSACL341522*****0.00%0.00%0.00%0rftask35**********300.00%0.00%0.00%0NetInput

36**********5040.07%0.03%0.00%0Computeloadavg

3708400.00%0.00%0.00%0BACKCHECK

380100.00%0.00%0.00%0chkptmessageha

390200.00%0.00%0.00%0cpf_process_msg_

400100.00%0.00%0.00%0cpf_process_ipcQ

4101400.00%0.00%0.00%0AggMgrProcess

420100.00%0.00%0.00%0*****

4301500.00%0.00%0.00%0Collectionproce

440300.00%0.00%0.00%0CEFswitchingba

450200.00%0.00%0.00%0AAADictionaryR

460200.00%0.00%0.00%0AAAServer

470100.00%0.00%0.00%0AAAACCTProc

480100.00%0.00%0.00%0ACCTPeriodicPr

49********-*****4920.71%0.62%0.62%0SpanningTree

504396*****780.00%0.01%0.00%0DTPProtocol

5140*****30.00%0.00%0.00%0Ethchnl

523744*****340.00%0.01%0.00%0UDLD5312934120.00%0.00%0.00%0DHCPSnooping

54201825100.00%0.00%0.00%0Port-Security

55***-********-*****5111.59%1.75%1.77%0IPInput

560100.00%0.00%0.00%0ICMPeventhandl

57**********24240.07%0.14%0.11%0CDPProtocol

5816221720.00%0.02%0.00%0Exec611482534580.00%0.00%0.00%0CEFbackgroundp

620200.00%0.00%0.00%0XDRmcast

630100.00%0.00%0.00%0IPCLCMessageH

640100.00%0.00%0.00%0XDRRPPingBack

65892580.00%0.00%0.00%0XDRRPbackgroun

660100.00%0.00%0.00%0XDRRPTestBack

670100.00%0.00%0.00%068**********5500.07%0.07%0.07%0CEF:

IPv4proces

691843651110.00%0.00%0.00%0ADJbackground

70483671300.00%0.00%0.00%0L2MM711201447820.00%0.00%0.00%0MRD721068*****890.00%0.00%0.00%0IGMPSN730100.00%0.00%0.00%0IGMPSN-HA

740100.00%0.00%0.00%0SocketTimers

750200.00%0.00%0.00%0L2TRACESERVER

76288*****170.00%0.00%0.00%0TCPTimer

7740517840.00%0.00%0.00%0TCPProtocols

78101256411790.00%0.00%0.00%0HTTPCORE

790100.00%0.00%0.00%0CHKPT*****

800100.00%0.00%0.00%0CHKPTDevTest

810200.00%0.00%0.00%0ATIP_UDP_TSK

820100.00%0.00%0.00%0DHCPSnoopingHA

830100.00%0.00%0.00%0Probe

IPIRDPInput

840100.00%0.00%0.00%0RARPInput

855380*****1590.00%0.00%0.00%0DHCPDReceive

86113220795440.00%0.00%0.00%0IPBackground

8730018561610.00%0.00%0.00%0IPRIBUpdate

880100.00%0.00%0.00%0COPS89161371110.00%0.00%0.00%0ClusterL2

9076*****60.00%0.00%0.00%0ClusterRARP

910200.00%0.00%0.00%0LOCALAAA

920200.00%0.00%0.00%0AAACachedServe

930200.00%0.00%0.00%0TPLUS940300.00%0.00%0.00%0RADIUSTESTCMD

950200.00%0.00%0.00%0AAASENDSTOPEV

96**********140.15%0.04%0.01%0PMCallback

9738030391250.00%0.00%0.00%0VLANManager

98891380.00%0.00%0.00%0DHCPDTimer

994162500.00%0.00%0.00%0VTPTrapProcess

1000200.00%0.00%0.00%0DHCPSecurityHe

1010100.00%0.00%0.00%0DiagCard1/-1

1020100.00%0.00%0.00%0DiagCard2/-1

1030100.00%0.00%0.00%0DiagCard3/-1

1040100.00%0.00%0.00%0DiagCard4/-1

1054124768650.00%0.00%0.00%0SyslogTraps

1060200.00%0.00%0.00%0VTPMIB

EDITBUFF

1070300.00%0.00%0.00%0SPANswitch

1080200.00%0.00%0.00%0SNMPTimers

1090200.00%0.00%0.00%0IPSNMP1100100.00%0.00%0.00%0PDU*****HER

1110100.00%0.00%0.00%0SNMPENGINE

1120100.00%0.00%0.00%0SNMPConfCopyPro

113804916320.00%0.00%0.00%0SNMPTraps

1141344*****120.00%0.00%0.00%0NTP115324*****100.00%0.00%0.00%0DHCPDDatabase

116356*****60.00%0.00%0.00%0Systempolling

通过showplatformhealth命令进一步更为详细的检查Catalyst4506交换机的进程我们发现K2CpuManReview进程有异常，如下：

showplahea

%CPU%CPURunTimeMaxPriorityAverage%CPUTotal

TargetActualTargetActualFgBg5SecMinHourCPU

Lj-poll1.000.0121441005000000:

26

GalChassisVp-review3.000.1710281005000002:

50

S2w-JobEventSchedule10.000.251091005000004:

35

Stub-JobEventSchedul10.002.36103410050022135:

16

StatValueManUpdate1.000.05101005000001:

58

Pim-review0.100.00101005000000:

08

Ebm-host-review1.000.31841005000000:

27

Ebm-port-review0.100.00101005000000:

00

Protocol-aging-revie0.200.00201005000000:

00

Acl-Flattener1.000.001051005000000:

00

KxAclPathMancreate/1.000.001051005000000:

14

KxAclPathManupdate2.000.0010141005000000:

00

KxAclPathManreprogr1.000.00211005000000:

00

TagMan-RecreateMtegR1.000.001051005000000:

00

K2CpuManReview30.0069.843026100500112106781248:

14

K2AccelPacketMan:

Tx10.002.74200100500121210254:

45

K2AccelPacketMan:

Au0.100.00001005000000:

00

K2AclMan-taggedFlatA1.000.001051005000000:

00

K2AclCamManstaleen1.000.001051005000000:

00

K2AclCamManhwstats3.000.501051005000007:

24

K2AclCamMankxstats1.000.011051005000003:

03

K2AclCamManAuditre1.007.761051005005004:

07

K2AclPolicerTableMan1.000.001011005000000:

17

K2L2AddressTableR2.003.251251005000007:

25

K2L2NewStaticAddr2.000.001051005000000:

00

K2L2NewMulticastA2.000.001051005000000:

00

K2L2DynamicAddress2.000.001051005000000:

00

K2L2VlanTableRevi2.000.001281005000000:

02

K2L2DestinationCa2.000.001001005000000:

00

K2PortManReview2.001.53151110050021126:

42

Gigaport*****Review0.400.04411005000001:

15

Gigaport*****Review0.400.07411005000001:

15

Gigaport*****Review0.400.06411005000001:

15

Gigaport*****Review0.400.05411005000001:

17

Gigaport*****Review0.400.05411005000001:

17

Gigaport*****Review0.400.06411005000001:

16

Gigaport*****Review0.400.05411005000001:

17

Gigaport*****Review0.400.05411005000001:

17

Gigaport*****Review0.400.12401005000005:

23

Gigaport*****Review0.400.09401005000005:

20

Gigaport*****Review0.400.08401005000005:

17

Gigaport*****Review0.400.09401005000005:

19

Gigaport*****Review0.400.04411005000001:

18

Gigaport*****Review0.400.08411005000001:

17

Gigaport*****Review0.400.06411005000001:

16

Gigaport*****Review0.400.06411005000001:

16

Gigaport*****Review0.400.05411005000001:

24

Gigaport*****Review0.400.05411005000001:

22

Gigaport*****Review0.400.07451005000001:

22

Gigaport*****Review0.400.07411005000001:

22

Gigaport*****Review0.400.074111005000001:

22

Gigaport*****Review0.400.06411005000001:

23

Gigaport*****Review0.400.05491005000001:

22

Gigaport*****Review0.400.05411005000001:

21

Gigaport*****Review0.400.08401005000005:

19

Gigaport*****Review0.400.11401005000005:

22

Gigaport*****Review0.400.08401005000005:

19

Gigaport*****Review0.400.10401005000005:

19

Gigaport*****Review0.400.08401005000005:

18

Gigaport*****Review0.400.09401005000005:

18

Gigaport*****Review0.400.11401005000005:

20

Gigaport*****Review0.400.09401005000005:

19

K2Fibcamusagerevi2.000.001501005000000:

00

K2FibIrmFibReview2.