One of our core Cisco 7206VXR router rebooted by itself a few days ago and according to show version output, there was a watchdog timer expired. I did some troubleshooting to dig more info and also raised a TAC case based on the show stacks output. The Cisco TAC engineer advised me to upgrade the IOS to c7200-spservicesk9-mz.124-24.T8.bin
CORE01#show version
Cisco IOS Software, 7200 Software (C7200-SPSERVICESK9-M), Version 12.4(24)T1, RELEASE SOFTWARE (fc3) Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2009 by Cisco Systems, Inc.
Compiled Fri 19-Jun-09 20:27 by prod_rel_team
ROM: System Bootstrap, Version 12.3(4r)T3, RELEASE SOFTWARE (fc1)
CORE01 uptime is 3 days, 20 hours, 14 minutes
System returned to ROM by watchdog timer expired
System restarted at 12:16:05 UTC Mon Aug 17 2015
System image file is "disk2:c7200-spservicesk9-mz.124-24.T1.bin"
CORE01#show stacks ?
<1-8192> Process to show stack detail on
| Output modifiers
<cr>
CORE01#show stacks
Minimum process stacks:
Free/Size Name
8328/9000 EEM ED RF
59164/60000 script background loader
58916/60000 EEM Auto Registration Proc
5396/6000 SASL MAIN
2400/3000 allegro libretto init
10936/12000 Router Init
4212/6000 Update prst
3348/12000 Init
4244/6000 DIB error message
5192/6000 RADIUS INITCONFIG
5236/6000 BGP Accepter
3396/6000 BGP Open
2280/3000 Rom Random Update Process
2764/6000 BFD PP Process
11172/12000 BFD
8632/12000 BFD events
33860/36000 TCP Command
6640/12000 Virtual Exec
3484/6000 TFTP Read Process
Interrupt level stacks:
Level Called Unused/Size Name
1 345573575 4724/9000 Network interfaces
2 0 9000/9000 DMA/Timer Interrupt
3 146504 7884/9000 PA Management Int Handler
4 65 8596/9000 Console Uart
5 0 9000/9000 OIR/Error Interrupt
7 83084011 8372/9000 NMI Interrupt Handler
Spurious interrupts: 388
System was restarted by watchdog timer expired
-----------------------------------------------------------------
Possible software fault. Hardware replacement may not
correct problem. Upon recurrence, please collect
crashinfo, "show tech" and contact Cisco Technical Support.
-----------------------------------------------------------------
The TFTP process on a Cisco 7206VXR router is slightly different compared to other router platforms and the command to use is copy tftp disk2. I deleted the current IOS since the router flash isn't large enough and also pointed to the new IOS image. Hopefully, there's no auto reboot again on this router and eventually use the new and stable copy of the IOS. After the TFTP process, I need to rename the IOS file name using the rename command in privileged mode.
CORE01#ping 172.27.25.164 // PING TO TFTP SERVER/PC
Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 172.27.25.164, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 52/55/56 ms
CORE01#copy tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin disk2
Destination filename [disk2]? // FOR SOME REASON THE FILE NAME WAS CHANGED TO disk2
Accessing tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin...
Loading c7200-spservicesk9-mz.124-24.T8.bin from 172.27.25.164 (via GigabitEthernet0/2): !
%Error copying tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin (Not enough space on device)
CORE01#delete disk2:c7200-spservicesk9-mz.124-24.T1.bin
Delete filename [c7200-spservicesk9-mz.124-24.T1.bin]?
Delete disk2:/c7200-spservicesk9-mz.124-24.T1.bin? [confirm]
CORE01#copy tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin disk2
Destination filename [disk2]?
Accessing tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin...
Loading c7200-spservicesk9-mz.124-24.T8.bin from 172.27.25.164 (via GigabitEthernet0/2): !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[OK - 36906144 bytes]
36906144 bytes copied in 4284.884 secs (8613 bytes/sec)
CORE01#show disk2
-#- --length-- -----date/time------ path
2 36906144 Aug 19 2015 02:49:30 disk2 // T8 IOS
3 83 Jun 26 2012 04:01:08 staging-running-config
CORE01#rename disk2: ?
WORD Destination file path
CORE01#rename disk2:disk2 c7200-spservicesk9-mz.124-24.T8.bin
CORE01(conf)#no boot system disk2:c7200-spservicesk9-mz.124-24.T1.bin
CORE01(conf)#boot system disk2:c7200-spservicesk9-mz.124-24.T8.bin
CORE01#show version
Cisco IOS Software, 7200 Software (C7200-SPSERVICESK9-M), Version 12.4(24)T1, RELEASE SOFTWARE (fc3) Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2009 by Cisco Systems, Inc.
Compiled Fri 19-Jun-09 20:27 by prod_rel_team
ROM: System Bootstrap, Version 12.3(4r)T3, RELEASE SOFTWARE (fc1)
CORE01 uptime is 3 days, 20 hours, 14 minutes
System returned to ROM by watchdog timer expired
System restarted at 12:16:05 UTC Mon Aug 17 2015
System image file is "disk2:c7200-spservicesk9-mz.124-24.T1.bin"
CORE01#show stacks ?
<1-8192> Process to show stack detail on
| Output modifiers
<cr>
CORE01#show stacks
Minimum process stacks:
Free/Size Name
8328/9000 EEM ED RF
59164/60000 script background loader
58916/60000 EEM Auto Registration Proc
5396/6000 SASL MAIN
2400/3000 allegro libretto init
10936/12000 Router Init
4212/6000 Update prst
3348/12000 Init
4244/6000 DIB error message
5192/6000 RADIUS INITCONFIG
5236/6000 BGP Accepter
3396/6000 BGP Open
2280/3000 Rom Random Update Process
2764/6000 BFD PP Process
11172/12000 BFD
8632/12000 BFD events
33860/36000 TCP Command
6640/12000 Virtual Exec
3484/6000 TFTP Read Process
Interrupt level stacks:
Level Called Unused/Size Name
1 345573575 4724/9000 Network interfaces
2 0 9000/9000 DMA/Timer Interrupt
3 146504 7884/9000 PA Management Int Handler
4 65 8596/9000 Console Uart
5 0 9000/9000 OIR/Error Interrupt
7 83084011 8372/9000 NMI Interrupt Handler
Spurious interrupts: 388
System was restarted by watchdog timer expired
-----------------------------------------------------------------
Possible software fault. Hardware replacement may not
correct problem. Upon recurrence, please collect
crashinfo, "show tech" and contact Cisco Technical Support.
-----------------------------------------------------------------
The TFTP process on a Cisco 7206VXR router is slightly different compared to other router platforms and the command to use is copy tftp disk2. I deleted the current IOS since the router flash isn't large enough and also pointed to the new IOS image. Hopefully, there's no auto reboot again on this router and eventually use the new and stable copy of the IOS. After the TFTP process, I need to rename the IOS file name using the rename command in privileged mode.
CORE01#ping 172.27.25.164 // PING TO TFTP SERVER/PC
Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 172.27.25.164, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 52/55/56 ms
CORE01#copy tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin disk2
Destination filename [disk2]? // FOR SOME REASON THE FILE NAME WAS CHANGED TO disk2
Accessing tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin...
Loading c7200-spservicesk9-mz.124-24.T8.bin from 172.27.25.164 (via GigabitEthernet0/2): !
%Error copying tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin (Not enough space on device)
CORE01#delete disk2:c7200-spservicesk9-mz.124-24.T1.bin
Delete filename [c7200-spservicesk9-mz.124-24.T1.bin]?
Delete disk2:/c7200-spservicesk9-mz.124-24.T1.bin? [confirm]
CORE01#copy tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin disk2
Destination filename [disk2]?
Accessing tftp://172.27.25.164/c7200-spservicesk9-mz.124-24.T8.bin...
Loading c7200-spservicesk9-mz.124-24.T8.bin from 172.27.25.164 (via GigabitEthernet0/2): !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[OK - 36906144 bytes]
36906144 bytes copied in 4284.884 secs (8613 bytes/sec)
CORE01#show disk2
-#- --length-- -----date/time------ path
2 36906144 Aug 19 2015 02:49:30 disk2 // T8 IOS
3 83 Jun 26 2012 04:01:08 staging-running-config
CORE01#rename disk2: ?
WORD Destination file path
CORE01#rename disk2:disk2 c7200-spservicesk9-mz.124-24.T8.bin
CORE01(conf)#no boot system disk2:c7200-spservicesk9-mz.124-24.T1.bin
CORE01(conf)#boot system disk2:c7200-spservicesk9-mz.124-24.T8.bin