Tuesday, May 3, 2022

Cisco Nexus 5000 Switch NX-OS and Kickstart Code Upgrade

I upgraded a Cisco Nexus 3000 switch in a previous post. This time, I needed to upgrade a Cisco Nexus 5000 switch to NX-OS 7.3(8)N1(1).

I verified the current NX-OS software of the Nexus 5K switch to be 7.3(1)N1(1) using the show version command.

N5K# show version

Cisco Nexus Operating System (NX-OS) Software

TAC support: http://www.cisco.com/tac

Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_serie

s_home.html

Copyright (c) 2002-2016, Cisco Systems, Inc. All rights reserved.

The copyrights to certain works contained herein are owned by

other third parties and are used and distributed under license.

Some parts of this software are covered under the GNU Public

License. A copy of the license is available at

http://www.gnu.org/licenses/gpl.html.

 

Software

  BIOS:      version 2.1.7

  Power Sequencer Firmware:

             Module 1: v4.0

             Module 1: v4.0

  Fabric Power Sequencer Firmware: Module 1: version v4.0

  Microcontroller Firmware:        version v0.0.0.15

  QSFP Microcontroller Firmware:  

             Module 1: v2.0.0.0

  CXP Microcontroller Firmware:  

             Module not detected

  kickstart: version 7.3(1)N1(1)

  system:    version 7.3(1)N1(1)

  BIOS compile time:       06/16/2016

  kickstart image file is: bootflash:///n6000-uk9-kickstart.7.3.1.N1.1.bin

  kickstart compile time:  10/5/2016 19:00:00 [10/06/2016 05:19:57]

  system image file is:    bootflash:///n6000-uk9.7.3.1.N1.1.bin

  system compile time:     10/5/2016 19:00:00 [10/06/2016 05:21:39]

 

 

Hardware

  cisco Nexus 5672UP Chassis ("Nexus 5672UP Supervisor")

  Intel(R) Xeon(R) CPU  @ 1.80 with 8243284 kB of memory.

  Processor Board ID FOC21091234

 

  Device name: N5K

  bootflash:    7692288 kB

 

Kernel uptime is 1 day(s), 15 hour(s), 25 minute(s), 23 second(s)

 

Last reset at 736681 usecs after  Thu Apr  7 05:04:50 2005

 

  Reason: Reset Requested by CLI command reload

  System version: 7.3(1)N1(1)

  Service:

 

plugin

  Core Plugin, Ethernet Plugin


There's an upgrade path to follow per the Cisco Nexus 7.3(8)N1(1) Release Notes: 7.3(1) > 7.3(2) > 7.3(8). The said code release also list down the supported hardware such as the Nexus switch platforms, line card modules and Fabric Extenders (FEX).

So I upgraded first to 7.3(2)N1(1) and downloaded the main NX-OS and Kickstart image (BIOS).


I deleted some old image files to give space in bootflash using the delete command. It's best practice to keep the previous image in case you need to roll back or downgrade.

N5K# dir bootflash:

       4096    Jan 01 00:02:07 2001  .patch/

         24    Feb 16 13:02:35 2001  20010216_130235_poap_4722_dhcp.pcap

     984128    Feb 16 14:14:59 2001  20010216_130235_poap_4722_init.log

         24    Apr 07 05:12:28 2005  20050407_051228_poap_5299_dhcp.pcap

     734565    Apr 07 05:32:44 2005  20050407_051228_poap_5299_init.log

   35792384    Feb 17 11:25:28 2001  bootflah:

       2518    Feb 16 14:37:40 2001  config

        630    Jan 01 00:08:06 2001  license_FOC21081234_26_1.lic

       4096    Dec 01 06:55:44 2001  lost+found/

   37969408    Mar 25 06:53:39 2017  n6000-uk9-kickstart.7.1.0.N1.1b.bin

   35792384    Feb 17 11:29:49 2001  n6000-uk9-kickstart.7.3.1.N1.1.bin

  310229868    Mar 25 06:54:05 2017  n6000-uk9.7.1.0.N1.1b.bin

  324046051    Feb 17 11:29:26 2001  n6000-uk9.7.3.1.N1.1.bin

  324046051    Feb 17 11:29:26 2001  n6000-uk9.7.3.1.N1.1.bin

       4096    Feb 17 11:39:26 2001  scripts/

       4096    Jan 01 00:02:06 2001  vdc_2/

       4096    Jan 01 00:02:06 2001  vdc_3/

       4096    Jan 01 00:02:06 2001  vdc_4/

       4096    Feb 17 11:35:19 2001  virtual-instance/

       4096    Jan 01 00:02:10 2001  virtual-instance-stby-sync/

      11352    Apr 07 04:57:37 2005  vlan.dat

    1654746    Apr 07 05:03:36 2005  vtp_debug.log

 

N5K# delete n6000-uk9-kickstart.7.1.0.N1.1b.bin

Do you want to delete "/n6000-uk9-kickstart.7.1.0.N1.1b.bin" ? (yes/no/abort)   [y] y


N5K# delete n6000-uk9.7.1.0.N1.1b.bin

Do you want to delete "/n6000-uk9.7.1.0.N1.1b.bin" ? (yes/no/abort)   [y] y

N5K# dir

       4096    Jan 01 00:02:07 2001  .patch/

         24    Feb 16 13:02:35 2001  20010216_130235_poap_4722_dhcp.pcap

     984128    Feb 16 14:14:59 2001  20010216_130235_poap_4722_init.log

         24    Apr 07 05:12:28 2005  20050407_051228_poap_5299_dhcp.pcap

     734565    Apr 07 05:32:44 2005  20050407_051228_poap_5299_init.log

   35792384    Feb 17 11:25:28 2001  bootflah:

       2518    Feb 16 14:37:40 2001  config

        630    Jan 01 00:08:06 2001  license_FOC21081234_26_1.lic

       4096    Dec 01 06:55:44 2001  lost+found/

   35792384    Feb 17 11:29:49 2001  n6000-uk9-kickstart.7.3.1.N1.1.bin

  324046051    Feb 17 11:29:26 2001  n6000-uk9.7.3.1.N1.1.bin

       4096    Feb 17 11:39:26 2001  scripts/

       4096    Jan 01 00:02:06 2001  vdc_2/

       4096    Jan 01 00:02:06 2001  vdc_3/

       4096    Jan 01 00:02:06 2001  vdc_4/

       4096    Feb 17 11:35:19 2001  virtual-instance/

       4096    Jan 01 00:02:10 2001  virtual-instance-stby-sync/

      11352    Apr 07 04:57:37 2005  vlan.dat

    1654746    Apr 07 05:03:36 2005  vtp_debug.log

 
Use the copy command to transfer image files with the vrf keyword if using a source VRF.

N5K# copy ftp://ftpuser:ftp123@10.1.1.14/n6000-uk9-kickstart.7.3.2.N1.1.bin bootflash:

Enter vrf (If no input, current vrf 'default' is considered):

N5K# copy ftp://ftpuser:ftp123@10.1.1.14/n6000-uk9-kickstart.7.3.2.N1.1.bin bootflash: vrf ?

  default     Known VRF name

  management  Known VRF name

N5K# copy ftp://ftpuser:ftp123@10.1.1.14/n6000-uk9-kickstart.7.3.2.N1.1.bin bootflash: vrf management

Password:    // ftp123

[####                     ]         4.37MB

 

***** Transfer of file Completed Successfully *****   

Copy complete, now saving to disk (please wait)...

 

 

N5K# copy ftp://ftpuser:ftp123@10.1.1.14/n6000-uk9.7.3.2.N1.1.bin bootflash: vrf management

Password:

[#########                ]        10.49MB

 

***** Transfer of file Completed Successfully *****   

Copy complete, now saving to disk (please wait)...

 

N5K# dir

       4096    Jan 01 00:02:07 2001  .patch/

         24    Feb 16 13:02:35 2001  20010216_130235_poap_4722_dhcp.pcap

     984128    Feb 16 14:14:59 2001  20010216_130235_poap_4722_init.log

         24    Apr 07 05:12:28 2005  20050407_051228_poap_5299_dhcp.pcap

     734565    Apr 07 05:32:44 2005  20050407_051228_poap_5299_init.log

   35792384    Feb 17 11:25:28 2001  bootflah:

       2518    Feb 16 14:37:40 2001  config

        630    Jan 01 00:08:06 2001  license_FOC2108R181_26_1.lic

   35792384    Feb 17 11:29:49 2001  n6000-uk9-kickstart.7.3.1.N1.1.bin

   35289088    Apr 08 23:42:56 2005  n6000-uk9-kickstart.7.3.2.N1.1.bin

  324046051    Feb 17 11:29:26 2001  n6000-uk9.7.3.1.N1.1.bin

  343742244    Apr 08 23:47:43 2005  n6000-uk9.7.3.2.N1.1.bin

       4096    Feb 17 11:39:26 2001  scripts/

       4096    Jan 01 00:02:06 2001  vdc_2/

       4096    Jan 01 00:02:06 2001  vdc_3/

       4096    Jan 01 00:02:06 2001  vdc_4/

       4096    Feb 17 11:35:19 2001  virtual-instance/

       4096    Jan 01 00:02:10 2001  virtual-instance-stby-sync/

      11352    Apr 07 04:57:37 2005  vlan.dat

    1654746    Apr 07 05:03:36 2005  vtp_debug.log

 

Usage for bootflash://

 1220804608 bytes used

 6136344576 bytes free

 7357149184 bytes total

 

Verify the MD5 or SHA512 checksum using the show file command for any corruption during the file transfer. Just compare to the MD5 output on the Cisco download site.

N5K# show file bootflash:///n6000-uk9-kickstart.7.3.2.N1.1.bin md5sum

af50c5a3435dd971da57aa44b967598a

 

N5K# show file bootflash:///n6000-uk9.7.3.2.N1.1.bin md5sum

ef5943379bbef4be2800cb60b13f922b

 

It's also good practice to verify the new images using the show install command before the actual install or code upgrade.

N5K# show install all impact kickstart bootflash:///n6000-uk9-kickstart.7.3.2.N1.1.bin system bootflash:///n6000-uk9.7.3.2.N1.1.bin

 

Verifying image bootflash:/n6000-uk9-kickstart.7.3.2.N1.1.bin for boot variable "kickstart".

[####################] 100% -- SUCCESS

 

Verifying image bootflash:/n6000-uk9.7.3.2.N1.1.bin for boot variable "system".   // THIS WILL TAKE AROUND 5 MINUTES

[####################] 100% -- SUCCESS

 

Verifying image type.

[####################] 100% -- SUCCESS

 

Extracting "system" version from image bootflash:/n6000-uk9.7.3.2.N1.1.bin.

[####################] 100% -- SUCCESS

 

Extracting "kickstart" version from image bootflash:/n6000-uk9-kickstart.7.3.2.N1.1.bin.

[####################] 100% -- SUCCESS

 

Extracting "system" version from image bootflash:/n6000-uk9.7.3.2.N1.1.bin.

[####################] 100% -- SUCCESS

 

Extracting "kickstart" version from image bootflash:/n6000-uk9-kickstart.7.3.2.N1.1.bin.

[####################] 100% -- SUCCESS

 

Extracting "bios" version from image bootflash:/n6000-uk9.7.3.2.N1.1.bin.

[####################] 100% -- SUCCESS

 

Performing module support checks.

[####################] 100% -- SUCCESS

 

Notifying services about system upgrade.

[####################] 100% -- SUCCESS

 

 

Compatibility check is done:

Module  bootable          Impact  Install-type  Reason

------  --------  --------------  ------------  ------

     1       yes      disruptive         reset  Non-disruptive install not supported if L3 was enabled

     2       yes      disruptive         reset  Non-disruptive install not supported if L3 was enabled

 

 

Images will be upgraded according to following table:

Module             Image         Running-Version             New-Version  Upg-Required

------  ----------------  ----------------------  ----------------------  ------------

     1            system             7.3(1)N1(1)             7.3(2)N1(1)           yes

     1         kickstart             7.3(1)N1(1)             7.3(2)N1(1)           yes

     1              bios      v2.1.7(06/16/2016)      v2.1.7(06/16/2016)            no

     1         power-seq                    v4.0                    v4.0            no

     1  fabric-power-seq                    v4.0                    v4.0            no

     2         power-seq                    v4.0                    v4.0            no

     1   microcontroller               v0.0.0.15               v0.0.0.15            no

 

To perform the actual Nexus switch code upgrade, use the install command.

N5K# install all kickstart bootflash:///n6000-uk9-kickstart.7.3.2.N1.1.bin system bootflash:///n6000-uk9.7.3.2.N1.1.bin

 

Verifying image bootflash:/n6000-uk9-kickstart.7.3.2.N1.1.bin for boot variable "kickstart".

[####################] 100% -- SUCCESS

 

Verifying image bootflash:/n6000-uk9.7.3.2.N1.1.bin for boot variable "system".

[####################] 100% -- SUCCESS

 

Verifying image type.

[####################] 100% -- SUCCESS

 

Extracting "system" version from image bootflash:/n6000-uk9.7.3.2.N1.1.bin.

[####################] 100% -- SUCCESS

 

Extracting "kickstart" version from image bootflash:/n6000-uk9-kickstart.7.3.2.N1.1.bin.

[####################] 100% -- SUCCESS

 

Extracting "bios" version from image bootflash:/n6000-uk9.7.3.2.N1.1.bin.

[####################] 100% -- SUCCESS

 

Performing module support checks.

[####################] 100% -- SUCCESS

 

Notifying services about system upgrade.

[####################] 100% -- SUCCESS

 

 

Compatibility check is done:

Module  bootable          Impact  Install-type  Reason

------  --------  --------------  ------------  ------

     1       yes      disruptive         reset  Non-disruptive install not supported if L3 was enabled

     2       yes      disruptive         reset  Non-disruptive install not supported if L3 was enabled

 

 

Images will be upgraded according to following table:

Module             Image         Running-Version             New-Version  Upg-Required

------  ----------------  ----------------------  ----------------------  ------------

     1            system             7.3(1)N1(1)             7.3(2)N1(1)           yes

     1         kickstart             7.3(1)N1(1)             7.3(2)N1(1)           yes

     1              bios      v2.1.7(06/16/2016)      v2.1.7(06/16/2016)            no

     1         power-seq                    v4.0                    v4.0            no

     1  fabric-power-seq                    v4.0                    v4.0            no

     2         power-seq                    v4.0                    v4.0            no

     1   microcontroller               v0.0.0.15               v0.0.0.15            no

 

 

Switch will be reloaded for disruptive upgrade.

 

Do you want to continue with the installation (y/n)?  y

 

Install is in progress, please wait.

 

Performing runtime checks.

[####################] 100% -- SUCCESS

 

Setting boot variables.

[####################] 100% -- SUCCESS

 

Performing configuration copy.

[####################] 100% -- SUCCESS

 

Finishing the upgrade, switch will reboot in 10 seconds.

 

 

N5K# [156233.485298] Shutdown Ports..

[156233.520690]  writing reset reason 49,

2005 Apr  9 00:29:48 N5K %$ VDC-1 %$ %KERN-0-SYSTEM_MSG: [156233.485298] Shutdown Ports.. - kernel

2005 Apr  9 00:29:48 N5K %$ VDC-1 %$ %KERN-0-SYSTEM_MSG: [156233.520690]  writing reset reason 49,  - kernel

 

Broadcast message from root (Sat Apr  9 00:29:53 2005):

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "icmpv6" (PID 4321) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "statsclient" (PID 4273) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "fs-daemon" (PID 4149) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "vman" (PID 4208) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Radius Daemon" (PID 4460) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Security Daemon" (PID 4249) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "res_mgr" (PID 4217) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "urib" (PID 4258) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Cert_enroll Daemon" (PID 4251) is forced exit.

Apr  9 00:29:53 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "bios_daemon" (PID 4242) is forced exit.

 

INIT: Sending processes the KILL signal

Sending all processes the TERM signal...

Apr  9 00:30:00 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "icmpv6" (PID 4321) is forced exit.

Apr  9 00:30:00 %ICMPV6-3-MTS_RECV  icmpv6 [4321]  Error returned from mts_recv(), errno: Interrupted system call

Apr  9 00:30:00 %ADJMGR-2-MTS_RECV  adjmgr [4283]  MTS queue receive failed on AM LOW PRI queue: Interrupted system call

Sending all processes the KILL signal...

Unmounting filesystems...

[156252.392985] Resetting board

 

 

(c) Copyright 2016, Cisco Systems.

N5K-C5672UP BIOS v.2.1.7, Fri 06/17/2016, 02:54 PM

 

(c) Copyright 2016, Cisco Systems.

N5K-C5672UP BIOS v.2.1.7, Thu 06/16/2016

 

Booting kickstart image: bootflash:/n6000-uk9-kickstart.7.3.2.N1.1.bin

 

...............................................................................

.............................Image verification OK

 

Booting kernel

 

 

<OUTPUT TRUNCATED>

 

 

The Nexus code upgrade took around 7 mintues to complete. Perform similar steps to upgrade to 7.3(8)N1(1).


System is coming up ... Please wait ...

2005 Apr  9 00:36:51 N5K %$ VDC-1 %$ %VDC_MGR-2-VDC_ONLINE: vdc 1 has come online

System is coming up ... Please wait ...

 

 

User Access Verification

N5K login: admin

Password:

 

 

Cisco Nexus Operating System (NX-OS) Software

TAC support: http://www.cisco.com/tac

Copyright (c) 2002-2017, Cisco Systems, Inc. All rights reserved.

The copyrights to certain works contained in this software are

owned by other third parties and used and distributed under

license. Certain components of this software are licensed under

the GNU General Public License (GPL) version 2.0 or the GNU

Lesser General Public License (LGPL) Version 2.1. A copy of each

such license is available at

http://www.opensource.org/licenses/gpl-2.0.php and

http://www.opensource.org/licenses/lgpl-2.1.php

 

 

N5K# show version

Cisco Nexus Operating System (NX-OS) Software

TAC support: http://www.cisco.com/tac

Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_serie

s_home.html

Copyright (c) 2002-2017, Cisco Systems, Inc. All rights reserved.

The copyrights to certain works contained herein are owned by

other third parties and are used and distributed under license.

Some parts of this software are covered under the GNU Public

License. A copy of the license is available at

http://www.gnu.org/licenses/gpl.html.

 

Software

  BIOS:      version 2.1.7

  Power Sequencer Firmware:

             Module 1: v4.0

  Fabric Power Sequencer Firmware: Module 1: version v4.0

  Microcontroller Firmware:        version v0.0.0.15

  QSFP Microcontroller Firmware:  

             Module not detected

  SFP Microcontroller Firmware:  

             Module 1: v1.3.0.0

  CXP Microcontroller Firmware:  

             Module not detected

  kickstart: version 7.3(2)N1(1)

  system:    version 7.3(2)N1(1)

  BIOS compile time:       06/16/2016

  kickstart image file is: bootflash:///n6000-uk9-kickstart.7.3.2.N1.1.bin

  kickstart compile time:  5/12/2017 23:00:00 [05/13/2017 11:15:12]

  system image file is:    bootflash:///n6000-uk9.7.3.2.N1.1.bin

  system compile time:     5/12/2017 23:00:00 [05/13/2017 11:16:49]

 

 

Hardware

  cisco Nexus 5672UP Chassis ("Nexus 5672UP Supervisor")

  Intel(R) Xeon(R) CPU  @ 1.80 with 8243276 kB of memory.

  Processor Board ID FOC21091234

 

  Device name: N5K

  bootflash:    7692288 kB

 

Kernel uptime is 0 day(s), 0 hour(s), 6 minute(s), 49 second(s)

 

Last reset at 567632 usecs after  Sat Apr  9 00:29:53 2005

 

  Reason: Disruptive upgrade

  System version: 7.3(1)N1(1)

  Service:

 

plugin

  Core Plugin, Ethernet Plugin

 

Active Package(s)