升级 Mellanox ConnectX-3 EN 10/40 Gbps 网卡固件
确认 ib_uverbs mlx4_en mlx4_core mlx4_ib
mst_pciconf 已加载, mstflint 已编译安装.
1> 确认mlx固件版本
查询 mlx 设备信息
# lspci |grep Mell
02:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]
查询 mlx 设备信息, 其中 Device ID 与 PSID 很重要, 必须根据这2个信息下载响应的固件.
# mstflint -d 02:00.0 q
或
# mstflint -d /proc/bus/pci/02/00.0 q
Image type: FS2
FW Version: 2.10.700
Device ID: 4099
Description: Node Port1 Port2 Sys image
GUIDs: 0002c90300faa480 0002c90300faa481 0002c90300faa482 0002c90300faa483
MACs: 0002c9faa481 0002c9faa482
VSD:
PSID: MT_1090110019
ConnectX-3 Pro 与 ConnectX-3 Device ID 区别:
ConnectX-3 Pro : 4103
ConnectX-3 : 4099
固件下载地址
http://www.mellanox.com/page/firmware_download
当前设备 ConnectX-3 为 PSID: MT_1090110019 （ConnectX®-3 VPI Adapter Cards (InfiniBand, Ethernet,VPI)）
http://www.mellanox.com/page/firmware_table_ConnectX3IB
验证固件信息
# mstflint -d 02:00.0 v
FS2 failsafe image. Start address: 0x80000. Chunk size 0x80000:
NOTE: The addresses below are contiguous logical addresses. Physical addresses on
flash may be different, based on the image start address and chunk size
/0x00000038-0x00000bdf (0x000ba8)/ (BOOT2) - OK
/0x00000be0-0x00005053 (0x004474)/ (BOOT2) - OK
/0x00005054-0x00005f2b (0x000ed8)/ (Configuration) - OK
/0x00005f2c-0x00005f6f (0x000044)/ (GUID) - OK
/0x00005f70-0x000060ab (0x00013c)/ (Image Info) - OK
/0x000060ac-0x0000cfef (0x006f44)/ (DDR) - OK
/0x0000cff0-0x0000e8eb (0x0018fc)/ (DDR) - OK
/0x0000e8ec-0x0001db83 (0x00f298)/ (DDR) - OK
/0x0001db84-0x00026c77 (0x0090f4)/ (DDR) - OK
/0x00026c78-0x000869ab (0x05fd34)/ (DDR) - OK
/0x000869ac-0x0008a5fb (0x003c50)/ (DDR) - OK
/0x0008a5fc-0x000b129b (0x026ca0)/ (DDR) - OK
/0x000b129c-0x000b4c33 (0x003998)/ (DDR) - OK
/0x000b4c34-0x000b896b (0x003d38)/ (DDR) - OK
/0x000b896c-0x000b993f (0x000fd4)/ (Configuration) - OK
/0x000b9940-0x000b999b (0x00005c)/ (Jump addresses) - OK
/0x000b999c-0x000b9fdb (0x000640)/ (FW Configuration) - OK
/0x00000000-0x000b9fdb (0x0b9fdc)/ (Full Image) - OK
-I- FW image verification succeeded. Image is bootable.
保存当前固件 及其他信息
# mstflint -d 02:00.0 ri mlx4.img
# mstflint -d 02:00.0 dc mlx4.config
# mstflint -d 02:00.0 hw query > mlx4.hw
验证当前固件
# mstflint -i mlx4.img v
FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:
NOTE: The addresses below are contiguous logical addresses. Physical addresses on
flash may be different, based on the image start address and chunk size
/0x00000038-0x00000bdf (0x000ba8)/ (BOOT2) - OK
/0x00000be0-0x00005053 (0x004474)/ (BOOT2) - OK
/0x00005054-0x00005f2b (0x000ed8)/ (Configuration) - OK
/0x00005f2c-0x00005f6f (0x000044)/ (GUID) - OK
/0x00005f70-0x000060ab (0x00013c)/ (Image Info) - OK
/0x000060ac-0x0000cfef (0x006f44)/ (DDR) - OK
/0x0000cff0-0x0000e8eb (0x0018fc)/ (DDR) - OK
/0x0000e8ec-0x0001db83 (0x00f298)/ (DDR) - OK
/0x0001db84-0x00026c77 (0x0090f4)/ (DDR) - OK
/0x00026c78-0x000869ab (0x05fd34)/ (DDR) - OK
/0x000869ac-0x0008a5fb (0x003c50)/ (DDR) - OK
/0x0008a5fc-0x000b129b (0x026ca0)/ (DDR) - OK
/0x000b129c-0x000b4c33 (0x003998)/ (DDR) - OK
/0x000b4c34-0x000b896b (0x003d38)/ (DDR) - OK
/0x000b896c-0x000b993f (0x000fd4)/ (Configuration) - OK
/0x000b9940-0x000b999b (0x00005c)/ (Jump addresses) - OK
/0x000b999c-0x000b9fdb (0x000640)/ (FW Configuration) - OK
/0x00000000-0x000b9fdb (0x0b9fdc)/ (Full Image) - OK
-I- FW image verification succeeded. Image is bootable.
下载固件后解压并验证固件
当前下载版本为为fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin.zip
# unzip /hgfs/HarddiskVolume3/Tmp/fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin.zip
验证固件
# mstflint -i fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin v
FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:
NOTE: The addresses below are contiguous logical addresses. Physical addresses on
flash may be different, based on the image start address and chunk size
/0x00000038-0x0000065b (0x000624)/ (BOOT2) - OK
/0x0000065c-0x00002a4f (0x0023f4)/ (BOOT2) - OK
/0x00002a50-0x00003927 (0x000ed8)/ (Configuration) - OK
/0x00003928-0x0001c53b (0x018c14)/ (ROM) - OK
/0x0001c53c-0x0001c57f (0x000044)/ (GUID) - OK
/0x0001c580-0x0001c6eb (0x00016c)/ (Image Info) - OK
/0x0001c6ec-0x00029c33 (0x00d548)/ (DDR) - OK
/0x00029c34-0x0002ac77 (0x001044)/ (DDR) - OK
/0x0002ac78-0x0002b047 (0x0003d0)/ (DDR) - OK
/0x0002b048-0x00064c47 (0x039c00)/ (DDR) - OK
/0x00064c48-0x0006a157 (0x005510)/ (DDR) - OK
/0x0006a158-0x0006e27b (0x004124)/ (DDR) - OK
/0x0006e27c-0x0007033b (0x0020c0)/ (DDR) - OK
/0x0007033c-0x000a929f (0x038f64)/ (DDR) - OK
/0x000a92a0-0x000ace23 (0x003b84)/ (DDR) - OK
/0x000ace24-0x000c1ef7 (0x0150d4)/ (DDR) - OK
/0x000c1ef8-0x000c1fff (0x000108)/ (DDR) - OK
/0x000c2000-0x000cc30b (0x00a30c)/ (DDR) - OK
/0x000cc30c-0x000cdae3 (0x0017d8)/ (Configuration) - OK
/0x000cdae4-0x000cdb57 (0x000074)/ (Jump addresses) - OK
/0x000cdb58-0x000ce3c7 (0x000870)/ (FW Configuration) - OK
/0x00000000-0x000ce3c7 (0x0ce3c8)/ (Full Image) - OK
-I- FW image verification succeeded. Image is bootable.
烧录固件,程序将自动验证版本跟PSID，PSID不匹配将提示错误.
# mstflint -d 02:00.0 -i fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin b
Current FW version on flash: 2.10.700
New FW version: 2.33.5100
Burning FS2 FW image without signatures - OK
Restoring signature - OK
查询当前版本
# mstflint -d 02:00.0 q
Image type: FS2
FW Version: 2.33.5100
FW Release Date: 25.1.2015
Product Version: 02.33.51.00
Rom Info: type=PXE version=3.4.460 devid=4099
Device ID: 4099
Description: Node Port1 Port2 Sys image
GUIDs: 0002c90300faa480 0002c90300faa481 0002c90300faa482 0002c90300faa483
MACs: 0002c9faa481 0002c9faa482
VSD:
PSID: MT_1090110019
可见已烧录成功当前版本为 2.33.5100.
查询 mlx 设备信息
# lspci |grep Mell
02:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]
查询 mlx 设备信息, 其中 Device ID 与 PSID 很重要, 必须根据这2个信息下载响应的固件.
# mstflint -d 02:00.0 q
或
# mstflint -d /proc/bus/pci/02/00.0 q
Image type: FS2
FW Version: 2.10.700
Device ID: 4099
Description: Node Port1 Port2 Sys image
GUIDs: 0002c90300faa480 0002c90300faa481 0002c90300faa482 0002c90300faa483
MACs: 0002c9faa481 0002c9faa482
VSD:
PSID: MT_1090110019
ConnectX-3 Pro 与 ConnectX-3 Device ID 区别:
ConnectX-3 Pro : 4103
ConnectX-3 : 4099
固件下载地址
http://www.mellanox.com/page/firmware_download
当前设备 ConnectX-3 为 PSID: MT_1090110019 （ConnectX®-3 VPI Adapter Cards (InfiniBand, Ethernet,VPI)）
http://www.mellanox.com/page/firmware_table_ConnectX3IB
验证固件信息
# mstflint -d 02:00.0 v
FS2 failsafe image. Start address: 0x80000. Chunk size 0x80000:
NOTE: The addresses below are contiguous logical addresses. Physical addresses on
flash may be different, based on the image start address and chunk size
/0x00000038-0x00000bdf (0x000ba8)/ (BOOT2) - OK
/0x00000be0-0x00005053 (0x004474)/ (BOOT2) - OK
/0x00005054-0x00005f2b (0x000ed8)/ (Configuration) - OK
/0x00005f2c-0x00005f6f (0x000044)/ (GUID) - OK
/0x00005f70-0x000060ab (0x00013c)/ (Image Info) - OK
/0x000060ac-0x0000cfef (0x006f44)/ (DDR) - OK
/0x0000cff0-0x0000e8eb (0x0018fc)/ (DDR) - OK
/0x0000e8ec-0x0001db83 (0x00f298)/ (DDR) - OK
/0x0001db84-0x00026c77 (0x0090f4)/ (DDR) - OK
/0x00026c78-0x000869ab (0x05fd34)/ (DDR) - OK
/0x000869ac-0x0008a5fb (0x003c50)/ (DDR) - OK
/0x0008a5fc-0x000b129b (0x026ca0)/ (DDR) - OK
/0x000b129c-0x000b4c33 (0x003998)/ (DDR) - OK
/0x000b4c34-0x000b896b (0x003d38)/ (DDR) - OK
/0x000b896c-0x000b993f (0x000fd4)/ (Configuration) - OK
/0x000b9940-0x000b999b (0x00005c)/ (Jump addresses) - OK
/0x000b999c-0x000b9fdb (0x000640)/ (FW Configuration) - OK
/0x00000000-0x000b9fdb (0x0b9fdc)/ (Full Image) - OK
-I- FW image verification succeeded. Image is bootable.
保存当前固件 及其他信息
# mstflint -d 02:00.0 ri mlx4.img
# mstflint -d 02:00.0 dc mlx4.config
# mstflint -d 02:00.0 hw query > mlx4.hw
验证当前固件
# mstflint -i mlx4.img v
FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:
NOTE: The addresses below are contiguous logical addresses. Physical addresses on
flash may be different, based on the image start address and chunk size
/0x00000038-0x00000bdf (0x000ba8)/ (BOOT2) - OK
/0x00000be0-0x00005053 (0x004474)/ (BOOT2) - OK
/0x00005054-0x00005f2b (0x000ed8)/ (Configuration) - OK
/0x00005f2c-0x00005f6f (0x000044)/ (GUID) - OK
/0x00005f70-0x000060ab (0x00013c)/ (Image Info) - OK
/0x000060ac-0x0000cfef (0x006f44)/ (DDR) - OK
/0x0000cff0-0x0000e8eb (0x0018fc)/ (DDR) - OK
/0x0000e8ec-0x0001db83 (0x00f298)/ (DDR) - OK
/0x0001db84-0x00026c77 (0x0090f4)/ (DDR) - OK
/0x00026c78-0x000869ab (0x05fd34)/ (DDR) - OK
/0x000869ac-0x0008a5fb (0x003c50)/ (DDR) - OK
/0x0008a5fc-0x000b129b (0x026ca0)/ (DDR) - OK
/0x000b129c-0x000b4c33 (0x003998)/ (DDR) - OK
/0x000b4c34-0x000b896b (0x003d38)/ (DDR) - OK
/0x000b896c-0x000b993f (0x000fd4)/ (Configuration) - OK
/0x000b9940-0x000b999b (0x00005c)/ (Jump addresses) - OK
/0x000b999c-0x000b9fdb (0x000640)/ (FW Configuration) - OK
/0x00000000-0x000b9fdb (0x0b9fdc)/ (Full Image) - OK
-I- FW image verification succeeded. Image is bootable.
下载固件后解压并验证固件
当前下载版本为为fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin.zip
# unzip /hgfs/HarddiskVolume3/Tmp/fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin.zip
验证固件
# mstflint -i fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin v
FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:
NOTE: The addresses below are contiguous logical addresses. Physical addresses on
flash may be different, based on the image start address and chunk size
/0x00000038-0x0000065b (0x000624)/ (BOOT2) - OK
/0x0000065c-0x00002a4f (0x0023f4)/ (BOOT2) - OK
/0x00002a50-0x00003927 (0x000ed8)/ (Configuration) - OK
/0x00003928-0x0001c53b (0x018c14)/ (ROM) - OK
/0x0001c53c-0x0001c57f (0x000044)/ (GUID) - OK
/0x0001c580-0x0001c6eb (0x00016c)/ (Image Info) - OK
/0x0001c6ec-0x00029c33 (0x00d548)/ (DDR) - OK
/0x00029c34-0x0002ac77 (0x001044)/ (DDR) - OK
/0x0002ac78-0x0002b047 (0x0003d0)/ (DDR) - OK
/0x0002b048-0x00064c47 (0x039c00)/ (DDR) - OK
/0x00064c48-0x0006a157 (0x005510)/ (DDR) - OK
/0x0006a158-0x0006e27b (0x004124)/ (DDR) - OK
/0x0006e27c-0x0007033b (0x0020c0)/ (DDR) - OK
/0x0007033c-0x000a929f (0x038f64)/ (DDR) - OK
/0x000a92a0-0x000ace23 (0x003b84)/ (DDR) - OK
/0x000ace24-0x000c1ef7 (0x0150d4)/ (DDR) - OK
/0x000c1ef8-0x000c1fff (0x000108)/ (DDR) - OK
/0x000c2000-0x000cc30b (0x00a30c)/ (DDR) - OK
/0x000cc30c-0x000cdae3 (0x0017d8)/ (Configuration) - OK
/0x000cdae4-0x000cdb57 (0x000074)/ (Jump addresses) - OK
/0x000cdb58-0x000ce3c7 (0x000870)/ (FW Configuration) - OK
/0x00000000-0x000ce3c7 (0x0ce3c8)/ (Full Image) - OK
-I- FW image verification succeeded. Image is bootable.
烧录固件,程序将自动验证版本跟PSID，PSID不匹配将提示错误.
# mstflint -d 02:00.0 -i fw-ConnectX3-rel-2_33_5100-MCX354A-FCB_A1-FlexBoot-3.4.460.bin b
Current FW version on flash: 2.10.700
New FW version: 2.33.5100
Burning FS2 FW image without signatures - OK
Restoring signature - OK
查询当前版本
# mstflint -d 02:00.0 q
Image type: FS2
FW Version: 2.33.5100
FW Release Date: 25.1.2015
Product Version: 02.33.51.00
Rom Info: type=PXE version=3.4.460 devid=4099
Device ID: 4099
Description: Node Port1 Port2 Sys image
GUIDs: 0002c90300faa480 0002c90300faa481 0002c90300faa482 0002c90300faa483
MACs: 0002c9faa481 0002c9faa482
VSD:
PSID: MT_1090110019
可见已烧录成功当前版本为 2.33.5100.
验证当前固件
# mstflint -d 02:00.0 v
FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:
NOTE: The addresses below are contiguous logical addresses. Physical addresses on
flash may be different, based on the image start address and chunk size
/0x00000038-0x0000065b (0x000624)/ (BOOT2) - OK
/0x0000065c-0x00002a4f (0x0023f4)/ (BOOT2) - OK
/0x00002a50-0x00003927 (0x000ed8)/ (Configuration) - OK
/0x00003928-0x0001c53b (0x018c14)/ (ROM) - OK
/0x0001c53c-0x0001c57f (0x000044)/ (GUID) - OK
/0x0001c580-0x0001c6eb (0x00016c)/ (Image Info) - OK
/0x0001c6ec-0x00029c33 (0x00d548)/ (DDR) - OK
/0x00029c34-0x0002ac77 (0x001044)/ (DDR) - OK
/0x0002ac78-0x0002b047 (0x0003d0)/ (DDR) - OK
/0x0002b048-0x00064c47 (0x039c00)/ (DDR) - OK
/0x00064c48-0x0006a157 (0x005510)/ (DDR) - OK
/0x0006a158-0x0006e27b (0x004124)/ (DDR) - OK
/0x0006e27c-0x0007033b (0x0020c0)/ (DDR) - OK
/0x0007033c-0x000a929f (0x038f64)/ (DDR) - OK
/0x000a92a0-0x000ace23 (0x003b84)/ (DDR) - OK
/0x000ace24-0x000c1ef7 (0x0150d4)/ (DDR) - OK
/0x000c1ef8-0x000c1fff (0x000108)/ (DDR) - OK
/0x000c2000-0x000cc30b (0x00a30c)/ (DDR) - OK
/0x000cc30c-0x000cdae3 (0x0017d8)/ (Configuration) - OK
/0x000cdae4-0x000cdb57 (0x000074)/ (Jump addresses) - OK
/0x000cdb58-0x000ce3c7 (0x000870)/ (FW Configuration) - OK
/0x00000000-0x000ce3c7 (0x0ce3c8)/ (Full Image) - OK
-I- FW image verification succeeded. Image is bootable.
烧录成功
# reboot
mstflint 参考
http://www.mellanox.com/pdf/firmware/mstflint_README.txt