v2.15: Sndk/wdc Plug in commands are not working with SN655 (NVMe OF)

[Sayoojntly]

Check the Sndk/wdc plug in commands with NVMe OF enclosure for SN655

################################################################################
[root@dhcp-host ~]# nvme sndk vs-fw-activate-history /dev/nvme7n8
ERROR: SNDK: sndk_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: SNDK: 0xC2 Log Page not supported, uuid_index: -1
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: SNDK: 0xC2 Log Page not supported, index: 0
ERROR: WDC: unsupported device for this command

################################################################################
[root@dhcp-host ~]# nvme sndk get-drive-status  /dev/nvme7n8
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: SNDK: 0xC2 Log Page not supported, index: 0
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: WDC: 0xC2 Log Page not supported, uuid_index: 0
################################################################################
 nvme list |grep /dev/nvme7
/dev/nvme7n1          /dev/ng7n1            243302900005         WUS5EC1B1ESP7Y4                          0x1          3.83  TB /   3.83  TB    512   B +  0 B   RC910002

nvme wdc capabilities /dev/nvme7n8
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: SNDK: 0xC2 Log Page not supported, index: 0
WDC Plugin Capabilities for NVME device:nvme7n8
cap-diag                      : Supported
drive-log                     : Not Supported
get-crash-dump                : Not Supported
get-pfail-dump                : Not Supported
id-ctrl                       : Supported
purge                         : Not Supported
purge-monitor                 : Not Supported
vs-internal-log               : Supported
vs-nand-stats                 : Not Supported
vs-smart-add-log              : Not Supported
--C0 Log Page                 : Not Supported
--C1 Log Page                 : Not Supported
--C3 Log Page                 : Not Supported
--CA Log Page                 : Not Supported
--D0 Log Page                 : Not Supported
clear-pcie-correctable-errors : Not Supported
drive-essentials              : Not Supported
get-drive-status              : Supported
clear-assert-dump             : Supported
drive-resize                  : Supported
vs-fw-activate-history        : Not Supported
clear-fw-activate-history     : Not Supported
vs-telemetry-controller-option: Not Supported
vs-error-reason-identifier    : Not Supported
log-page-directory            : Not Supported
namespace-resize              : Not Supported
vs-drive-info                 : Not Supported
vs-temperature-stats          : Not Supported
cloud-SSD-plugin-version      : Not Supported
vs-pcie-stats                 : Not Supported
get-error-recovery-log        : Not Supported
get-dev-capabilities-log      : Not Supported
get-unsupported-reqs-log      : Not Supported
get-latency-monitor-log       : Not Supported
cloud-boot-SSD-version        : Not Supported
vs-cloud-log                  : Not Supported
vs-hw-rev-log                 : Not Supported
vs-device_waf                 : Not Supported
set-latency-monitor-feature   : Not Supported
capabilities                  : Supported

Observations:
v2.15: Sndk/wdc Plug in commands are not working with SN655 (NVMe OF)
Working fine with nvme cli 2.11.
The command was supported with 2.11 is not supported in 2.15 version.

[sarabjotsoit]

Hi,

Any update on this?

[igaw]

Adding @jeff-lien-sndk

[jeff-lien-sndk]

@sarabjotsoit @Sayoojntly
The nvme cli plugin code is not able to find the expected UUID in the UUID list. Vould you please execute the command "nvme id-uuid /dev/nvme7" to get the UUID list and post the results. Thanks

[Sayoojntly]

Hi @jeff-lien-sndk ,
Please find the id-uuid o/p

[root@host ~]# nvme version
nvme version 2.15 (git 2.15-67-gcf29338)
libnvme version 1.15 (git 1.15-35-g6ff20a2)


[root@host ~]# nvme id-uuid /dev/nvme1
NVME Identify UUID:
 Entry[  1]
.................
association  : 0
UUID         : 11111111-1111-1111-2222-222222222222
.................

[root@host ~]# nvme list |grep /dev/nvme1
/dev/nvme1n1          /dev/ng1n1            23470B800581         WUS5EA138ESP7E3                          0x1          2.89  TB /   2.89  TB    512   B +  0 B   RC610008

[root@host ~]# nvme wdc get-drive-status /dev/nvme1
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: SNDK: 0xC2 Log Page not supported, index: 0
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: WDC: 0xC2 Log Page not supported, uuid_index: 0

[jeff-lien-sndk]

In the 2.15 version of nvme cli, there was code added to search the UUID list for the SN655 UUID. Unfortunately, that code is also dependent on reading the drive's pci device id which is not supported in the nvme over fabric case. I will need to look into alternative methods to do this. I'll post here when I come up with a solution.

[jeff-lien-sndk]

@Sayoojntly Could you retry those commands with the latest nvme cli code from the master branch. Here's the versions you should see:
nvme version
nvme version 2.16 (git 2.16-2105-g7eb5a7f+)
libnvme version 1.16 (git 1.16)

nvme sndk version
nvme sndk version 3.0.8 (git 2.16-2105-g7eb5a7f+)
libnvme version 1.16 (git 1.16)

nvme wdc version
nvme wdc version 2.14.6 (git 2.16-2105-g7eb5a7f+)
libnvme version 1.16 (git 1.16)

There have been several fixes for the SN-861 drive that should also apply to the SN-655. I was not able to get the vs-fw-activate-history or get-drive-status commands to fail on SN-655 with that code - in a simulated fabric attached environment.

Here's the output from my testing:
tips33:root:13:22 ~/git-repos/nvme-cli-jal > .build/nvme sndk vs-fw-activate-history /dev/nvme0
ERROR: SNDK: sndk_get_pci_ids : Open vendor file failed
ERROR: SNDK: sndk_get_pci_ids : Open vendor file failed
sndk_get_dev_mgment_data: UUID lists are supported but a matching uuid was not found
ERROR: SNDK: 0xC2 Log Page not found
NVMe status: Successful Completion: The command completed without error(0)
Firmware Activate History Log
Power on Hour Power Cycle Previous New
Entry hh:mm:ss Count Firmware Firmware Slot Action Result

---

337 0052:57:46 21 LC610701 LC709003 1 000b fail #19
338 0064:40:04 21 LC610701 LC709003 1 011b fail #19
339 0064:40:04 21 LC610701 -------- 1 001b fail #7
tips33:root:13:23 ~/git-repos/nvme-cli-jal > .build/nvme sndk vs-fw-activate-history /dev/nvme1
ERROR: SNDK: sndk_get_pci_ids : Open vendor file failed
ERROR: SNDK: sndk_get_pci_ids : Open vendor file failed
sndk_get_dev_mgment_data: UUID lists are supported but a matching uuid was not found
ERROR: SNDK: 0xC2 Log Page not found
NVMe status: Successful Completion: The command completed without error(0)
INFO: WDC: No FW Activate History entries found.

tips33:root:13:23 ~/git-repos/nvme-cli-jal > .build/nvme sndk get-drive-status /dev/nvme0
Drive Status :-
Percent Used: 0%
Drive Life Status: Normal
Assert Dump Status: Not Present
Thermal Throttling Status: Off
Format Corrupt Reason: Format Not Corrupted
tips33:root:13:24 ~/git-repos/nvme-cli-jal > .build/nvme sndk get-drive-status /dev/nvme1
Drive Status :-
Percent Used: 0%
Drive Life Status: Normal
Assert Dump Status: Not Present
Thermal Throttling Status: Off
Format Corrupt Reason: Format Not Corrupted

[Sayoojntly]

Hi @jeff-lien-sndk
We have tried with latest nvme cli from git and still observing the issue.

NOTE: This issue observed with the UUID enabled firmware from our enclosure with SN655.

/dev/nvme9n4          /dev/ng9n4            23470B800829         WUS5EA138ESP7E3                          0x4        954.72  GB / 954.72  GB    512   B +  0 B   RC61000B

[root@host]# nvme version
nvme version 2.16 (git 2.16-2112-g7dc37f7)
libnvme version 1.16 (git 1.16)

[root@host]# nvme wdc version
nvme wdc version 2.14.6 (git 2.16-2112-g7dc37f7)
libnvme version 1.16 (git 1.16)

[root@host]# nvme sndk version
nvme sndk version 3.0.8 (git 2.16-2112-g7dc37f7)
libnvme version 1.16 (git 1.16)

[nvme sndk vs-fw-activate-history /dev/nvme9
ERROR: SNDK: sndk_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: SNDK: 0xC2 Log Page not supported, uuid_index: -2
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: SNDK: 0xC2 Log Page not supported, index: 0
ERROR: WDC: unsupported device for this command
[root@host]# nvme wdc get-drive-status /dev/nvme9
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: SNDK: 0xC2 Log Page not supported, index: 0
ERROR: WDC: wdc_get_pci_ids : Open vendor file failed
get_dev_mgment_cbs_data: UUID lists are supported but a matching uuid was not found
ERROR: WDC: 0xC2 Log Page entry ID 0x8 not found
ERROR: WDC: 0xC2 Log Page not supported, uuid_index: 0

[root@host]# nvme id-uuid /dev/nvme9
NVME Identify UUID:
Entry[ 1]

.................
association  : 0
UUID         : 11111111-1111-1111-2222-222222222222
.................

[jeff-lien-sndk]

Hi @Sayoojntly,
Could you execute this command and attach the output to this issue:
nvme get-log /dev/nvme9 -i 0xc2 -l 1024

[Sayoojntly]

Hi @jeff-lien-sndk ,
Please find the data below.

 nvme get-log /dev/nvme9 -i 0xc2 -l 1024
Device:nvme9 log-id:194 namespace-id:0xffffffff
       0  1  2  3  4  5  6  7  8  9  a  b  c  d  e  f
0000: 68 03 00 00 00 00 00 00 0c 00 00 00 01 00 00 00 "h..............."
0010: 0c 57 03 04 10 00 00 00 04 00 00 00 00 60 e5 3e ".W...........`.>"
0020: 7e 03 00 00 10 00 00 00 05 00 00 00 00 60 e5 3e "~............`.>"
0030: 7e 03 00 00 10 00 00 00 06 00 00 00 00 20 43 3c "~.............C<"
0040: 00 00 00 00 10 00 00 00 0e 00 00 00 00 00 a0 ac "................"
0050: b9 03 00 00 10 00 00 00 0b 00 00 00 00 ca 9a 3b "...............;"
0060: 00 00 00 00 10 00 00 00 0c 00 00 00 00 10 00 00 "................"
0070: 00 00 00 00 10 00 00 00 0d 00 00 00 00 00 00 00 "................"
0080: 00 00 00 00 0c 00 00 00 0f 00 00 00 02 00 00 00 "................"
0090: 0c 00 00 00 0a 00 00 00 07 00 00 00 20 00 00 00 "................"
00a0: 07 00 00 00 12 00 00 00 55 6c 74 72 61 73 74 61 "........Ultrasta"
00b0: 72 20 44 43 20 53 4e 36 35 35 00 00 1c 00 00 00 "r.DC.SN655......"
00c0: 10 00 00 00 0f 00 00 00 57 55 53 35 45 41 31 33 "........WUS5EA13"
00d0: 38 45 53 50 37 45 33 00 20 00 00 00 11 00 00 00 "8ESP7E3........."
00e0: 14 00 00 00 32 33 34 37 30 42 38 30 30 38 32 39 "....23470B800829"
00f0: 20 20 20 20 20 20 20 20 34 00 00 00 13 00 00 00 "........4......."
0100: 28 00 00 00 63 6f 66 66 65 65 62 61 79 5f 68 70 "(...coffeebay_hp"
0110: 2f 52 43 36 31 30 30 30 42 2e 30 30 2d 30 2d 67 "/RC61000B.00-0-g"
0120: 30 38 62 65 39 65 32 32 62 64 62 36 0c 00 00 00 "08be9e22bdb6...."
0130: 15 00 00 00 01 00 00 00 48 00 00 00 16 00 00 00 "........H......."
0140: 3c 00 00 00 55 6e 6b 6e 6f 77 6e 20 53 46 46 20 "<...Unknown.SFF."
0150: 37 6d 6d 20 33 38 34 30 47 42 20 50 43 49 65 20 "7mm.3840GB.PCIe."
0160: 52 49 2d 30 2e 38 20 44 57 2f 44 20 37 25 20 4f "RI-0.8.DW/D.7%.O"
0170: 50 2c 20 49 53 45 20 2c 20 47 45 4e 45 52 49 43 "P,.ISE.,.GENERIC"
0180: 1c 00 00 00 02 00 00 00 0e 00 00 00 31 62 39 36 "............1b96"
0190: 2d 32 37 33 30 2d 34 32 35 63 00 00 0c 00 00 00 "-2730-425c......"
01a0: 12 00 00 00 19 0e 00 00 14 00 00 00 03 00 00 00 "................"
01b0: 05 00 00 00 30 2e 30 2e 30 00 00 00 1c 00 00 00 "....0.0.0......."
01c0: 17 00 00 00 10 00 00 00 42 35 6d 5f 43 2e 31 2e "........B5m_C.1."
01d0: 30 00 00 00 00 00 00 00 0c 00 00 00 18 00 00 00 "0..............."
01e0: 00 00 00 00 0c 00 00 00 19 00 00 00 00 00 00 00 "................"
01f0: 0c 00 00 00 1a 00 00 00 1e 00 00 00 0c 00 00 00 "................"
0200: 1b 00 00 00 00 00 00 00 0c 00 00 00 1c 00 00 00 "................"
0210: 00 00 00 00 0c 00 00 00 1d 00 00 00 00 00 00 00 "................"
0220: 0c 00 00 00 1e 00 00 00 00 00 00 00 0c 00 00 00 "................"
0230: 1f 00 00 00 00 00 00 00 0c 00 00 00 20 00 00 00 "................"
0240: 1a 00 00 00 0c 00 00 00 21 00 00 00 0d 00 00 00 "........!......."
0250: 0c 00 00 00 22 00 00 00 0e 00 00 00 0c 00 00 00 "...."..........."
0260: 23 00 00 00 1a 00 00 00 20 00 00 00 24 00 00 00 "#...........$..."
0270: 13 00 00 00 43 55 53 54 4f 4d 45 52 5f 49 44 5f "....CUSTOMER_ID_"
0280: 47 45 4e 45 52 49 43 00 20 00 00 00 25 00 00 00 "GENERIC.....%..."
0290: 13 00 00 00 43 55 53 54 4f 4d 45 52 5f 49 44 5f "....CUSTOMER_ID_"
02a0: 47 45 4e 45 52 49 43 00 20 00 00 00 26 00 00 00 "GENERIC.....&..."
02b0: 13 00 00 00 43 55 53 54 4f 4d 45 52 5f 49 44 5f "....CUSTOMER_ID_"
02c0: 47 45 4e 45 52 49 43 00 20 00 00 00 27 00 00 00 "GENERIC.....'..."
02d0: 13 00 00 00 43 55 53 54 4f 4d 45 52 5f 49 44 5f "....CUSTOMER_ID_"
02e0: 47 45 4e 45 52 49 43 00 10 00 00 00 28 00 00 00 "GENERIC.....(..."
02f0: 00 00 00 00 00 00 00 00 10 00 00 00 29 00 00 00 "............)..."
0300: 00 00 00 00 00 00 00 00 0c 00 00 00 2a 00 00 00 "............*..."
0310: 40 1f 00 00 0c 00 00 00 2b 00 00 00 10 00 00 00 "@.......+......."
0320: 20 00 00 00 08 00 00 00 14 00 00 00 01 02 03 04 "................"
0330: 05 06 07 08 0d 80 81 c0 c2 c4 c5 c6 ca cb d1 fa "................"
0340: 28 00 00 00 09 00 00 00 1a 00 00 00 01 02 03 04 "(..............."
0350: 05 07 08 09 0a 0b 0e 16 17 7e 7f 80 81 82 83 c3 ".........~......"
0360: cb cd ce cf d1 d2 00 00 00 00 00 00 00 00 00 00 "................"
0370: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
0380: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
0390: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
03a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
03b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
03c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
03d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
03e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
03f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 "................"
~]# nvme version
nvme version 2.16 (git 2.16-2112-g7dc37f7)
libnvme version 1.16 (git 1.16)

[jeff-lien-sndk]

I created PR #2982 to resolve this issue. The PR is currently under review and not merged yet. I'll add a comment here once it's been merged.

[igaw]

I've merged #2982. Feel free to reopen if it's not done yet.