Sparse documentation available here: https://www.mellanox.com/related-docs/prod_management_software/Mellanox_NEO-Host_User_Manual_v1.0.pdf
All SDK scripts are in hschulz@bluefield101:/opt/neohost/sdk
We need a root process to run neohost on each bfd card. E.g.
ssh root@bfd101
neohost –s 5001=============================================================================================================================================================
|| Counter Name || Counter Value ||| Performance Analysis || Analysis Value [Units] ||
=============================================================================================================================================================
|| Level 0 MTT Cache Hit || 0 ||| Bandwidth ||
|| Level 0 MTT Cache Miss || 0 ||---------------------------------------------------------------------------
|| Level 1 MTT Cache Hit || 0 ||| RX BandWidth || 0 [Gb/s] ||
|| Level 1 MTT Cache Miss || 0 ||| TX BandWidth || 0 [Gb/s] ||
|| Level 0 MPT Cache Hit || 0 ||===========================================================================
|| Level 0 MPT Cache Miss || 0 ||| Memory ||
|| Level 1 MPT Cache Hit || 0 ||---------------------------------------------------------------------------
|| Level 1 MPT Cache Miss || 0 ||| RX Indirect Memory Keys Rate || 0 [Keys/Packet] ||
|| Indirect Memory Key Access || 0 ||===========================================================================
|| ICM Cache Miss || 1,355 ||| PCIe Latency ||
|| PCIe Internal Back Pressure || 0 ||---------------------------------------------------------------------------
|| Outbound Stalled Reads || 0 ||| PCIe Avg Latency || 0 [NS] ||
|| Outbound Stalled Writes || 0 ||| PCIe Max Latency || 0 [NS] ||
|| PCIe Read Stalled due to No Read Engines || 0 ||| PCIe Min Latency || 0 [NS] ||
|| PCIe Read Stalled due to No Completion Buffer || 0 ||===========================================================================
|| PCIe Read Stalled due to Ordering || 0 ||| PCIe Latency to ARM ||
|| Back Pressure from Packet Scatter to RX Packet Buffer || 0 ||---------------------------------------------------------------------------
|| Back Pressure from Packet Processing to RX Packet Buffer || 0 ||| PCIe to ARM Avg Latency || 334 [NS] ||
|| RX Packet Buffer Full Port 1 || 0 ||| PCIe to ARM Max Latency || 334 [NS] ||
|| RX Packet Buffer Full Port 2 || 0 ||| PCIe to ARM Min Latency || 334 [NS] ||
|| Chip Frequency || 275.012 ||===========================================================================
|| RX Steering Pipe 0 || 13 ||| Packet Rate ||
|| RX Steering Pipe 1 || 0 ||---------------------------------------------------------------------------
|| RX Steering Cache Hit Pipe 0 || 12 ||| RX Packet Rate || 1 [Packets/Seconds] ||
|| RX Steering Cache Miss Pipe 0 || 0 ||| TX Packet Rate || 0 [Packets/Seconds] ||
|| RX Steering Cache Hit Pipe 1 || 0 ||===========================================================================
|| RX Steering Cache Miss Pipe 1 || 0 ||| eSwitch ||
|| RX Steering Cache Access Pipe 0 || 12 ||---------------------------------------------------------------------------
|| RX Steering Cache Access Pipe 1 || 0 ||| RX Hops Per Packet || 13 [Hops/Packet] ||
|| RX Steering Learning Cache Lookups || 1 ||| RX Optimal Hops Per Packet Per Pipe || 6.5 [Hops/Packet] ||
|| RX Steering Learning Cache Hit || 1 ||| RX Optimal Packet Rate Bottleneck || 42.3095 [MPPS] ||
|| RX Steering Learning Cache Miss || 0 ||| RX Packet Rate Bottleneck || 21.1548 [MPPS] ||
|| RX Steering Learning Cache Learn || 0 ||| TX Hops Per Packet || 0 [Hops/Packet] ||
|| Back Pressure from Internal MMU to RX Descriptor Handling || 0 ||| TX Optimal Hops Per Packet Per Pipe || 0 [Hops/Packet] ||
|| Receive WQE Cache Hit || 0 ||| TX Optimal Packet Rate Bottleneck || 0 [MPPS] ||
|| Receive WQE Cache Miss || 0 ||| TX Packet Rate Bottleneck || 0 [MPPS] ||
|| Back Pressure from PCIe to Packet Scatter || 0 ||===========================================================================
|| RX Steering Packets || 1 ||
|| RX Steering Packets Fast Path || 0 ||
|| EQ All State Machines Busy || 0 ||
|| CQ All State Machines Busy || 0 ||
|| MSI-X All State Machines Busy || 0 ||
|| CQE Compression Sessions || 0 ||
|| Compressed CQEs || 0 ||
|| Compression Session Closed due to EQE || 0 ||
|| Compression Session Closed due to Timeout || 0 ||
|| Compression Session Closed due to Mismatch || 0 ||
|| Compression Session Closed due to PCIe Idle || 0 ||
|| Compression Session Closed due to S2CQE || 0 ||
|| Compressed CQE Strides || 0 ||
|| Compression Session Closed due to LRO || 0 ||
|| TX Descriptor Handling Stopped due to Limited State || 0 ||
|| TX Descriptor Handling Stopped due to Limited VL || 0 ||
|| TX Descriptor Handling Stopped due to De-schedule || 0 ||
|| TX Descriptor Handling Stopped due to Work Done || 0 ||
|| TX Descriptor Handling Stopped due to E2E Credits || 0 ||
|| Line Transmitted Port 1 || 0 ||
|| Line Transmitted Port 2 || 0 ||
|| Line Transmitted Loop Back || 0 ||
|| TX Steering Pipe 0 || 0 ||
|| TX Steering Pipe 1 || 0 ||
|| TX Steering Hit Pipe 0 || 0 ||
|| TX Steering Miss Pipe 0 || 0 ||
|| TX Steering Hit Pipe 1 || 0 ||
|| TX Steering Miss Pipe 1 || 0 ||
|| TX Steering Cache Miss Pipe 0 || 0 ||
|| TX Steering Cache Miss Pipe 1 || 0 ||
|| TX Steering Cache Access Pipe 0 || 0 ||
|| TX Steering Cache Access Pipe 1 || 0 ||
|| TX Steering Learning Cache Lookups || 0 ||
|| TX Steering Learning Cache Hit || 0 ||
|| TX Steering Learning Cache Miss || 0 ||
|| TX Steering Learning Cache Learn || 0 ||
==================================================================================
python get_system_information.py --mode shell
{"id": 177, "result": {"serverInfo": {"displayName": "Server Information", "val": {"kernel": {"displayName": "Kernel", "val": "4.14.0-115.el7a.0.1.aarch64"}, "totalMem": {"displayName": "Total Memory (GB)", "val": "15.31 GB"}, "cpuCores": {"displayName": "CPU Cores", "val": 16}, "hostName": {"displayName": "Host Name", "val": "bluefield101.pri.cosma7.alces.network"}, "cpuArch": {"displayName": "CPU Architecture", "val": "aarch64"}, "ofedVer": {"displayName": "Driver", "val": "MLNX_OFED_LINUX-5.0-2.1.8.0"}, "os": {"displayName": "Operating System", "val": "CentOS Linux 7.6.1810 (AltArch)"}}}}}Similarly,
python get_system_dump.py --mode shell --dump-dir-path $HOME/dump
{"id": 523, "result": {"dumpFilePath": "/cosma/home/durham/hschulz/dump/DebugGetSystemInfo_20210713-034124.512.txt"}}
head /cosma/home/durham/hschulz/dump/DebugGetSystemInfo_20210713-034124.512.txt
Server Information:
hostname: bluefield101.pri.cosma7.alces.network
bios: N/A
cpu: N/A
kernel1: N/A
kernel2: N/A
kernel3: N/A
model: N/A
net_ip: 192.168.100.2/30
net_mac: 00:1a:ca:ff:ff:01