Disclaimer: The information you can get from this tool is true and complete to the best of the author’s knowledge. But use it with caution if you want to deliver it to the customer. All the information you get from this report or recommendations is being driven by it without the guarantee its exact and precise. The author disclaims any liability in connection with the use of this information.

Preface: We are the warriors and fighters fighting with customers across the globe against Isilon any feature degradations. The performance degradation is one of the hottest topics we try our best to locate, mitigate and resolve. The purpose of this tool is to give you more insights by plots and statistics summary from the informative performance data we gathered by isiperf.

The Start

CPU Performance Plots

TimeUnit (or called UnitTime) which means each evenly cut a slice of time.

x-axis is UnitTime, y-axis is CPU usagage percent at that time point.

Network Protocol Throughput Performance Plots

TimeUnit (or called UnitTime) which means each evenly cut a slice of time.

x-axis is UnitTime, y-axis is protocol throughput at that time point.

Drvie Performance Plots

TimeUnit (or called UnitTime) which means each evenly cut a slice of time.

x-axis is UnitTime, y-axis is drive performance metrics at that time point.

Connection Count

TimeUnit (or called UnitTime) which means each evenly cut a slice of time.

x-axis is UnitTime, y-axis is client statistics metrics at that time point.

Protocol SMB and NFS Operations Profile

If plots showed it indicats there are related protocol operations. Those Operations were calculated based on the period you run the ISIPERF script.

## SMBv1 Protocol Operation Profile: Total Protocol Operations:  34033.42

## SMBv2 Protocol Operation Profile: Total Protocol Operations:  295120.8

## NFSv3 Protocol Operation Profile: Total Protocol Operations:  42.98

## NFSv4 Protocol Operation Profile:

Authentication Lantency

Top 50 Max Authentication Protocol Operation TimeAvg
Node LNN Protocol Class Operation Name TimeAvg_Max(us) Ops_Max TimeAvg_Mean Ops_Mean TimeAvg_Sum Ops_Sum
10 lsass_in other lsa:uid_to_ntoken 254179 0.6 19679 0.375 314858 6
12 lsass_in other lsa:uid_to_ntoken 251849 0.6 21663 0.421 303278 5.9
1 lsass_in other lsa:pac_to_ntoken 118668 1.4 5376 0.363 478451 32.3
14 lsass_in other lsa:uid_to_ntoken 101859 0.6 10523 0.429 147317 6
5 lsass_in other lsa:uid_to_ntoken 89880 0.6 11213 0.5 134557 6
9 lsass_in other lsa:uid_to_ntoken 88540 0.7 10057 0.443 140803 6.2
11 lsass_in other lsa:uid_to_ntoken 86155 0.7 10386 0.454 135023 5.9
4 lsass_in other lsa:pac_to_ntoken 80120 1 5115 0.326 439913 28
3 lsass_in namespace_read lsa:find_objects:name 77824 3.3 1540 1.475 104741 100.3
13 lsass_in namespace_read lsa:find_objects:name 67759 3.4 1223 1.544 78246 98.8
3 lsass_in other lsa:pac_to_ntoken 55103 0.9 7912 0.336 640910 27.2
5 lsass_in namespace_read lsa:find_objects:name 36461 3.4 810.1 1.483 55894 102.3
7 lsass_in namespace_read lsa:find_objects:name 34953 2.8 699.7 1.499 46882 100.4
9 lsass_in namespace_read lsa:find_objects:name 33018 3.9 769.4 1.543 51548 103.4
1 lsass_in other lsa:ad:ioctl:get_machine_account 31776 0.4 31776 0.4 31776 0.4
12 lsass_in namespace_read lsa:find_objects:name 31506 3.1 734.6 1.493 49221 100
3 lsass_in namespace_read lsa:query_member_of 30953 1.2 1195 0.503 80059 33.7
6 lsass_in namespace_read lsa:find_objects:unix_id 29441 3.1 596.8 1.329 41180 91.7
14 lsass_in namespace_read lsa:find_objects:name 25304 3.4 597.1 1.536 41198 106
10 lsass_in namespace_read lsa:find_objects:name 23685 3.4 648.3 1.533 42789 101.2
2 lsass_in namespace_read lsa:find_objects:unix_id 22706 4.9 508.6 1.626 35092 112.2
11 lsass_in namespace_read lsa:find_objects:name 20169 3.4 576.8 1.526 37490 99.2
3 lsass_in other lsa:uid_to_ntoken 15751 5.7 3878 3.617 46538 43.4
8 lsass_in namespace_read lsa:find_objects:name 12675 3.3 534.4 1.518 35273 100.2
2 lsass_in other lsa:pac_to_ntoken 9697 1 4061 0.353 353314 30.7
8 lsass_in other lsa:uid_to_ntoken 6612 0.6 4191 0.4 62862 6
11 lsass_in namespace_read lsa:query_member_of 5177 1.2 256.6 0.515 16680 33.5
14 lsass_in namespace_read lsa:query_member_of 5051 1.2 294.1 0.519 20296 35.8
1 lsass_in other lsa:uid_to_ntoken 4910 4.1 3002 2.478 27014 22.3
3 lsass_in namespace_read lsa:find_objects:sid 4896 6.9 470.4 1.001 48921 104.1
9 lsass_in namespace_read lsa:query_member_of 4511 1.4 274.3 0.524 18379 35.1
12 lsass_in namespace_read lsa:query_member_of 4202 1.1 243.4 0.503 16306 33.7
2 lsass_in session_state lsa:auth_user_pam 4181 0.2 4181 0.2 4181 0.2
3 lsass_in namespace_read lsa:find_objects:unix_id 3900 7.2 415.7 1.858 27853 124.5
13 lsass_in other lsa:uid_to_ntoken 3672 0.6 2554 0.47 25539 4.7
8 lsass_in namespace_read lsa:query_member_of 3560 1.2 246 0.517 16238 34.1
1 lsass_in namespace_read lsa:query_member_of 3512 1.2 246.6 0.493 17014 34
13 lsass_in namespace_read lsa:enum_objects 3379 0.4 1526 0.4 15265 4
2 lsass_in other lsa:name_to_ntoken 3355 0.2 3355 0.2 3355 0.2
4 lsass_in other lsa:uid_to_ntoken 3154 4.6 2702 2.5 29718 27.5
6 lsass_in other lsa:uid_to_ntoken 3097 0.6 2504 0.492 30048 5.9
7 lsass_in namespace_read lsa:query_member_of 3079 1 180.6 0.506 12103 33.9
7 lsass_in other lsa:uid_to_ntoken 3078 0.6 2514 0.545 27649 6
2 lsass_in other lsa:uid_to_ntoken 3066 3.7 2669 1.923 34695 25
6 lsass_in namespace_read lsa:find_objects:name 2780 3.4 218.7 1.513 15090 104.4
5 lsass_in namespace_read lsa:enum_objects 2349 0.4 2103 0.4 21029 4
8 lsass_in namespace_read lsa:enum_objects 2308 0.4 2086 0.39 20859 3.9
10 lsass_in namespace_read lsa:enum_objects 2208 0.4 2096 0.4 20964 4
9 lsass_in namespace_read lsa:enum_objects 2194 0.5 2046 0.41 20462 4.1
12 lsass_in namespace_read lsa:enum_objects 2160 0.4 2063 0.4 20630 4

Protocol Class Lantency

Top 50 SMB Max Protocol Operation TimeAvg
Node LNN Protocol Class Operation Name Ops In(KB) Out(KB) MaxTimeAvg(us)
3 smb2 file_state change_notify 0.4 0.038 0.029 3.211e+12
1 smb2 file_state change_notify 1.1 0.108 0.082 35201816
4 smb1 namespace_read trans2:findfirst 1.4 0.539 0.571 1712107
1 smb2 session_state negotiate 1.4 0.142 0.315 1286555
4 smb1 create ntcreatex 1.2 0.528 0.128 1045154
3 smb2 namespace_read query_directory 14 1.5 44 920169
2 smb2 namespace_read query_directory 34.4 3.5 131 827382
1 smb2 namespace_read query_directory 14 1.5 52 546719
4 smb1 delete unlink 2.5 1.1 0.095 542622
1 smb1 delete unlink 11.3 3.5 0.429 508214
4 smb1 delete rmdir 1.2 0.33 0.045 444439
1 smb1 namespace_write mv 2.5 0.849 0.093 360886
4 smb1 read readx 0.6 0.034 1.7 328248
1 smb1 read readx 14.3 0.88 215 327116
1 smb2 read read 557.5 65 34816 281280
3 smb2 write write 721.8 34816 61 274792
3 smb2 session_state session_setup 1.1 2 0.265 263330
4 smb2 namespace_read query_directory 11.5 1.2 44 263262
2 smb1 namespace_write mv 2 0.708 0.078 223119
3 smb1 namespace_read trans2:findfirst 1.4 0.517 0.556 216058
3 smb1 namespace_write mv 3.8 1.4 0.146 213546
1 smb2 write write 965.3 46080 81 200789
4 smb2 session_state tree_connect 0.9 0.105 0.076 196516
2 smb1 namespace_read trans2:findfirst 2.8 1.1 1.1 176012
3 smb2 read read 651.4 76 43008 172474
2 smb2 read read 442.3 52 19456 161993
4 smb1 create mkdir 1 0.248 0.039 145836
2 smb1 delete unlink 13.7 4.3 0.523 142019
1 smb2 session_state session_setup 1.4 2.4 0.32 121267
4 smb2 read read 229.3 27 6451 112714
4 smb2 namespace_write set_info 149 28 10 99213
3 smb1 delete unlink 21.4 6.6 0.814 98255
3 smb1 read readx 29.5 1.9 438 97582
4 smb2 session_state session_setup 0.9 1.6 0.217 82638
4 smb1 namespace_read trans2:qpathinfo 15.9 4.3 5 82624
2 smb1 create ntcreatex 33.6 11 3.5 75145
2 smb1 read readx 18.8 1.2 304 72909
3 smb1 namespace_read trans2:qpathinfo 323.3 86 83 54096
1 smb1 create ntcreatex 31.7 10 3.4 53439
1 smb1 namespace_read trans2:qpathinfo 178.8 47 45 50666
2 smb2 namespace_write set_info 195.7 35 14 49112
3 smb2 namespace_write set_info 246.6 44 17 44254
3 smb1 create ntcreatex 57.9 19 6.2 44151
3 smb1 write writex 29.7 364 1.5 38134
1 smb2 create create 916.6 290 185 33511
4 smb2 create create 622.7 198 125 33422
3 smb1 delete rmdir 21.4 5.9 0.814 33416
2 smb1 create mkdir 24.3 5.7 0.924 32376
1 smb2 namespace_write set_info 283.6 46 20 31023
2 smb1 write writex 17.5 302 0.872 23225
Top 50 SMB Protocol Internal Operation TimeAvg
Node LNN Protocol Class Operation Name TimeAvg_Max(us) Ops_Max TimeAvg_Mean Ops_Mean TimeAvg_Sum Ops_Sum
3 irp namespace_read read_directory_change 3.211e+12 0.4 3.211e+12 0.4 3.211e+12 0.4
1 irp namespace_read read_directory_change 35201804 1.1 6517867 0.711 123839465 13.5
2 irp other fs_control 15840474 833.8 592034 459.1 71044133 55097
4 irp other fs_control 6154554 774.5 1318976 266.3 158277085 31959
1 irp other fs_control 2932390 1126 504031 565 60483760 67804
3 irp other fs_control 1610991 1434 616319 663 73958316 79559
2 irp namespace_read query_directory 993831 19.7 105761 2.837 10576132 283.7
3 irp namespace_read query_directory 924199 12.5 160415 4.424 19249789 530.9
1 irp namespace_read query_directory 732294 10.4 108237 2.484 10390757 238.5
4 irp file_state set_information 538641 165.8 13432 47.99 1611869 5759
4 irp namespace_read query_directory 157800 7.7 16424 1.604 1297482 126.7
3 irp write write 146502 1331 7699 544.9 923844 65384
1 irp read read 126040 1126 24200 156.9 2903975 18828
1 irp write write 113662 1843 6843 696.2 821151 83544
4 irp read read 73880 469.9 26931 76.42 3231769 9171
3 irp read read 57838 1331 17780 267.6 2133614 32116
2 irp read read 55706 1331 24813 104.9 2977600 12588
2 irp file_state set_information 38907 207.6 6643 106.9 797118 12832
1 irp file_state set_information 26447 288.6 4989 149.6 598651 17946
3 irp file_state set_information 21109 299.3 6344 157.2 761294 18858
4 irp create create 17078 1536 5764 477.4 691722 57290
2 irp create create 11042 1741 4217 976.5 506008 117181
1 irp create create 10995 2253 4380 1145 525617 137417
3 irp create create 9537 2867 4761 1485 571273 178151
4 irp write write 8753 756 369.1 146.8 44288 17613
2 irp write write 6932 1843 353.4 383.6 42402 46038
2 irp file_state close 3438 1536 557.3 852 66876 102242
4 irp file_state close 3409 1331 538.6 417.2 64626 50066
3 irp file_state close 2745 2458 683.8 1287 82057 154401
3 irp file_state query_information 2198 1638 171.7 813.4 20608 97604
8 irp other device_io_control 1854 0.6 172.1 0.421 2410 5.9
6 irp other device_io_control 1795 0.6 170.6 0.5 2048 6
1 irp file_state close 1682 1946 499.1 1005 59897 120627
14 irp other device_io_control 1557 0.6 140.7 0.407 2111 6.1
2 irp file_state query_information 1358 1024 124.9 553.5 14990 66422
5 irp other device_io_control 1167 0.6 142.4 0.536 1566 5.9
1 irp file_state query_information 1152 1331 135.6 667.2 16269 80062
10 irp other device_io_control 775.7 0.6 94.91 0.421 1329 5.9
9 irp other device_io_control 755.7 0.7 101.1 0.492 1213 5.9
8 irp create create 626.7 0.6 513.2 0.421 7185 5.9
12 irp other device_io_control 617.3 0.6 86.14 0.462 1120 6
12 irp create create 607 0.6 504.1 0.462 6554 6
7 irp other device_io_control 598 0.7 74.99 0.545 824.9 6
5 irp create create 590.3 0.6 502 0.536 5522 5.9
9 irp create create 590 0.7 512.1 0.492 6146 5.9
14 irp create create 575 0.6 489.8 0.407 7347 6.1
10 irp create create 568.7 0.6 493.2 0.421 6905 5.9
11 irp create create 562 0.6 497.5 0.462 6468 6
3 irp namespace_read query_volume_information 383.8 30.9 179.9 7.14 20868 828.2
11 irp other device_io_control 378 0.6 65.34 0.462 849.4 6
Top 50 NFS Max Protocol Operation TimeAvg
Node LNN Protocol Class Operation Name Ops In(KB) Out(KB) MaxTimeAvg(us)
2 nfs3 namespace_read access 3.4 0.398 0.398 53034
2 nfs3 namespace_read getattr 18.2 2.1 2 10390

…Duo to the privacy reason other information regarding clients info will not be showed here.