do@lenny ~$ sudo rados bench -p scbench-ssd 10 write --no-cleanup hints = 1 Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects Object prefix: benchmark_data_lenny_3639885 sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 0 0 0 0 0 0 - 0 1 16 16 0 0 0 - 0 2 16 20 4 7.99861 8 1.55338 1.33348 3 16 23 7 9.3317 12 2.58585 1.8076 4 16 25 9 8.99783 8 1.93891 1.9839 5 16 30 14 11.1975 20 4.94566 2.74343 6 16 34 18 11.9974 16 1.56079 2.84698 7 16 36 20 11.4262 8 2.35802 3.01545 8 16 39 23 11.4976 12 7.98993 3.41017 9 16 41 25 11.1088 8 0.890175 3.29592 10 16 45 29 11.5977 16 1.70533 3.3532 11 15 46 31 11.2704 8 2.52783 3.36889 12 14 46 32 10.6646 4 3.09921 3.36046 13 14 46 32 9.84422 0 - 3.36046 14 10 46 36 10.2837 8 3.90924 3.76006 Total time run: 14.7675 Total writes made: 46 Write size: 4194304 Object size: 4194304 Bandwidth (MB/sec): 12.4598 Stddev Bandwidth: 5.74934 Max bandwidth (MB/sec): 20 Min bandwidth (MB/sec): 0 Average IOPS: 3 Stddev IOPS: 1.43734 Max IOPS: 5 Min IOPS: 0 Average Latency(s): 4.80864 Stddev Latency(s): 3.27751 Max latency(s): 13.214 Min latency(s): 0.845786 do@lenny ~$ sudo rados bench -p scbench-ssd 10 rand hints = 1 sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 0 0 0 0 0 0 - 0 1 16 19 3 11.995 12 0.898158 0.82445 2 16 23 7 13.9958 16 1.88579 1.25992 3 16 26 10 13.3299 12 2.64588 1.59851 4 16 30 14 13.9966 16 3.83668 1.93553 5 16 35 19 15.1964 20 1.47049 2.20992 6 16 38 22 14.6634 12 1.45423 2.42733 7 16 44 28 15.9965 24 0.959714 2.73725 8 16 47 31 15.4966 12 1.37284 2.85643 9 16 52 36 15.9966 20 5.0076 3.03584 10 16 55 39 15.5967 12 0.690651 3.07763 11 16 56 40 14.5424 4 4.92254 3.12375 12 16 56 40 13.3305 0 - 3.12375 13 16 56 40 12.3051 0 - 3.12375 Total time run: 13.9669 Total reads made: 56 Read size: 4194304 Object size: 4194304 Bandwidth (MB/sec): 16.0379 Average IOPS: 4 Stddev IOPS: 1.84669 Max IOPS: 6 Min IOPS: 0 Average Latency(s): 3.94751 Max latency(s): 8.45673 Min latency(s): 0.686362 do@lenny ~$ sudo rados bench -p scbench-ssd 10 seq hints = 1 sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 0 0 0 0 0 0 - 0 1 16 19 3 11.9959 12 0.689586 0.66343 2 16 25 9 17.9956 24 1.21362 1.19095 3 16 28 12 15.9964 12 1.30662 1.43019 4 16 32 16 15.9968 16 3.99621 1.7762 5 16 36 20 15.9969 16 4.64822 2.13385 6 16 41 25 16.6635 20 5.0968 2.33332 7 16 44 28 15.9971 12 5.4352 2.45223 8 16 46 30 14.9972 8 1.53563 2.46951 9 13 46 33 14.664 12 7.01039 2.61443 10 8 46 38 15.1972 20 5.85954 2.99876 Total time run: 10.3346 Total reads made: 46 Read size: 4194304 Object size: 4194304 Bandwidth (MB/sec): 17.8043 Average IOPS: 4 Stddev IOPS: 1.22927 Max IOPS: 6 Min IOPS: 2 Average Latency(s): 3.43487 Max latency(s): 9.03273 Min latency(s): 0.634308 do@lenny ~$ sudo rados bench -p scbench-ssd 30 rand hints = 1 sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 0 0 0 0 0 0 - 0 1 16 19 3 11.9952 12 0.68926 0.625227 2 16 24 8 15.9953 20 1.49809 1.03518 3 16 31 15 19.9948 28 2.71333 1.53183 4 16 37 21 20.9949 24 1.75632 1.86349 5 16 43 27 21.5948 24 3.75659 2.05061 6 16 49 33 21.995 24 2.48837 2.11767 7 16 54 38 21.7095 20 0.659536 2.213 8 16 60 44 21.9952 24 0.614797 2.27264 9 16 65 49 21.7731 20 3.18292 2.34831 10 16 71 55 21.9954 24 2.73803 2.45288 11 16 77 61 22.1773 24 3.25429 2.47174 12 16 82 66 21.9956 20 3.3704 2.50903 13 16 88 72 22.1494 24 3.89392 2.54965 14 16 93 77 21.9957 20 2.76956 2.58599 15 16 99 83 22.129 24 2.89327 2.60995 16 16 105 89 22.2457 24 2.88837 2.6081 17 16 110 94 22.1134 20 3.16836 2.62964 18 16 116 100 22.218 24 3.01529 2.64267 19 16 121 105 22.1011 20 3.52018 2.63621 2020-03-26 20:04:22.748117 min lat: 0.533279 max lat: 4.52016 avg lat: 2.62519 sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 20 16 127 111 22.1958 24 0.555885 2.62519 21 16 132 116 22.091 20 3.24145 2.658 22 16 138 122 22.1776 24 3.53678 2.65736 23 16 143 127 22.0827 20 3.10933 2.66557 24 16 149 133 22.1625 24 3.74029 2.67077 25 16 155 139 22.2359 24 0.582075 2.66862 26 16 160 144 22.1497 20 3.49143 2.68488 27 16 166 150 22.2181 24 3.25106 2.70005 28 16 172 156 22.2816 24 0.5923 2.69024 29 16 177 161 22.2028 20 3.58342 2.70912 30 16 181 165 21.996 16 1.84561 2.70472 31 16 182 166 21.4154 4 2.98895 2.70643 32 16 182 166 20.7462 0 - 2.70643 33 16 182 166 20.1176 0 - 2.70643 34 16 182 166 19.5259 0 - 2.70643 Total time run: 34.0496 Total reads made: 182 Read size: 4194304 Object size: 4194304 Bandwidth (MB/sec): 21.3806 Average IOPS: 5 Stddev IOPS: 1.87107 Max IOPS: 7 Min IOPS: 0 Average Latency(s): 2.99141 Max latency(s): 8.15608 Min latency(s): 0.533279 do@lenny ~$ sudo rados bench -p scbench-ssd 30 seq hints = 1 sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 0 0 0 0 0 0 - 0 1 16 19 3 11.9894 12 0.917781 0.83888 2 16 22 6 11.9939 12 1.66418 1.21039 3 16 25 9 11.9954 12 1.56822 1.49919 4 16 30 14 13.9953 20 3.92662 2.08455 5 16 34 18 14.3956 16 1.75657 2.29691 6 16 36 20 13.3295 8 4.73111 2.57761 7 16 39 23 13.1393 12 6.17507 2.89999 8 16 42 26 12.9966 12 6.40956 2.97197 9 16 46 30 13.33 16 4.90467 3.18248 10 16 46 30 11.9971 0 - 3.18248 11 12 46 34 12.3607 8 5.35723 3.54036 12 12 46 34 11.3307 0 - 3.54036 13 12 46 34 10.4591 0 - 3.54036 Total time run: 13.3978 Total reads made: 46 Read size: 4194304 Object size: 4194304 Bandwidth (MB/sec): 13.7336 Average IOPS: 3 Stddev IOPS: 1.61325 Max IOPS: 5 Min IOPS: 0 Average Latency(s): 4.40677 Max latency(s): 11.0811 Min latency(s): 0.790116