Thursday 17 December 2015

Cloudbench: Google Cloud Platform - 32 vCPU / 28GB

Cloudbench result for Google Cloud Platform - 32 vCPU / 28GB in Taiwan region:
Starting Cloudbench - Wed Dec 16 21:54:29 UTC 2015

Install required packages:

===========================================================================================

System info:


CPU model :  Intel(R) Xeon(R) CPU @ 2.50GHz
Number of cores : 32
CPU frequency :  2500.000 MHz
Total amount of ram : 28873 MB
Total amount of swap : 0 MB
System uptime :   2 min,       
System version: CentOS release 6.7 (Final)
Kernel \r on an \m
System kernel: Linux instance-1 2.6.32-573.12.1.el6.x86_64 #1 SMP Tue Dec 15 21:19:08 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                32
On-line CPU(s) list:   0-31
Thread(s) per core:    2
Core(s) per socket:    16
Socket(s):             1
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 62
Stepping:              4
CPU MHz:               2500.000
BogoMIPS:              5000.00
Hypervisor vendor:     KVM
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              30720K
NUMA node0 CPU(s):     0-31

             total       used       free     shared    buffers     cached
Mem:         28873       2571      26301          0         10        139
-/+ buffers/cache:       2421      26451 
Swap:            0          0          0 
Total:       28873       2571      26301 

Filesystem      Size  Used Avail Use% Mounted on
/dev/sda1       9.8G  1.8G  7.5G  20% /
tmpfs            15G     0   15G   0% /dev/shm


Disk /dev/sda: 10.7 GB, 10737418240 bytes
4 heads, 32 sectors/track, 163840 cylinders
Units = cylinders of 128 * 512 = 65536 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x0003a780

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1              17      163825    10483712+  83  Linux

Kernel Interface table
Iface       MTU Met    RX-OK RX-ERR RX-DRP RX-OVR    TX-OK TX-ERR TX-DRP TX-OVR Flg
eth0       1460   0      438      0      0      0      437      0      0      0 BMRU
lo        65536   0        0      0      0      0        0      0      0      0 LRU

eth0      Link encap:Ethernet  HWaddr 42:01:0A:F0:00:02  
          inet addr:10.240.0.2  Bcast:10.240.0.2  Mask:255.255.255.255
          inet6 addr: fe80::4001:aff:fef0:2/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1460  Metric:1
          RX packets:438 errors:0 dropped:0 overruns:0 frame:0
          TX packets:437 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:176853 (172.7 KiB)  TX bytes:75225 (73.4 KiB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)


CentOS release 6.7 (Final)
LSB_VERSION=base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch
CentOS release 6.7 (Final)
CentOS release 6.7 (Final)

LSB Version:    :base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch
Distributor ID: CentOS
Description:    CentOS release 6.7 (Final)
Release:        6.7
Codename:       Final

===========================================================================================

Geekbench - CPU / Memory bandwidth:


Geekbench 64-bit:

Thank you for purchasing Geekbench! All the limitations of tryout mode have 
been removed. Thank you for your purchase, and we hope you enjoy using 
Geekbench 3.

System Information
  Operating System      Linux 2.6.32-573.12.1.el6.x86_64 x86_64
  Model                 Google Google
  Motherboard           N/A
  Processor             Intel(R) Xeon(R) CPU @ 2.50GHz @ 2.50 GHz
                        1 Processor, 16 Cores, 32 Threads
  Processor ID          GenuineIntel Family 6 Model 62 Stepping 4
  L1 Instruction Cache  32.0 KB x 16
  L1 Data Cache         32.0 KB x 16
  L2 Cache              256 KB x 16
  L3 Cache              30.0 MB
  Memory                28.2 GB 
  BIOS                  Google Google
  Compiler              Clang 3.3 (tags/RELEASE_33/final)

Integer
  AES
    single-core        2097          1.80 GB/sec
    multi-core        28198          24.1 GB/sec
  Twofish
    single-core        2401         134.7 MB/sec
    multi-core        62594          3.43 GB/sec
  SHA1
    single-core        2975         322.9 MB/sec
    multi-core        47961          5.08 GB/sec
  SHA2
    single-core        3232         139.9 MB/sec
    multi-core        46729          1.97 GB/sec
  BZip2 Compress
    single-core        2563          10.4 MB/sec
    multi-core        51193         208.1 MB/sec
  BZip2 Decompress
    single-core        2495          13.5 MB/sec
    multi-core        49036         265.8 MB/sec
  JPEG Compress
    single-core        2752     38.3 Mpixels/sec
    multi-core        59084    823.1 Mpixels/sec
  JPEG Decompress
    single-core        4176    103.3 Mpixels/sec
    multi-core        67686     1.67 Gpixels/sec
  PNG Compress
    single-core        2746     2.19 Mpixels/sec
    multi-core        56123     44.8 Mpixels/sec
  PNG Decompress
    single-core        2903     33.5 Mpixels/sec
    multi-core        57845    666.9 Mpixels/sec
  Sobel
    single-core        3791    138.0 Mpixels/sec
    multi-core        64634     2.35 Gpixels/sec
  Lua
    single-core        2943          2.64 MB/sec
    multi-core        51006          45.8 MB/sec
  Dijkstra
    single-core        2902      10.4 Mpairs/sec
    multi-core        28755     103.2 Mpairs/sec

Floating Point
  BlackScholes
    single-core        2301      10.2 Mnodes/sec
    multi-core        47466     211.2 Mnodes/sec
  Mandelbrot
    single-core        2666          2.73 Gflops
    multi-core        70513          72.3 Gflops
  Sharpen Filter
    single-core        2468          1.83 Gflops
    multi-core        45982          34.1 Gflops
  Blur Filter
    single-core        2005          1.91 Gflops
    multi-core        42904          40.9 Gflops
  SGEMM
    single-core        3441          9.64 Gflops
    multi-core        55148         154.4 Gflops
  DGEMM
    single-core        3362          4.94 Gflops
    multi-core        55561          81.6 Gflops
  SFFT
    single-core        2689          2.84 Gflops
    multi-core        39164          41.3 Gflops
  DFFT
    single-core        2751          2.51 Gflops
    multi-core        47871          43.6 Gflops
  N-Body
    single-core        4327      1.61 Mpairs/sec
    multi-core        74141      27.5 Mpairs/sec
  Ray Trace
    single-core        3422     4.04 Mpixels/sec
    multi-core        67781     79.9 Mpixels/sec

Memory
  Stream Copy
    single-core        1084          4.33 GB/sec
    multi-core         1789          7.14 GB/sec
  Stream Scale
    single-core        1950          7.79 GB/sec
    multi-core         3790          15.1 GB/sec
  Stream Add
    single-core        1675          7.58 GB/sec
    multi-core         3240          14.7 GB/sec
  Stream Triad
    single-core        1668          7.33 GB/sec
    multi-core         3408          15.0 GB/sec

Benchmark Summary
  Integer Score              2875  50004
  Floating Point Score       2874  53458
  Memory Score               1558   2941

  Geekbench Score            2611  41973


Uploading results to the Geekbench Browser. This could take a minute or two 
depending on the speed of your internet connection.

Upload succeeded. Visit the following link and view your results online:



===========================================================================================

Stream memory bandwidth:


-------------------------------------------------------------
STREAM version $Revision: 5.10 $
-------------------------------------------------------------
This system uses 8 bytes per array element.
-------------------------------------------------------------
Array size = 10000000 (elements), Offset = 0 (elements)
Memory per array = 76.3 MiB (= 0.1 GiB).
Total memory required = 228.9 MiB (= 0.2 GiB).
Each kernel will be executed 10 times.
 The *best* time for each kernel (excluding the first iteration)
 will be used to compute the reported bandwidth.
-------------------------------------------------------------
Your clock granularity/precision appears to be 1 microseconds.
Each test below will take on the order of 14373 microseconds.
   (= 14373 clock ticks)
Increase the size of the arrays if this shows that
you are not getting at least 20 clock ticks per test.
-------------------------------------------------------------
WARNING -- The above is only a rough guideline.
For best results, please be sure you know the
precision of your system timer.
-------------------------------------------------------------
Function    Best Rate MB/s  Avg time     Min time     Max time
Copy:            8616.5     0.019736     0.018569     0.020443
Scale:           8382.6     0.019749     0.019087     0.020830
Add:             9234.3     0.026782     0.025990     0.027959
Triad:           9213.0     0.027221     0.026050     0.028266
-------------------------------------------------------------
Solution Validates: avg error less than 1.000000e-13 on all three arrays
-------------------------------------------------------------

===========================================================================================

LMbench L1 L2 L3 and Memory latency:


"stride=64
0.00049 1.397
0.00098 1.391
0.00195 1.392
0.00293 1.386
0.00391 1.387
0.00586 1.390
0.00781 1.395
0.01172 1.391
0.01562 1.396
0.02344 1.385
0.03125 1.390
0.04688 4.125
0.06250 4.146
0.09375 4.198
0.12500 4.262
0.18750 4.415
0.25000 4.595
0.37500 4.808
0.50000 4.859
0.75000 4.856
1.00000 4.815
1.50000 4.844
2.00000 4.832
3.00000 4.811
4.00000 4.826
6.00000 4.834
8.00000 4.843
12.00000 4.842
16.00000 4.857
24.00000 7.667
32.00000 13.180
48.00000 14.929
64.00000 15.333
96.00000 15.219
128.00000 15.111
192.00000 14.660
256.00000 14.447
384.00000 14.637
512.00000 14.576

===========================================================================================

Simple CPU performance (Single thread):
L3 cache:              30720K
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 2.37975 s, 451 MB/s
cd573cfaace07e7949bc0c46028904ff  -
===========================================================================================
Global network bandwidth:
PING vip1.g5.cachefly.net (205.234.175.175) 56(84) bytes of data.
64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=1 ttl=55 time=162 ms
64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=2 ttl=55 time=161 ms
64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=3 ttl=55 time=161 ms
64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=4 ttl=55 time=161 ms
64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=5 ttl=55 time=161 ms
--- vip1.g5.cachefly.net ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4167ms
rtt min/avg/max/mdev = 161.460/161.760/162.609/0.668 ms
traceroute to cachefly.cachefly.net (205.234.175.175), 30 hops max, 60 byte packets
 1  209.85.242.89 (209.85.242.89)  127.053 ms  127.098 ms  127.214 ms
 2  209.85.242.89 (209.85.242.89)  126.971 ms 64.233.174.176 (64.233.174.176)  127.942 ms 209.85.242.89 (209.85.242.89)  127.044 ms
 3  209.85.242.89 (209.85.242.89)  126.901 ms 64.233.174.176 (64.233.174.176)  127.824 ms  128.004 ms
 4  64.233.174.176 (64.233.174.176)  127.385 ms 209.85.242.89 (209.85.242.89)  127.235 ms 64.233.174.176 (64.233.174.176)  127.396 ms
 5  209.85.242.89 (209.85.242.89)  126.860 ms 64.233.174.176 (64.233.174.176)  127.946 ms 209.85.242.89 (209.85.242.89)  127.069 ms
 6  64.233.174.176 (64.233.174.176)  127.355 ms 209.85.242.89 (209.85.242.89)  130.012 ms 64.233.174.176 (64.233.174.176)  127.864 ms
 7  64.233.174.176 (64.233.174.176)  127.820 ms  127.844 ms 209.85.242.89 (209.85.242.89)  127.138 ms
 8  209.85.242.89 (209.85.242.89)  127.116 ms 64.233.174.176 (64.233.174.176)  127.778 ms  127.398 ms
 9  64.233.174.176 (64.233.174.176)  127.702 ms  127.690 ms  127.743 ms
10  64.233.174.176 (64.233.174.176)  127.968 ms  127.314 ms 209.85.242.89 (209.85.242.89)  127.039 ms
11  64.233.174.176 (64.233.174.176)  127.708 ms  127.284 ms 209.85.242.89 (209.85.242.89)  127.206 ms
12  209.85.242.89 (209.85.242.89)  126.640 ms  127.064 ms 64.233.174.176 (64.233.174.176)  127.696 ms
13  209.85.254.116 (209.85.254.116)  161.309 ms 209.85.254.118 (209.85.254.118)  161.459 ms  161.818 ms
14  66.249.95.199 (66.249.95.199)  161.481 ms 72.14.237.220 (72.14.237.220)  161.183 ms 66.249.95.199 (66.249.95.199)  161.465 ms
15  66.249.95.165 (66.249.95.165)  161.818 ms 209.85.142.213 (209.85.142.213)  161.914 ms  161.619 ms
16  ge5-0-6d0.cir1.dallas2-tx.us.xo.net (65.47.204.57)  161.786 ms  161.394 ms  161.823 ms
17  207.88.14.188.ptr.us.xo.net (207.88.14.188)  161.536 ms  161.650 ms  161.258 ms
18  207.88.14.183.ptr.us.xo.net (207.88.14.183)  162.372 ms  161.934 ms  162.427 ms
19  vip1.G-anycast1.cachefly.net (205.234.175.175)  161.802 ms  161.601 ms  161.595 ms
Download speed from CacheFly: 12.3MB/s 
Download speed from Coloat, Atlanta GA: 8.90MB/s 
Download speed from Softlayer, Dallas, TX: 10.2MB/s 
Download speed from Linode, Tokyo, JP: 46.3MB/s 
Download speed from i3d.net, Rotterdam, NL: 3.00MB/s
Download speed from Linode, London, UK: 7.77MB/s 
Download speed from Leaseweb, Haarlem, NL: 7.50MB/s 
Download speed from Softlayer, Singapore: 32.9MB/s 
Download speed from Softlayer, Seattle, WA: 13.6MB/s 
Download speed from Softlayer, San Jose, CA: 12.3MB/s 
Download speed from Softlayer, Washington, DC: 2.49MB/s 
===========================================================================================
Speedtest.net
Retrieving speedtest.net configuration...
Retrieving speedtest.net server list...
Testing from Google Cloud (104.155.228.172)...
Selecting best server based on latency...
Hosted by Tekify Broadband Internet Services (Fremont, CA) [20.22 km]: 148.254 ms
Testing download speed........................................
Download: 14.20 Mbit/s
Testing upload speed..................................................
Upload: 7.83 Mbit/s


===========================================================================================

dd Sequential IO performance:


mke2fs 1.41.12 (17-May-2010)
Discarding device blocks: done                            
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=1 blocks, Stripe width=0 blocks
65536000 inodes, 262144000 blocks
13107200 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=4294967296
8000 block groups
32768 blocks per group, 32768 fragments per group
8192 inodes per group
Superblock backups stored on blocks: 
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, 
        4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968, 
        102400000, 214990848

Writing inode tables: done                            
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 36 mounts or
180 days, whichever comes first.  Use tune2fs -c or -i to override.
dd Write performance:
10240+0 records in
10240+0 records out
10737418240 bytes (11 GB) copied, 47.2468 s, 227 MB/s

dd Read performance:
10240+0 records in
10240+0 records out
10737418240 bytes (11 GB) copied, 42.7721 s, 251 MB/s

===========================================================================================

fio Random 8K 70/30 qd=16:


8k7030test: (g=0): rw=randrw, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
...
fio-2.1.10
Starting 16 processes

8k7030test: (groupid=0, jobs=16): err= 0: pid=5393: Wed Dec 16 22:41:50 2015
  read : io=9840.6MB, bw=83962KB/s, iops=10494, runt=120015msec
    slat (usec): min=3, max=59322, avg=520.95, stdev=2790.31
    clat (msec): min=4, max=109, avg=16.18, stdev= 8.14
     lat (msec): min=4, max=109, avg=16.70, stdev= 8.22
    clat percentiles (usec):
     |  1.00th=[ 8032],  5.00th=[ 8384], 10.00th=[ 8640], 20.00th=[ 9152],
     | 30.00th=[ 9792], 40.00th=[10688], 50.00th=[11968], 60.00th=[16512],
     | 70.00th=[20352], 80.00th=[24704], 90.00th=[28032], 95.00th=[30336],
     | 99.00th=[38144], 99.50th=[43264], 99.90th=[55040], 99.95th=[60160],
     | 99.99th=[70144]
    bw (KB  /s): min=    1, max= 6672, per=6.23%, avg=5232.92, stdev=492.81
  write: io=4224.6MB, bw=36045KB/s, iops=4504, runt=120015msec
    slat (usec): min=4, max=50104, avg=532.33, stdev=2814.25
    clat (msec): min=5, max=108, avg=17.38, stdev= 8.41
     lat (msec): min=5, max=108, avg=17.91, stdev= 8.55
    clat percentiles (usec):
     |  1.00th=[ 8512],  5.00th=[ 8896], 10.00th=[ 9152], 20.00th=[ 9792],
     | 30.00th=[10560], 40.00th=[11584], 50.00th=[14144], 60.00th=[18304],
     | 70.00th=[22144], 80.00th=[25984], 90.00th=[29056], 95.00th=[31360],
     | 99.00th=[40704], 99.50th=[45824], 99.90th=[57088], 99.95th=[62208],
     | 99.99th=[71168]
    bw (KB  /s): min=    1, max= 3075, per=6.25%, avg=2253.38, stdev=219.46
    lat (msec) : 10=29.89%, 20=38.02%, 50=31.90%, 100=0.21%, 250=0.01%
  cpu          : usr=0.40%, sys=1.93%, ctx=843403, majf=0, minf=487
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=104.2%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1259442/w=540649/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: io=9840.6MB, aggrb=83962KB/s, minb=83962KB/s, maxb=83962KB/s, mint=120015msec, maxt=120015msec
  WRITE: io=4224.6MB, aggrb=36044KB/s, minb=36044KB/s, maxb=36044KB/s, mint=120015msec, maxt=120015msec

Disk stats (read/write):
  sdb: ios=1313152/562971, merge=0/0, ticks=13182617/5927838, in_queue=19109219, util=100.00%

===========================================================================================

fio Sequential read 1MB qd=32:


readbw: (g=0): rw=read, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
...
fio-2.1.10
Starting 4 processes

readbw: (groupid=0, jobs=4): err= 0: pid=5477: Wed Dec 16 22:43:56 2015
  read : io=28956MB, bw=246512KB/s, iops=239, runt=120282msec
    slat (msec): min=14, max=431, avg=265.97, stdev=27.77
    clat (usec): min=15, max=532270, avg=266311.31, stdev=26205.74
     lat (msec): min=231, max=798, avg=532.80, stdev=33.95
    clat percentiles (msec):
     |  1.00th=[  200],  5.00th=[  231], 10.00th=[  233], 20.00th=[  265],
     | 30.00th=[  265], 40.00th=[  265], 50.00th=[  265], 60.00th=[  269],
     | 70.00th=[  269], 80.00th=[  269], 90.00th=[  297], 95.00th=[  302],
     | 99.00th=[  363], 99.50th=[  396], 99.90th=[  429], 99.95th=[  433],
     | 99.99th=[  502]
    bw (KB  /s): min= 2975, max=78267, per=24.81%, avg=61169.65, stdev=5082.18
    lat (usec) : 20=0.01%, 50=0.01%
    lat (msec) : 250=18.36%, 500=81.84%, 750=0.01%
  cpu          : usr=0.02%, sys=0.68%, ctx=3972, majf=0, minf=2233
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.2%, 32=104.3%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=28832/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=28956MB, aggrb=246511KB/s, minb=246511KB/s, maxb=246511KB/s, mint=120282msec, maxt=120282msec

Disk stats (read/write):
  sdb: ios=121000/0, merge=0/0, ticks=18565524/0, in_queue=18575843, util=100.00%

===========================================================================================

fio Sequential write 1MB qd=32:


writebw: (g=0): rw=write, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
...
fio-2.1.10
Starting 4 processes

writebw: (groupid=0, jobs=4): err= 0: pid=5518: Wed Dec 16 22:46:02 2015
  write: io=28954MB, bw=246292KB/s, iops=239, runt=120381msec
    slat (msec): min=2, max=513, avg=263.46, stdev=41.93
    clat (usec): min=8, max=671986, avg=266737.58, stdev=51225.45
     lat (msec): min=182, max=984, avg=530.80, stdev=61.54
    clat percentiles (msec):
     |  1.00th=[  135],  5.00th=[  204], 10.00th=[  233], 20.00th=[  237],
     | 30.00th=[  265], 40.00th=[  265], 50.00th=[  269], 60.00th=[  269],
     | 70.00th=[  269], 80.00th=[  297], 90.00th=[  302], 95.00th=[  334],
     | 99.00th=[  441], 99.50th=[  515], 99.90th=[  562], 99.95th=[  570],
     | 99.99th=[  668]
    bw (KB  /s): min= 3013, max=90021, per=24.84%, avg=61173.23, stdev=6604.98
    lat (usec) : 10=0.01%, 20=0.68%, 50=0.07%, 250=0.01%, 500=0.01%
    lat (msec) : 20=0.01%, 250=28.11%, 500=70.70%, 750=0.64%
  cpu          : usr=1.98%, sys=0.60%, ctx=4378, majf=0, minf=116
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.2%, 32=104.2%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=99.9%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=28830/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=28954MB, aggrb=246292KB/s, minb=246292KB/s, maxb=246292KB/s, mint=120381msec, maxt=120381msec

Disk stats (read/write):
  sdb: ios=80/120957, merge=0/0, ticks=55/18826038, in_queue=18836575, util=100.00%

===========================================================================================

fio Random read 8K qd=16:


readiops: (g=0): rw=randread, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
...
fio-2.1.10
Starting 4 processes

readiops: (groupid=0, jobs=4): err= 0: pid=5580: Wed Dec 16 22:48:07 2015
  read : io=14063MB, bw=120003KB/s, iops=14999, runt=120005msec
    slat (usec): min=42, max=675, avg=106.17, stdev=48.22
    clat (usec): min=203, max=15458, avg=4145.36, stdev=736.97
     lat (usec): min=419, max=15525, avg=4252.23, stdev=724.62
    clat percentiles (usec):
     |  1.00th=[ 2544],  5.00th=[ 3024], 10.00th=[ 3184], 20.00th=[ 3536],
     | 30.00th=[ 3856], 40.00th=[ 4016], 50.00th=[ 4192], 60.00th=[ 4256],
     | 70.00th=[ 4448], 80.00th=[ 4704], 90.00th=[ 5024], 95.00th=[ 5280],
     | 99.00th=[ 6304], 99.50th=[ 6752], 99.90th=[ 7648], 99.95th=[ 7904],
     | 99.99th=[ 9024]
    bw (KB  /s): min=   25, max=30914, per=24.92%, avg=29901.47, stdev=1952.77
    lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.16%, 4=37.92%, 10=61.89%, 20=0.01%
  cpu          : usr=0.52%, sys=4.88%, ctx=1423529, majf=0, minf=243
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=104.2%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1800064/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: io=14063MB, aggrb=120003KB/s, minb=120003KB/s, maxb=120003KB/s, mint=120005msec, maxt=120005msec

Disk stats (read/write):
  sdb: ios=1876279/0, merge=0/0, ticks=6388139/0, in_queue=6387450, util=100.00%

===========================================================================================

fio Random write 8K qd=16:


writeiops: (g=0): rw=randwrite, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
...
fio-2.1.10
Starting 4 processes

writeiops: (groupid=0, jobs=4): err= 0: pid=5621: Wed Dec 16 22:50:13 2015
  write: io=14064MB, bw=120005KB/s, iops=15000, runt=120004msec
    slat (usec): min=47, max=1090, avg=114.01, stdev=44.49
    clat (usec): min=867, max=17886, avg=4128.02, stdev=730.34
     lat (usec): min=939, max=17991, avg=4242.39, stdev=721.24
    clat percentiles (usec):
     |  1.00th=[ 1848],  5.00th=[ 3024], 10.00th=[ 3664], 20.00th=[ 3984],
     | 30.00th=[ 4048], 40.00th=[ 4128], 50.00th=[ 4128], 60.00th=[ 4192],
     | 70.00th=[ 4192], 80.00th=[ 4256], 90.00th=[ 4384], 95.00th=[ 5280],
     | 99.00th=[ 6624], 99.50th=[ 7392], 99.90th=[ 9792], 99.95th=[10304],
     | 99.99th=[12736]
    bw (KB  /s): min=   25, max=31300, per=24.92%, avg=29899.49, stdev=1947.61
    lat (usec) : 1000=0.04%
    lat (msec) : 2=1.40%, 4=19.20%, 10=79.28%, 20=0.08%
  cpu          : usr=1.33%, sys=4.71%, ctx=1629693, majf=0, minf=110
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=104.2%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=1800080/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
  WRITE: io=14064MB, aggrb=120005KB/s, minb=120005KB/s, maxb=120005KB/s, mint=120004msec, maxt=120004msec

Disk stats (read/write):
  sdb: ios=79/1876369, merge=0/0, ticks=58/6711628, in_queue=6711148, util=100.00%

===========================================================================================

fio Write bandwidth - 1MB random write qd=32:


writebw: (g=0): rw=randwrite, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
...
fio-2.1.10
Starting 4 processes

writebw: (groupid=0, jobs=4): err= 0: pid=5675: Wed Dec 16 22:52:19 2015
  write: io=28924MB, bw=246260KB/s, iops=239, runt=120272msec
    slat (msec): min=1, max=446, avg=262.51, stdev=44.17
    clat (usec): min=7, max=743184, avg=268132.91, stdev=126236.72
     lat (msec): min=109, max=1065, avg=531.12, stdev=130.83
    clat percentiles (usec):
     |  1.00th=[   11],  5.00th=[   13], 10.00th=[26496], 20.00th=[232448],
     | 30.00th=[238592], 40.00th=[264192], 50.00th=[264192], 60.00th=[268288],
     | 70.00th=[292864], 80.00th=[301056], 90.00th=[440320], 95.00th=[528384],
     | 99.00th=[593920], 99.50th=[634880], 99.90th=[692224], 99.95th=[708608],
     | 99.99th=[741376]
    bw (KB  /s): min= 2939, max=83877, per=24.81%, avg=61090.22, stdev=6606.62
    lat (usec) : 10=0.27%, 20=8.80%, 50=0.47%, 100=0.02%, 250=0.05%
    lat (usec) : 500=0.02%
    lat (msec) : 4=0.01%, 10=0.06%, 20=0.14%, 50=0.34%, 100=0.13%
    lat (msec) : 250=23.52%, 500=59.15%, 750=7.26%
  cpu          : usr=1.96%, sys=0.55%, ctx=4607, majf=0, minf=112
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.2%, 32=104.3%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=28800/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=28924MB, aggrb=246259KB/s, minb=246259KB/s, maxb=246259KB/s, mint=120272msec, maxt=120272msec

Disk stats (read/write):
  sdb: ios=77/121590, merge=0/0, ticks=38/18713715, in_queue=18716559, util=100.00%

===========================================================================================

fio Read Max IOPS - 512 random read qd=32:


readiops: (g=0): rw=randread, bs=512-512/512-512/512-512, ioengine=libaio, iodepth=32
...
fio-2.1.10
Starting 4 processes

readiops: (groupid=0, jobs=4): err= 0: pid=5720: Wed Dec 16 22:54:24 2015
  read : io=900094KB, bw=7500.4KB/s, iops=14999, runt=120007msec
    slat (usec): min=25, max=1078, avg=41.67, stdev=21.24
    clat (usec): min=2474, max=16544, avg=8479.30, stdev=986.50
     lat (usec): min=2520, max=16597, avg=8520.88, stdev=983.21
    clat percentiles (usec):
     |  1.00th=[ 6240],  5.00th=[ 7136], 10.00th=[ 7264], 20.00th=[ 7392],
     | 30.00th=[ 8256], 40.00th=[ 8384], 50.00th=[ 8512], 60.00th=[ 8512],
     | 70.00th=[ 8640], 80.00th=[ 9536], 90.00th=[ 9664], 95.00th=[ 9792],
     | 99.00th=[10688], 99.50th=[11200], 99.90th=[11840], 99.95th=[12096],
     | 99.99th=[13504]
    bw (KB  /s): min=    1, max= 1936, per=24.91%, avg=1868.19, stdev=121.15
    lat (msec) : 4=0.02%, 10=97.48%, 20=2.51%
  cpu          : usr=0.58%, sys=3.42%, ctx=1586271, majf=0, minf=131
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.1%, 32=104.2%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1800064/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=900094KB, aggrb=7500KB/s, minb=7500KB/s, maxb=7500KB/s, mint=120007msec, maxt=120007msec

Disk stats (read/write):
  sdb: ios=1875972/0, merge=0/0, ticks=14869713/0, in_queue=14869848, util=100.00%

===========================================================================================

fio Raad bandwidth - 1MB random read qd=32:

readbw: (g=0): rw=randread, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
...
fio-2.1.10
Starting 4 processes
readbw: (groupid=0, jobs=4): err= 0: pid=5758: Wed Dec 16 22:56:30 2015
  read : io=28940MB, bw=246534KB/s, iops=239, runt=120205msec
    slat (msec): min=12, max=538, avg=265.74, stdev=36.35
    clat (usec): min=7, max=839371, avg=266710.69, stdev=134416.14
     lat (msec): min=133, max=1137, avg=533.00, stdev=138.75
    clat percentiles (usec):
     |  1.00th=[   13],  5.00th=[   15], 10.00th=[   17], 20.00th=[234496],
     | 30.00th=[264192], 40.00th=[264192], 50.00th=[264192], 60.00th=[268288],
     | 70.00th=[268288], 80.00th=[296960], 90.00th=[501760], 95.00th=[536576],
     | 99.00th=[569344], 99.50th=[602112], 99.90th=[700416], 99.95th=[700416],
     | 99.99th=[806912]
    bw (KB  /s): min= 2965, max=91872, per=24.84%, avg=61240.19, stdev=6314.03
    lat (usec) : 10=0.11%, 20=10.87%, 50=0.69%, 100=0.05%, 250=0.06%
    lat (usec) : 750=0.02%
    lat (msec) : 4=0.01%, 10=0.03%, 20=0.06%, 50=0.07%, 100=0.11%
    lat (msec) : 250=15.81%, 500=62.33%, 750=9.97%, 1000=0.04%
  cpu          : usr=0.02%, sys=0.60%, ctx=4091, majf=0, minf=2225
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.2%, 32=104.3%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=28816/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
   READ: io=28940MB, aggrb=246533KB/s, minb=246533KB/s, maxb=246533KB/s, mint=120205msec, maxt=120205msec
Disk stats (read/write):
  sdb: ios=120753/0, merge=0/0, ticks=18406250/0, in_queue=18418710, util=100.00%
===========================================================================================
fio Max Write IOPS - 512 random write qd=32:
writeiops: (g=0): rw=randwrite, bs=512-512/512-512/512-512, ioengine=libaio, iodepth=32
...
fio-2.1.10
Starting 4 processes
writeiops: (groupid=0, jobs=4): err= 0: pid=5798: Wed Dec 16 22:58:35 2015
  write: io=831054KB, bw=6924.1KB/s, iops=13848, runt=120009msec
    slat (usec): min=27, max=960, avg=67.69, stdev=38.24
    clat (msec): min=1, max=41, avg= 9.16, stdev= 2.66
     lat (msec): min=1, max=41, avg= 9.22, stdev= 2.65
    clat percentiles (usec):
     |  1.00th=[ 3920],  5.00th=[ 5216], 10.00th=[ 5920], 20.00th=[ 6880],
     | 30.00th=[ 7584], 40.00th=[ 8256], 50.00th=[ 8896], 60.00th=[ 9664],
     | 70.00th=[10432], 80.00th=[11328], 90.00th=[12736], 95.00th=[13888],
     | 99.00th=[16192], 99.50th=[17024], 99.90th=[19072], 99.95th=[20096],
     | 99.99th=[22656]
    bw (KB  /s): min=    1, max= 1916, per=24.92%, avg=1725.42, stdev=125.35
    lat (msec) : 2=0.01%, 4=1.19%, 10=63.88%, 20=34.88%, 50=0.05%
  cpu          : usr=0.81%, sys=4.57%, ctx=1251263, majf=0, minf=110
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.1%, 32=104.3%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=1661984/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
  WRITE: io=831054KB, aggrb=6924KB/s, minb=6924KB/s, maxb=6924KB/s, mint=120009msec, maxt=120009msec
Disk stats (read/write):
  sdb: ios=80/1729860, merge=0/0, ticks=51/14165193, in_queue=14165377, util=100.00%

No comments:

Post a Comment