Tuesday 15 September 2015

AWS EC2 T2 instances

http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/t2-instances.html
 

Sydney region costs in US$:

If at any moment a T2 instance does not need all of the CPU credits it receives, it stores the unused credits in its CPU credit balance for up to 24 hours. For example, if a t2.small had a CPU utilization of 5% for an hour, it would have used 3 CPU credits, but it would have earned 12 CPU credits during the hour, so the difference of 9 CPU credits would be added to the CPU credit balance. Credits earned 24 hours ago will expire, and any expired credits are removed from the CPU credit balance at that time. This means that if the amount of credits expired is greater than those earned, the credit balance will go down. If the baseline CPU performance isn't being used, the credit balance will eventually stop its decline and potentially grow, depending on how much CPU is needed in steady state.

The T2 credit system is designed so that if your workload doesn't on average use more than 20% of a single core over the course of 24 hours, for example, then a t2.small is a good fit. The same thing can be said for the t2.micro (10% of single core performance) and t2.medium (40% of single core performance). If your instance consistently does not maintain a positive CPU credit balance, then larger T2 size or a fixed performance instance is recommended.

See Cloudwatch metric CPUCreditBalance for current credit balance.

As a side note it appears T2 instances have good networking performance. This AWS forum post shows t2.medium with iperf performance of  4.48 Gb/sec.

Performance testing results:
CPU:
 
See detailed results here. Significantly faster (whilst there are credits) than some fixed performance AWS instances. Compare here

Network:
# iperf3 -c X.X.X.X
Connecting to host 172.31.129.157, port 5201
[  4] local Y.Y.Y.Y port 46987 connected to X.X.X.X port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec   123 MBytes  1.03 Gbits/sec  174    210 KBytes
[  4]   1.00-2.00   sec  97.6 MBytes   819 Mbits/sec  133    271 KBytes
[  4]   2.00-3.00   sec   120 MBytes  1.01 Gbits/sec  128    201 KBytes
[  4]   3.00-4.00   sec   121 MBytes  1.02 Gbits/sec  136    201 KBytes
[  4]   4.00-5.00   sec   121 MBytes  1.01 Gbits/sec  126    218 KBytes
[  4]   5.00-6.00   sec   119 MBytes   994 Mbits/sec  120    184 KBytes
[  4]   6.00-7.00   sec   122 MBytes  1.02 Gbits/sec  138    218 KBytes
[  4]   7.00-8.00   sec  96.6 MBytes   810 Mbits/sec  142    218 KBytes
[  4]   8.00-9.00   sec   108 MBytes   904 Mbits/sec  131    122 KBytes
[  4]   9.00-10.00  sec  85.9 MBytes   721 Mbits/sec  160    175 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  1.09 GBytes   934 Mbits/sec  1388             sender
[  4]   0.00-10.00  sec  1.09 GBytes   932 Mbits/sec                  receiver

iperf Done.

Disk IO (on 100GB gp2 EBS volume):
dd Write performance:
10240+0 records in
10240+0 records out
10737418240 bytes (11 GB) copied, 170.936 s, 62.8 MB/s

dd Read performance:
10240+0 records in
10240+0 records out
10737418240 bytes (11 GB) copied, 171.809 s, 62.5 MB/s

===========================================================================================

fio Random 8K 70/30 qd=16:


8k7030test: (g=0): rw=randrw, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
...
8k7030test: (g=0): rw=randrw, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
fio-2.1.5
Starting 16 processes

8k7030test: (groupid=0, jobs=16): err= 0: pid=14968: Wed Sep 16 11:24:00 2015
  read : io=1973.2MB, bw=16827KB/s, iops=2101, runt=120070msec
    slat (usec): min=1, max=90996, avg=2633.13, stdev=11288.93
    clat (msec): min=21, max=176, avg=82.16, stdev=20.90
     lat (msec): min=21, max=176, avg=84.79, stdev=18.96
    clat percentiles (msec):
     |  1.00th=[   43],  5.00th=[   43], 10.00th=[   44], 20.00th=[   48],
     | 30.00th=[   86], 40.00th=[   86], 50.00th=[   91], 60.00th=[   91],
     | 70.00th=[   96], 80.00th=[   96], 90.00th=[  101], 95.00th=[  106],
     | 99.00th=[  113], 99.50th=[  114], 99.90th=[  130], 99.95th=[  139],
     | 99.99th=[  163]
    bw (KB  /s): min=    1, max= 1733, per=6.23%, avg=1047.97, stdev=150.16
  write: io=862512KB, bw=7183.5KB/s, iops=897, runt=120070msec
    slat (usec): min=1, max=79438, avg=2725.45, stdev=11473.82
    clat (msec): min=22, max=176, avg=83.82, stdev=19.64
     lat (msec): min=27, max=186, avg=86.55, stdev=20.22
    clat percentiles (msec):
     |  1.00th=[   43],  5.00th=[   44], 10.00th=[   46], 20.00th=[   79],
     | 30.00th=[   86], 40.00th=[   87], 50.00th=[   91], 60.00th=[   91],
     | 70.00th=[   96], 80.00th=[   97], 90.00th=[  101], 95.00th=[  106],
     | 99.00th=[  113], 99.50th=[  115], 99.90th=[  130], 99.95th=[  141],
     | 99.99th=[  161]
    bw (KB  /s): min=    1, max=  812, per=6.25%, avg=448.83, stdev=85.50
    lat (msec) : 50=20.13%, 100=64.99%, 250=14.95%
  cpu          : usr=0.08%, sys=0.12%, ctx=95328, majf=0, minf=425
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=104.2%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=252376/w=107755/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: io=1973.2MB, aggrb=16827KB/s, minb=16827KB/s, maxb=16827KB/s, mint=120070msec, maxt=120070msec
  WRITE: io=862512KB, aggrb=7183KB/s, minb=7183KB/s, maxb=7183KB/s, mint=120070msec, maxt=120070msec

Disk stats (read/write):
  xvdf: ios=263120/112254, merge=4/0, ticks=12003240/5177232, in_queue=17183488, util=100.00%

===========================================================================================

fio Sequential read 1MB qd=32:


readbw: (g=0): rw=read, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
...
readbw: (g=0): rw=read, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
fio-2.1.5
Starting 4 processes

readbw: (groupid=0, jobs=4): err= 0: pid=20374: Wed Sep 16 11:26:07 2015
  read : io=7324.0MB, bw=62192KB/s, iops=59, runt=120591msec
    slat (msec): min=188, max=1419, avg=1057.61, stdev=110.74
    clat (usec): min=7, max=2174.9K, avg=1061544.90, stdev=102755.09
     lat (msec): min=495, max=3235, avg=2129.69, stdev=150.73
    clat percentiles (msec):
     |  1.00th=[  302],  5.00th=[ 1012], 10.00th=[ 1020], 20.00th=[ 1037],
     | 30.00th=[ 1045], 40.00th=[ 1057], 50.00th=[ 1074], 60.00th=[ 1090],
     | 70.00th=[ 1090], 80.00th=[ 1106], 90.00th=[ 1123], 95.00th=[ 1123],
     | 99.00th=[ 1156], 99.50th=[ 1156], 99.90th=[ 1418], 99.95th=[ 1418],
     | 99.99th=[ 2180]
    bw (KB  /s): min= 2289, max=48330, per=24.59%, avg=15292.74, stdev=2144.25
    lat (usec) : 10=0.01%
    lat (msec) : 500=1.33%, 750=0.44%, 1000=1.11%, 2000=97.97%, >=2000=0.01%
  cpu          : usr=0.00%, sys=0.10%, ctx=1944, majf=0, minf=32878
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.9%, 32=104.7%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=7200/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7324.0MB, aggrb=62191KB/s, minb=62191KB/s, maxb=62191KB/s, mint=120591msec, maxt=120591msec

Disk stats (read/write):
  xvdf: ios=60718/0, merge=0/0, ticks=18116664/0, in_queue=18131372, util=100.00%

===========================================================================================

fio Sequential write 1MB qd=32:


writebw: (g=0): rw=write, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
...
writebw: (g=0): rw=write, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
fio-2.1.5
Starting 4 processes

writebw: (groupid=0, jobs=4): err= 0: pid=25709: Wed Sep 16 11:28:14 2015
  write: io=7420.0MB, bw=62903KB/s, iops=60, runt=120791msec
    slat (usec): min=704, max=1113.6K, avg=1053309.81, stdev=50027.61
    clat (msec): min=264, max=1113, avg=1050.36, stdev=69.50
     lat (msec): min=1320, max=2170, avg=2106.80, stdev=73.91
    clat percentiles (msec):
     |  1.00th=[  996],  5.00th=[ 1057], 10.00th=[ 1057], 20.00th=[ 1057],
     | 30.00th=[ 1057], 40.00th=[ 1057], 50.00th=[ 1057], 60.00th=[ 1057],
     | 70.00th=[ 1057], 80.00th=[ 1057], 90.00th=[ 1057], 95.00th=[ 1057],
     | 99.00th=[ 1057], 99.50th=[ 1074], 99.90th=[ 1106], 99.95th=[ 1106],
     | 99.99th=[ 1106]
    bw (KB  /s): min= 2593, max=16516, per=24.48%, avg=15397.51, stdev=1206.70
    lat (msec) : 500=0.88%, 1000=0.66%, 2000=99.34%
  cpu          : usr=0.11%, sys=0.04%, ctx=1934, majf=0, minf=102
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.9%, 32=103.7%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=7296/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=7420.0MB, aggrb=62902KB/s, minb=62902KB/s, maxb=62902KB/s, mint=120791msec, maxt=120791msec

Disk stats (read/write):
  xvdf: ios=182/61006, merge=0/0, ticks=52/18052004, in_queue=18064676, util=100.00%

===========================================================================================

fio Random read 8K qd=16:


readiops: (g=0): rw=randread, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
...
readiops: (g=0): rw=randread, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
fio-2.1.5
Starting 4 processes

readiops: (groupid=0, jobs=4): err= 0: pid=31088: Wed Sep 16 11:30:19 2015
  read : io=2813.3MB, bw=24003KB/s, iops=2999, runt=120016msec
    slat (usec): min=20, max=208, avg=33.12, stdev= 6.39
    clat (usec): min=9615, max=34942, avg=21288.15, stdev=483.18
     lat (usec): min=9663, max=34980, avg=21321.32, stdev=482.71
    clat percentiles (usec):
     |  1.00th=[20352],  5.00th=[21120], 10.00th=[21120], 20.00th=[21120],
     | 30.00th=[21376], 40.00th=[21376], 50.00th=[21376], 60.00th=[21376],
     | 70.00th=[21376], 80.00th=[21376], 90.00th=[21376], 95.00th=[21376],
     | 99.00th=[22144], 99.50th=[23168], 99.90th=[26752], 99.95th=[28288],
     | 99.99th=[30336]
    bw (KB  /s): min=   25, max= 6119, per=24.92%, avg=5980.16, stdev=389.69
    lat (msec) : 10=0.01%, 20=0.73%, 50=99.27%
  cpu          : usr=0.27%, sys=0.72%, ctx=373654, majf=0, minf=232
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=104.3%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=360032/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: io=2813.3MB, aggrb=24002KB/s, minb=24002KB/s, maxb=24002KB/s, mint=120016msec, maxt=120016msec

Disk stats (read/write):
  xvdf: ios=375274/0, merge=0/0, ticks=6984708/0, in_queue=6984996, util=99.99%

===========================================================================================

fio Random write 8K qd=16:


writeiops: (g=0): rw=randwrite, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
...
writeiops: (g=0): rw=randwrite, bs=8K-8K/8K-8K/8K-8K, ioengine=libaio, iodepth=16
fio-2.1.5
Starting 4 processes

writeiops: (groupid=0, jobs=4): err= 0: pid=2977: Wed Sep 16 11:32:24 2015
  write: io=2813.4MB, bw=24003KB/s, iops=2999, runt=120022msec
    slat (usec): min=19, max=309, avg=34.93, stdev= 7.50
    clat (msec): min=6, max=35, avg=21.28, stdev= 1.49
     lat (msec): min=6, max=35, avg=21.32, stdev= 1.49
    clat percentiles (usec):
     |  1.00th=[15168],  5.00th=[20608], 10.00th=[20864], 20.00th=[21120],
     | 30.00th=[21120], 40.00th=[21376], 50.00th=[21376], 60.00th=[21376],
     | 70.00th=[21376], 80.00th=[21376], 90.00th=[21632], 95.00th=[22144],
     | 99.00th=[27520], 99.50th=[29824], 99.90th=[32640], 99.95th=[33536],
     | 99.99th=[35072]
    bw (KB  /s): min=   25, max= 6177, per=24.91%, avg=5980.04, stdev=390.40
    lat (msec) : 10=0.12%, 20=3.15%, 50=96.73%
  cpu          : usr=0.25%, sys=0.77%, ctx=372239, majf=0, minf=99
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=104.3%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=360048/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
  WRITE: io=2813.4MB, aggrb=24002KB/s, minb=24002KB/s, maxb=24002KB/s, mint=120022msec, maxt=120022msec

Disk stats (read/write):
  xvdf: ios=91/375263, merge=0/1, ticks=28/7113472, in_queue=7113932, util=100.00%

===========================================================================================

fio Write bandwidth - 1MB random write qd=32:


writebw: (g=0): rw=randwrite, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
...
writebw: (g=0): rw=randwrite, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
fio-2.1.5
Starting 4 processes

writebw: (groupid=0, jobs=4): err= 0: pid=8387: Wed Sep 16 11:34:31 2015
  write: io=7420.0MB, bw=62869KB/s, iops=60, runt=120855msec
    slat (usec): min=712, max=1263.6K, avg=1052920.14, stdev=52823.67
    clat (msec): min=263, max=1263, avg=1049.96, stdev=71.62
     lat (msec): min=1114, max=2320, avg=2106.00, stdev=81.63
    clat percentiles (msec):
     |  1.00th=[  799],  5.00th=[ 1057], 10.00th=[ 1057], 20.00th=[ 1057],
     | 30.00th=[ 1057], 40.00th=[ 1057], 50.00th=[ 1057], 60.00th=[ 1057],
     | 70.00th=[ 1057], 80.00th=[ 1057], 90.00th=[ 1057], 95.00th=[ 1057],
     | 99.00th=[ 1057], 99.50th=[ 1123], 99.90th=[ 1270], 99.95th=[ 1270],
     | 99.99th=[ 1270]
    bw (KB  /s): min= 2592, max=20608, per=24.51%, avg=15407.54, stdev=1240.05
    lat (msec) : 500=0.88%, 1000=1.75%, 2000=98.25%
  cpu          : usr=0.11%, sys=0.04%, ctx=1940, majf=0, minf=98
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.9%, 32=103.7%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=7296/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=7420.0MB, aggrb=62869KB/s, minb=62869KB/s, maxb=62869KB/s, mint=120855msec, maxt=120855msec

Disk stats (read/write):
  xvdf: ios=91/61008, merge=0/0, ticks=28/18057880, in_queue=18070080, util=100.00%

===========================================================================================

fio Read Max IOPS - 512 random read qd=32:


readiops: (g=0): rw=randread, bs=512-512/512-512/512-512, ioengine=libaio, iodepth=32
...
readiops: (g=0): rw=randread, bs=512-512/512-512/512-512, ioengine=libaio, iodepth=32
fio-2.1.5
Starting 4 processes

readiops: (groupid=0, jobs=4): err= 0: pid=14753: Wed Sep 16 11:36:36 2015
  read : io=180094KB, bw=1500.4KB/s, iops=2999, runt=120038msec
    slat (usec): min=19, max=316, avg=31.17, stdev= 5.92
    clat (usec): min=32974, max=56471, avg=42623.00, stdev=502.40
     lat (usec): min=33004, max=56503, avg=42654.12, stdev=502.09
    clat percentiles (usec):
     |  1.00th=[41728],  5.00th=[42240], 10.00th=[42240], 20.00th=[42752],
     | 30.00th=[42752], 40.00th=[42752], 50.00th=[42752], 60.00th=[42752],
     | 70.00th=[42752], 80.00th=[42752], 90.00th=[42752], 95.00th=[42752],
     | 99.00th=[43776], 99.50th=[44800], 99.90th=[48384], 99.95th=[49408],
     | 99.99th=[51456]
    bw (KB  /s): min=    1, max=  379, per=24.89%, avg=373.39, stdev=24.37
    lat (msec) : 50=99.98%, 100=0.04%
  cpu          : usr=0.00%, sys=1.00%, ctx=372385, majf=0, minf=120
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.1%, 32=104.3%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=360064/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=180094KB, aggrb=1500KB/s, minb=1500KB/s, maxb=1500KB/s, mint=120038msec, maxt=120038msec

Disk stats (read/write):
  xvdf: ios=375232/0, merge=0/0, ticks=14990608/0, in_queue=14993164, util=99.98%

===========================================================================================

fio Read bandwidth - 1MB random read qd=32:


readbw: (g=0): rw=randread, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
...
readbw: (g=0): rw=randread, bs=1M-1M/1M-1M/1M-1M, ioengine=libaio, iodepth=32
fio-2.1.5
Starting 4 processes

readbw: (groupid=0, jobs=4): err= 0: pid=19765: Wed Sep 16 11:38:43 2015
  read : io=7356.0MB, bw=62454KB/s, iops=59, runt=120610msec
    slat (msec): min=38, max=1244, avg=1052.64, stdev=117.63
    clat (msec): min=275, max=1231, avg=1057.27, stdev=103.60
     lat (msec): min=1005, max=2359, avg=2121.36, stdev=143.28
    clat percentiles (msec):
     |  1.00th=[  449],  5.00th=[ 1004], 10.00th=[ 1020], 20.00th=[ 1029],
     | 30.00th=[ 1057], 40.00th=[ 1074], 50.00th=[ 1074], 60.00th=[ 1090],
     | 70.00th=[ 1090], 80.00th=[ 1106], 90.00th=[ 1123], 95.00th=[ 1123],
     | 99.00th=[ 1139], 99.50th=[ 1156], 99.90th=[ 1237], 99.95th=[ 1237],
     | 99.99th=[ 1237]
    bw (KB  /s): min= 2347, max=32768, per=24.56%, avg=15338.31, stdev=1874.89
    lat (msec) : 500=1.55%, 750=0.88%, 1000=1.77%, 2000=96.68%
  cpu          : usr=0.01%, sys=0.09%, ctx=1947, majf=0, minf=32874
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.9%, 32=104.9%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=7232/w=0/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7356.0MB, aggrb=62453KB/s, minb=62453KB/s, maxb=62453KB/s, mint=120610msec, maxt=120610msec

Disk stats (read/write):
  xvdf: ios=61167/0, merge=0/0, ticks=18087120/0, in_queue=18090480, util=99.99%

===========================================================================================

fio Max Write IOPS - 512 random write qd=32:


writeiops: (g=0): rw=randwrite, bs=512-512/512-512/512-512, ioengine=libaio, iodepth=32
...
writeiops: (g=0): rw=randwrite, bs=512-512/512-512/512-512, ioengine=libaio, iodepth=32
fio-2.1.5
Starting 4 processes

writeiops: (groupid=0, jobs=4): err= 0: pid=25391: Wed Sep 16 11:40:48 2015
  write: io=180086KB, bw=1500.4KB/s, iops=2999, runt=120031msec
    slat (usec): min=19, max=326, avg=33.17, stdev= 7.13
    clat (msec): min=20, max=78, avg=42.62, stdev= 1.51
     lat (msec): min=20, max=78, avg=42.65, stdev= 1.51
    clat percentiles (usec):
     |  1.00th=[40192],  5.00th=[41728], 10.00th=[42240], 20.00th=[42240],
     | 30.00th=[42240], 40.00th=[42752], 50.00th=[42752], 60.00th=[42752],
     | 70.00th=[42752], 80.00th=[42752], 90.00th=[43264], 95.00th=[43776],
     | 99.00th=[45312], 99.50th=[48896], 99.90th=[58624], 99.95th=[61696],
     | 99.99th=[76288]
    bw (KB  /s): min=    1, max=  392, per=24.89%, avg=373.38, stdev=24.39
    lat (msec) : 50=99.65%, 100=0.37%
  cpu          : usr=0.27%, sys=0.71%, ctx=368012, majf=0, minf=99
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.1%, 32=104.3%, >=64=0.0%
     submit    : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=360048/d=0, short=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=180086KB, aggrb=1500KB/s, minb=1500KB/s, maxb=1500KB/s, mint=120031msec, maxt=120031msec

Disk stats (read/write):
  xvdf: ios=182/375265, merge=0/0, ticks=72/14982308, in_queue=14984580, util=100.00%

CPUCreditBalance:
$ aws cloudwatch get-metric-statistics --metric-name CPUCreditBalance --start-time `date --date="15 days ago" +'%Y-%m-%dT%H:%M:00'` --end-time `date  +'%Y-%m-%dT%H:%M:00'` --period 900 --namespace AWS/EC2                --statistics Maximum --dimensions Name=InstanceId,Value=i-db8d5aaa |  jq -r  '.Datapoints[] | "\(.Timestamp),\(.Maximum)"' 2>/dev/null | sort | tail -20
2015-09-15T05:32:00Z,416.55
2015-09-15T05:47:00Z,417.82
2015-09-15T06:02:00Z,418.82
2015-09-15T06:17:00Z,420.13
2015-09-15T06:32:00Z,421.09
2015-09-15T06:47:00Z,421.19
2015-09-15T07:02:00Z,420.23
2015-09-15T07:17:00Z,419.06
2015-09-15T07:32:00Z,416.76
2015-09-15T07:47:00Z,416.16 <-- Stopped instance
2015-09-15T22:32:00Z,61.94  <-- Started instance
2015-09-15T22:47:00Z,67.9
2015-09-15T23:02:00Z,70.65
2015-09-15T23:17:00Z,73.28
2015-09-15T23:32:00Z,74.95
2015-09-15T23:47:00Z,76.55
2015-09-16T00:02:00Z,77.9
2015-09-16T00:17:00Z,76.92
2015-09-16T00:32:00Z,78.86
2015-09-16T00:47:00Z,80.04

*Please note CPUCreditUsage and CPUCreditBalance are reported at 5 minute interval

No comments:

Post a Comment