Zoran's Blog: Cloudbench

https://github.com/zorangagic/cloudbench

Benchmark for RH/Centos/Amazon Linux to test:

CPU
Memory bandwidth
L1/L2/L3/Memory latency
Network bandwidth: Global and Australian
Storage sequential performance
Storage random IOPS performance
Network bandwidth for local network (iperf installed will need to run manually)

WARNING: Note that the write tests will destroy any data that currently resides on the last device as reported by fdisk

git clone https://github.com/zorangagic/cloudbench.git

cd cloudbench
vi cloudbench.sh - enter your Geekbench licence key if you have it

bash cloudbench.sh

Happy benchmarking! :)

!/bin/bash

(
yum -y install fio git iperf gcc sysstat libX11-devel mesa-libGL-devel perl-Time-HiRes

EC2_nstancetype="`wget -q -O - http://169.254.169.254/latest/meta-data/instance-type || die \"wget nstance-type has failed: $?\"`"
echo "AWS instance type: " $EC2_nstancetype

# Geekbench
echo -e "\n\nGeekbench - CPU / Memory bandwidth:"
wget http://geekbench.s3.amazonaws.com/Geekbench-3.1.2-Linux.tar.gz
tar -vxzf Geekbench-3.1.2-Linux.tar.gz
dist/Geekbench-3.1.2-Linux/geekbench_x86_64 -r zorang@gmail.com secret-key
dist/Geekbench-3.1.2-Linux/geekbench_x86_64 --upload

# UNIXBench
echo -e "\n\nUNIXbench - CPU / Memory bandwidth:"
wget -c http://byte-unixbench.googlecode.com/files/unixbench-5.1.3.tgz
tar xvzf unixbench-5.1.3.tgz
cd unixbench-5.1.3
make
./Run
cd ..

# Latency test
echo -e "\n\n==================================================================================================================\n\nLMbench L1 L2 L3 and Memory latency:\n\n"
git clone https://github.com/dmonakhov/lmbench.git
cd lmbench
make
bin/*/lat_mem_rd 512
cd ..

# Simple CPU test
echo -e "\n\n==================================================================================================================\n\nSimple CPU performance:\n\n"
dd if=/dev/zero bs=1M count=1024 | md5sum

# Network Bandwidth test
echo -e "\n\n==================================================================================================================\n\nGlobal network bandwidth:\n\n"
wget freevps.us/downloads/bench.sh -O - -o /dev/null|bash

# Network Bandwidth test to local Australian site
echo -e "\n\n==================================================================================================================\n\nAustralian network bandwidth:\n\n"
wget http://mirror.internode.on.net/pub/centos/7.1.1503/isos/x86_64/CentOS-7-x86_64-Minimal-1503-01.iso

# Sequential IO test
echo -e "\n\n==================================================================================================================\n\ndd Sequiential IO performance:\n\n"
d=`fdisk -l | grep Disk | grep -v identifier | tail -1 | cut -d' ' -f2 | cut -d':' -f1`
mkfs.ext4 -F $d
mount $d /mnt
cd /mnt
dd if=/dev/zero of=tempfile bs=1M count=10240 conv=fdatasync,notrunc
echo 3 > /proc/sys/vm/drop_caches
dd if=tempfile of=/dev/null bs=1M count=10240
cd /
umount /mnt

# fio IO test
echo -e "\n\n==================================================================================================================\n\nfio Random 8K 70/30 qd=16:\n\n"
fio --filename=$d --direct=1 --rw=randrw --refill_buffers --norandommap --ioengine=libaio --bs=8k --rwmixread=70 --iodepth=16 --numjobs=16 --runtime=120 --ramp_time=5 --group_reporting --name=8k7030test

echo -e "\n\n==================================================================================================================\n\nfio Sequential read 1MB qd=32:\n\n"
fio --name=readbw --filename=$d --direct=1 --rw=read  --bs=1m --numjobs=4 --iodepth=32 --direct=1 --iodepth_batch=16 --iodepth_batch_complete=16 --runtime=120 --ramp_time=5 --norandommap --time_based --ioengine=libaio --group_reporting

echo -e "\n\n==================================================================================================================\n\nfio Sequential write 1MB qd=32:\n\n"
fio --name=writebw --filename=$d --direct=1 --rw=write  --bs=1m --numjobs=4 --iodepth=32 --direct=1 --iodepth_batch=16 --iodepth_batch_complete=16 --runtime=120 --ramp_time=5 --norandommap --time_based --ioengine=libaio --group_reporting

echo -e "\n\n==================================================================================================================\n\nfio Random read 8K qd=16:\n\n"
fio --name=readiops --filename=$d --direct=1 --rw=randread --bs=8k --numjobs=4 --iodepth=16 --direct=1 --iodepth_batch=16 --iodepth_batch_complete=16 --runtime=120 --ramp_time=5 --norandommap --time_based --ioengine=libaio --group_reporting

echo -e "\n\n==================================================================================================================\n\nfio Random write 8K qd=16:\n\n"
fio --name=writeiops --filename=$d --direct=1 --rw=randwrite --bs=8k --numjobs=4 --iodepth=16 --direct=1 --iodepth_batch=16 --iodepth_batch_complete=16 --runtime=120 --ramp_time=5 --norandommap --time_based --ioengine=libaio --group_reporting

echo -e "\n\n==================================================================================================================\n\nfio Write bandwidth - 1MB random write qd=32:\n\n"
fio --name=writebw --filename=$d --direct=1 --rw=randwrite --bs=1m --numjobs=4 --iodepth=32 --direct=1 --iodepth_batch=16 --iodepth_batch_complete=16 --runtime=120 --ramp_time=5 --norandommap --time_based --ioengine=libaio --group_reporting

echo -e "\n\n==================================================================================================================\n\nfio Read Max IOPS - 512 random read qd=32:\n\n"
fio --name=readiops --filename=$d --direct=1 --rw=randread --bs=512 --numjobs=4 --iodepth=32 --direct=1 --iodepth_batch=16 --iodepth_batch_complete=16 --runtime=120 --ramp_time=5 --norandommap --time_based --ioengine=libaio --group_reporting

echo -e "\n\n==================================================================================================================\n\nfio Raed bandwidth - 1MB random read qd=32:\n\n"
fio --name=readbw --filename=$d --direct=1 --rw=randread --bs=1m --numjobs=4 --iodepth=32 --direct=1 --iodepth_batch=16 --iodepth_batch_complete=16 --runtime=120 --ramp_time=5 --norandommap --time_based --ioengine=libaio --group_reporting

echo -e "\n\n==================================================================================================================\n\nfio Max Write IOPS - 512 random write qd=32:\n\n"
fio --name=writeiops --filename=$d --direct=1 --rw=randwrite --bs=512 --numjobs=4 --iodepth=32 --direct=1 --iodepth_batch=16 --iodepth_batch_complete=16 --runtime=120 --ramp_time=5 --norandommap --time_based --ioengine=libaio --group_reporting

) 2>&1  | tee cloudbench.out

Results from AWS EC2 instance r3.8xlarge with 16TB EBS General SSD:

Geekbench 3.1.2 : http://www.primatelabs.com/geekbench/

System Information

Operating System Linux 3.14.35-28.38.amzn1.x86_64 x86_64

Model Xen HVM domU

Motherboard N/A

Processor Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz @ 2.50 GHz

2 Processors, 16 Cores, 32 Threads

Processor ID GenuineIntel Family 6 Model 62 Stepping 4

L1 Instruction Cache 32.0 KB x 8

L1 Data Cache 32.0 KB x 8

L2 Cache 256 KB x 8

L3 Cache 25.0 MB

Memory 240 GB

BIOS Xen 4.2.amazon

Compiler Clang 3.3 (tags/RELEASE_33/final)

Integer

AES

single-core 2460 2.11 GB/sec

multi-core 30045 25.7 GB/sec

Twofish

single-core 2534 142.2 MB/sec

multi-core 55484 3.04 GB/sec

SHA1

single-core 2940 319.2 MB/sec

multi-core 47856 5.07 GB/sec

SHA2

single-core 3239 140.2 MB/sec

multi-core 49091 2.07 GB/sec

BZip2 Compress

single-core 2371 9.64 MB/sec

multi-core 48574 197.4 MB/sec

BZip2 Decompress

single-core 2346 12.7 MB/sec

multi-core 48270 261.6 MB/sec

JPEG Compress

single-core 2610 36.4 Mpixels/sec

multi-core 55008 766.3 Mpixels/sec

JPEG Decompress

single-core 3681 91.0 Mpixels/sec

multi-core 64392 1.59 Gpixels/sec

PNG Compress

single-core 2523 2.01 Mpixels/sec

multi-core 54609 43.6 Mpixels/sec

PNG Decompress

single-core 2717 31.3 Mpixels/sec

multi-core 54390 627.1 Mpixels/sec

Sobel

single-core 3481 126.7 Mpixels/sec

multi-core 59092 2.15 Gpixels/sec

Lua

single-core 2753 2.47 MB/sec

multi-core 51219 46.0 MB/sec

Dijkstra

single-core 2443 8.77 Mpairs/sec

multi-core 30164 108.2 Mpairs/sec

Floating Point

BlackScholes

single-core 2216 9.86 Mnodes/sec

multi-core 44971 200.1 Mnodes/sec

Mandelbrot

single-core 2511 2.57 Gflops

multi-core 66271 67.9 Gflops

Sharpen Filter

single-core 2269 1.68 Gflops

multi-core 45874 34.0 Gflops

Blur Filter

single-core 1862 1.77 Gflops

multi-core 42108 40.1 Gflops

SGEMM

single-core 3553 9.95 Gflops

multi-core 55728 156.1 Gflops

DGEMM

single-core 3295 4.84 Gflops

multi-core 53890 79.2 Gflops

SFFT

single-core 2567 2.71 Gflops

multi-core 38969 41.1 Gflops

DFFT

single-core 2758 2.51 Gflops

multi-core 45724 41.6 Gflops

N-Body

single-core 4241 1.57 Mpairs/sec

multi-core 70874 26.3 Mpairs/sec

Ray Trace

single-core 3389 4.00 Mpixels/sec

multi-core 64555 76.1 Mpixels/sec

Memory

Stream Copy

single-core 1999 7.97 GB/sec

multi-core 6084 24.3 GB/sec

Stream Scale

single-core 2763 11.0 GB/sec

multi-core 6320 25.2 GB/sec

Stream Add

single-core 2523 11.4 GB/sec

multi-core 6443 29.1 GB/sec

Stream Triad

single-core 2595 11.4 GB/sec

multi-core 7490 32.9 GB/sec

Benchmark Summary

Integer Score 2747 48765

Floating Point Score 2784 51868

Memory Score 2452 6563

Geekbench Score 2702 41565

Uploading results to the Geekbench Browser. This could take a minute or two

depending on the speed of your internet connection.

Upload succeeded. Visit the following link and view your results online:

http://browser.primatelabs.com/geekbench3/2706716

==================================================================================================================

UNIXbench:

# # # # # # # ##### ###### # # #### # #

# # ## # # # # # # # ## # # # # #

# # # # # # ## ##### ##### # # # # ######

# # # # # # ## # # # # # # # # #

# # # ## # # # # # # # ## # # # #

#### # # # # # ##### ###### # # #### # #

Version 5.1.3 Based on the Byte Magazine Unix Benchmark

Multi-CPU version Version 5 revisions by Ian Smith,

Sunnyvale, CA, USA

January 13, 2011 johantheghost at yahoo period com

1 x Dhrystone 2 using register variables 1 2 3 4 5 6 7 8 9 10

1 x Double-Precision Whetstone 1 2 3 4 5 6 7 8 9 10

1 x Execl Throughput 1 2 3

1 x File Copy 1024 bufsize 2000 maxblocks 1 2 3

1 x File Copy 256 bufsize 500 maxblocks 1 2 3

1 x File Copy 4096 bufsize 8000 maxblocks 1 2 3

1 x Pipe Throughput 1 2 3 4 5 6 7 8 9 10

1 x Pipe-based Context Switching 1 2 3 4 5 6 7 8 9 10

1 x Process Creation 1 2 3

1 x System Call Overhead 1 2 3 4 5 6 7 8 9 10

1 x Shell Scripts (1 concurrent) 1 2 3

1 x Shell Scripts (8 concurrent) 1 2 3

========================================================================

BYTE UNIX Benchmarks (Version 5.1.3)

System: ip-172-27-3-134: GNU/Linux

OS: GNU/Linux -- 3.14.35-28.38.amzn1.x86_64 -- #1 SMP Wed Mar 11 22:50:37 UTC 2015

Machine: x86_64 (x86_64)

Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")

CPU 0: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz (5000.1 bogomips)