Benchmarks are run nightly using pebble
bench ycsb on AWS machines equipped with local SSD
storage. The AWS instances show remarkably high instance
to instance performance variability. In order to smooth
out that variability the benchmarks are run multiple
times each (using different instances) and outliers are
excluded.
This benchmark attempts to find the optimal write throughput by
driving more and more load against the DB until a target heuristic
fails (currently a mixture of number of L0 sublevels, L0 files, and
whether the DB has experienced a write stall). These benchmarks are
run nightly using pebble
bench write on GCP n2-standard-32 machines equipped with 16 local
SSDs in a RAID 0 array.