Benchio Sample Clauses

Benchio. Benchio is another tool for benchmarking AWS S3 systems. It is much simpler, but more limited than COSBench. It only supports S3 interfaces, and all tests follow the same process: write a number of objects of a particular size to a single bucket, then read back those objects. The number of objects, size of objects and number of parallel workers is configurable but is the same throughout the test. It does not carry out any verification that the contents of the object that is received are the same as that sent, although it does check the size. Benchio has been designed for testing large numbers of small objects, and not for testing large objects, as might be used by typical CompBioMed users. As such, we forked Benchio to make alterations for this use case: • Allow for the execution of tests of objects larger than the memory of the local machine. Previously, ▇▇▇▇▇▇▇ would create a random data set of the specified size in memory at the start, then upload it repeatedly. Our change allowed it to read the data multiple times, allowing tests of theoretically unlimited size. • Use AWS S3 multi-part uploads, which allows large objects to be uploaded as multiple HTTP requests.