S3-Performance-Test icon indicating copy to clipboard operation
S3-Performance-Test copied to clipboard
verified publisher icon jenshadlich

SDK-Update and new options

Open giraone opened this issue 6 years ago • 0 comments

This pull request contains

  1. two new options (--region and --prefix)
  2. two new operations (RANDOM_GET, RANDOM_READ_FIRST_BYTE)
  3. an update to the latest AWS SDK including some refactoring to replace deprecated methods

I have tested the change with AWS S3, minio and RedHat Ceph.

Option --region was needed get the test running against minio. The option --prefix is intended to place the test objects in "folders". I found it useful in my tests.

With the new SDK the existing RANDOM_READ has created warnings in each request, because the object was not read to the end. So I decided to offer 3 methods:

  • RANDOM_GET is more or less like the existing RANDOM_READ
  • RANDOM_READ does now a full read of the S3ObjectInputStream
  • RANDOM_READ_FIRST_BYTE reads only the first 4K bytes

giraone avatar Oct 15 '19 19:10 giraone