cloudserver icon indicating copy to clipboard operation
cloudserver copied to clipboard

Add S3 SELECT functionality

Open chriscrawfordAL opened this issue 5 years ago • 4 comments

Feature Request

Proposal

S3 SELECT allows users to pull only specific pieces of information back from S3, not the entire file. Useful when columnar data is stored in S3 in parquet format.

Current behavior

Entire file must be pulled back to process one column

Desired behavior

Be able to pull only sections of a file

Use case

Queries can be sped up to 400% using S3 SELECT

Additional information

  • Is this request for your company? Y
    • If Y: Company name: HPE
    • Are you using any Scality Enterprise Edition products (RING, Zenko EE)? Y
  • Are you willing to contribute this feature yourself? I do not have expertise in this area
  • Position/Title: Sales
  • How did you hear about us? HPE

chriscrawfordAL avatar Jan 07 '21 21:01 chriscrawfordAL

Hi @crawdaddy18, Thanks for the feature request. I'll make sure it gets in the proper hands.

dora-korpar avatar Jan 07 '21 21:01 dora-korpar

Also needed for Orange. Is there a roadmap ?

This feature is implemented in min.io

ggrebert avatar Apr 19 '22 08:04 ggrebert

@dora-korpar any news ? this issue is open since more than 3 years !

ggrebert avatar Mar 19 '24 16:03 ggrebert

is this project died ?

ggrebert avatar Mar 29 '24 10:03 ggrebert