DuckDB.NET Aws S3 support

Hi,

Am trying to read the parquet file data from aws s3 (similar to specified in the link provided https://github.com/duckdb/duckdb/blob/1fbc35f37e2b5b5e641ae0e0cb145078621c0c7b/test/sql/copy/parquet/test_parquet_remote.test) but it says the file didn't found.

Could someone please help how to read the data from aws s3 file

Nov 25 '21 11:11 ravi27may

Does the same work when you run it from duckdb shell?

Nov 25 '21 14:11 Giorgi

Yes Giorgi, it worked using the shell but in linux

Nov 30 '21 14:11 ravi27may

@ravi27may Which version of duckdb.dll did you try it with?

Dec 01 '21 12:12 Giorgi

@ravi27may To load files from HTTPS or S3 DuckDb needs to be compiled with HTTPFS extension: https://github.com/duckdb/duckdb/issues/1457#issuecomment-983606089

Dec 01 '21 13:12 Giorgi

Hi Giorgi,

Am using the 0.3.1 version. so is this version already have httfs extension included any idea

Dec 01 '21 13:12 ravi27may

I don't think 0.3.1 has BUILD_HTTPFS_EXTENSION=1

Dec 01 '21 13:12 Giorgi

@Giorgi - how can we build the with httpfs extension to duckdb.dll. Could you please help me

Dec 01 '21 13:12 ravi27may

That question belongs to the DuckDB repo

Dec 01 '21 13:12 Giorgi

@Giorgi Since duckdb 0.5.1 is released, if possible can you provide us an example with s3 file reading?

Nov 08 '22 12:11 karthikmallireddy

I think DuckDB never includes httpfs in their precompiled binaries. It can be installed by executing "INSTAL httpfs" sql command (it will download extension ) and then "LOAD httpfs".

Dec 19 '22 15:12 mikeTWC1984

Closing as this issue isn't related to .Net bindings.

Dec 19 '22 16:12 Giorgi