Make extension available for DuckDB v1.2.0

[ingomueller-net]

What happens?

DuckDB v1.2.0 was released yesterday but this extension isn't available in the extension repository for that version yet. We should make it available to ensure that people can upgrade DuckDB while continuing to use this extension.

To Reproduce

pip install duckdb==1.2.0
python
# Then in the Python console
import duckdb
con = duckdb.connect()
con.install_extension("substrait")

This produces:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
duckdb.duckdb.HTTPException: HTTP Error: Failed to download extension "substrait" at URL "http://extensions.duckdb.org/v1.2.0/linux_amd64_gcc4/substrait.duckdb_extension.gz" (HTTP 403)

Candidate extensions: "vss", "spatial", "sqlite_scanner", "postgres", "postgres_scanner"
For more info, visit https://duckdb.org/docs/extensions/troubleshooting/?version=v1.2.0&platform=linux_amd64_gcc4&extension=substrait

OS:

linux_amd64_gcc4

Substrait-Extension Version:

n/a

DuckDB Version:

1.2.0

DuckDB Client:

python

Have you tried this on the latest master branch?

• [x] I have

Have you tried the steps to reproduce? Do they include all relevant data and configuration? Does the issue you report still appear there?

• [x] I have

[EpsilonPrime]

A few of us are trying to figure out what the new process is for getting the extension built and included. Since the last major release the repository was moved so it may just require getting it updated in the release process.

[jacques-n]

For reference, I believe that we need to get substrait registered as a community extension now that it is no longer part of the core duckdb release process.

https://duckdb.org/2024/07/05/community-extensions.html#developer-experience

[szarnyasg]

Hi folks, FYI - as you know, the Substrait extension was removed from the core extensions of DuckDB v1.2.0. I also tracked this change in the documentation: https://github.com/duckdb/duckdb-web/pull/4749

If you would like to lift some of the documentation to the upcoming community extension, feel free to do so.

[EpsilonPrime]

Thanks, I'll update the documentation after we get the working build in (https://github.com/duckdb/community-extensions/pull/285).

[EpsilonPrime]

Looks like the community extension update PR is done. That should mean that the 1.2.0 version of the duckdb community extension should now be available. It's not clear to me if the new instructions will need to be "import substrait from community" (will need to test).

[szarnyasg]

Installation works!

[mukundvijay123]

Substrait extension isnt accesible in v1.2.2

Traceback (most recent call last):
  File "/home/m..../duck/duck.py", line 7, in <module>
    con.execute("INSTALL substrait FROM community;")
duckdb.duckdb.HTTPException: HTTP Error: Failed to download extension "substrait" at URL "http://community-extensions.duckdb.org/v1.2.2/linux_amd64_gcc4/substrait.duckdb_extension.gz" (HTTP 403)

Candidate extensions: "vss", "spatial", "sqlite_scanner", "postgres", "postgres_scanner"
For more info, visit https://duckdb.org/docs/extensions/troubleshooting/?version=v1.2.2&platform=linux_amd64_gcc4&extension=substrait

[EpsilonPrime]

I have a PR to fix that but unfortunately the tests are broken because Iceberg isn't available in 1.2.2. Will check again.