amazon-linux-2023 icon indicating copy to clipboard operation
amazon-linux-2023 copied to clipboard

[Package Request] - GDAL

Open stev-0 opened this issue 3 years ago • 18 comments

What package is missing from Amazon Linux 2022? Please describe and include package name. gdal, gdal-devel, python3-gdal, gdal-python-tools

Is this an update to existing package or new package request? New package request

Is this package available in Amazon Linux 2? No

Number of users impacted Many downstream geospatial packages including QGIS server, geopandas, fiona, rasterio, and is a very useful data transformation library on its own. In the tens to hundreds of thousands of people I would guess

stev-0 avatar May 27 '22 16:05 stev-0

Also here interested

ecofor avatar Apr 18 '23 20:04 ecofor

Adding support to this request by noting that GDAL provides common backend support across several other languages beyond Python too (including R and Julia's geospatial data science stack).

On that note, however, building/serving gdal on its own may be insufficient for fully functional geospatial stack. In R land at least, we also require geos, proj, and udunits2.

grantmcdermott avatar Aug 25 '23 21:08 grantmcdermott

Leaving a comment here because i'm also interested in this. Currently trying to migrate projects from AL2 to AL2023 and having problems with GDAL.

Gonsaave avatar Oct 10 '23 13:10 Gonsaave

Leaving a comment here because i'm also interested in this. Currently trying to migrate projects from AL2 to AL2023 and having problems with GDAL.

Same here. Haven't been successful with installing GDAL from source on my Amazon Linux 2023 instance.

kvigulis avatar Jan 17 '24 11:01 kvigulis

Same here

alacret avatar Apr 09 '24 13:04 alacret

Another bump for GDAL and geos, proj, and udunits2 for (R geospatial processing).

cgostic avatar May 16 '24 15:05 cgostic

Aside: geos has been requested separately here. https://github.com/amazonlinux/amazon-linux-2023/issues/372

(Again IMO it makes sense to provision/install gdal, geos, proj and udunits2 together as part of coherent geospatial stack.)

grantmcdermott avatar Jun 14 '24 19:06 grantmcdermott

Yet another bump. We need the whole spatial stack to support python workflows with rasterio.

chipfranzen avatar Jul 30 '24 19:07 chipfranzen

Another bump. This is needed, if not will probably switch from amazon linux.

Joangaes avatar Aug 14 '24 07:08 Joangaes

Another bump. Extremely frustrated that these packages are not in Amazon linux 2023. Now we are left running round and round to find solution.

fodmap-technical avatar Aug 28 '24 07:08 fodmap-technical

While I understand your frustration, I would like to point out that those packages are also not in other popular enterprise distributions, at least not in any supported form. That said, we are trying to find a solution

ozbenh avatar Aug 29 '24 06:08 ozbenh

i am building rpm's from source with modified fedora specs. i'd like that to be available as an optional repo

spawn-guy avatar Sep 23 '24 14:09 spawn-guy

You should be able to then build that rpm inside Fedora COPR and start creating your own repo like me: https://copr.fedorainfracloud.org/coprs/faramirza/al2023 AL2023 is one of the chroots you can build against in COPR. I've added that repo to my AL2023 hosts and get my added/updated packages from it.

danie-dejager avatar Sep 25 '24 05:09 danie-dejager

@daniejstriata first time I stumbled on Fedora COPR yesterday. And now that you mention it - I will go dig deeper. As an idea to host my own repo on s3 flew through my mind 🤔

spawn-guy avatar Sep 25 '24 13:09 spawn-guy

@spawn-guy Here is a guide I wrote: https://github.com/amazonlinux/amazon-linux-2023/issues/433#issuecomment-1923164891

danie-dejager avatar Sep 25 '24 13:09 danie-dejager

This works for me, in case it helps anyone else (the lambda images are on AWS Linux 2023)

FROM public.ecr.aws/lambda/python:3.13

RUN dnf install -y \
  cmake \
  g++ \
  gcc \
  libcurl-devel \
  libtiff-devel \
  sqlite-devel \
  tar \
  wget \
  zlib-devel
RUN dnf clean all


# Install Proj
# https://proj.org/en/stable/install.html#compilation-and-installation-from-source-code 
WORKDIR /proj
RUN wget https://download.osgeo.org/proj/proj-9.5.1.tar.gz \
    && tar -xzf proj-9.5.1.tar.gz \
    && cd proj-9.5.1 \
    && mkdir build && cd build \
    && cmake .. && cmake --build . -j$(nproc) \
    && cmake -DCMAKE_INSTALL_PREFIX=/usr/local .. \
    && make install -j$(nproc)
RUN rm -rf /proj/proj-9.5.1*

# Install GDAL
# https://gdal.org/en/stable/development/building_from_source.html
WORKDIR /gdal
RUN wget https://github.com/OSGeo/gdal/releases/download/v3.10.0/gdal-3.10.0.tar.gz \
    && tar -xzf gdal-3.10.0.tar.gz \
    && cd gdal-3.10.0 \
    && mkdir build && cd build \
    && cmake .. && cmake --build . -j$(nproc) \
    && cmake -DCMAKE_INSTALL_PREFIX=/usr/local .. \
    && make install -j$(nproc)
RUN rm -rf /gdal/gdal-3.10.0*

RUN pip install rasterio

chase-dwelle avatar Dec 17 '24 19:12 chase-dwelle