fsspec
Using kerchunk catalogue from R
hello, I have intake catalogue which points to kerchunk catalogue that we made for Xarray users. I would like to let 'R' user to access that catalogue as well. Does anyone know how to open this great tool kerchunk to 'R' users??
I have not heard of an intake-compatible package for R, but the format in YAML or the server protocol are both very simple.
As for kerchunk, I believe there is a nascent zarr package for R somewhere, but it does not know anything specific about kerchunk. A storage implementation along the lines of fsspec's ReferenceFileSystem would be needed. That, in turn doesn't need to be as complex as it sounds: here is a version for JavaScript (where only HTTP targets are supported).
hello, I found a blog which shows how to reading Zarr file from R environment. May be this can be applied for loading kerchunk data?
That seems to be using the gdal netCDF4/zarr implementation, so it would be very hard to make that work with kerchunk, I think. Zarr is super simple, so anyone that can do a little R coding should be able to implement it; and a native implementation could make choices about storage backends, including supporting referenceFS for kerchunk.
As to the alternative, of supporting kerchunk reference sets directly in GDAL; I have no idea if this is plausible. Perhaps searching for the authors of the netcdf4/zarr implementation there would provide answers.