VirtualiZarr

VirtualiZarr copied to clipboard

Refactor codebase to support a new simplified Parser->ManifestStore model.

14

- [x] Closes https://github.com/zarr-developers/VirtualiZarr/issues/561 https://github.com/zarr-developers/VirtualiZarr/issues/553 https://github.com/zarr-developers/VirtualiZarr/issues/498 https://github.com/zarr-developers/VirtualiZarr/issues/476 https://github.com/zarr-developers/VirtualiZarr/issues/559 - [x] Tests added - [x] Tests passing - [x] Full type hint coverage - [ ] Changes are documented in `docs/releases.rst`...

sharkinsspatial

Listing every format that could be represented as virtual zarr

19

**Let's list all the file formats that could potentially be represented efficiently as "virtual zarr" - i.e. zarr + chunk manifests.** The important criteria here is that the format must...

TomNicholas

WIP: Use mkdocs-material for documentation

3

I haven't updated all the pages yet for the new format, so please don't nit yet but I'd really appreciate some high level feedback on using mkdocs material and plugins...

maxrjones

Start Executing Docs

3

Beginning of executable docs (#83). All notebooks will automatically be executed as part of the docs build per the docs here: https://myst-nb.readthedocs.io/en/latest/computation/execute.html# It will be useful to set up the...

ianhi

Executable code examples in docs

2

The main usage docs revolve around code examples, but these are currently just hard-coded in. It would be good to generate these results automatically, and even better if the docs...

TomNicholas

Virtualize ZIP archives?

1

[This article](https://medium.com/@mojodna/tapalcatl-cloud-optimized-tile-archives-1db8d4577d92#:~:text=ZIPs%20facilitate%20random,file%20of%20interest.) is fascinating: > ZIPs facilitate random access and cheap updates as part of their design. > > Random access is achieved by providing a [central directory](https://en.wikipedia.org/wiki/Zip_%28file_format%29#Structure), which contains...

TomNicholas

Document use as a runtime translation layer

6

I realized there is now another use case for VirtualiZarr that is not clearly documented: using `ManifestStore` as a runtime translation layer to access other cloud-optimized formats (e.g. COGeoTIFF) through...

TomNicholas

Remove unnecessary obstore import

1

Call `store.get_range_async(...)` rather than `obstore.get_range_async(store, ...)`

maxrjones

VirtualiZarr for incrementally-populated arrays

4

This issue discusses what VirtualiZarr would need to enable incrementally-populated zarr arrays. # Background: Incrementally populated arrays In the original issue (https://github.com/zarr-developers/zarr-specs/issues/300), I described the pattern of populating Zarr arrays...

DahnJ

Failing test to due to upstream indexer changes

1

`virtualizarr/tests/test_xarray.py::TestConcat::test_concat_along_new_dim` started failing after https://github.com/pydata/xarray/pull/10277 was merged.

maxrjones