Ashley Scillitoe

Replace autodoc with autoapi

2

We should aim to replace sphinx [autodoc](https://www.sphinx-doc.org/en/master/usage/extensions/autodoc.html) (and [sphinx-apidoc](https://www.sphinx-doc.org/en/master/man/sphinx-apidoc.html)) with [sphinx-autoapi](https://github.com/readthedocs/sphinx-autoapi), for consistency with https://github.com/SeldonIO/alibi-detect/pull/482. This should largely be straightforward, but ideally, we should avoid using the `undoc-members` setting, which...

Remove optional dependencies from conda recipe

1

The `alibi` conda build is currently very slow, necessitating the use of [mamba](https://github.com/mamba-org/mamba) to install in most cases. Now that `tensorflow` is an optional dependency, we could explore removing it...

Install alibi-detect during RTD docs build

1

With the ReadTheDocs V2 config file it appears we can install `alibi-detect` (and its dependencies) as part of the docs build, so that they don't have to be mocked. This...

Publish releases to PyPI via a GitHub Action (and replace `setup.py` with `pyproject.toml`)

2

This PR implements a release process via github actions. Performing a release will be as simple as pushing a new version release tag e.g. ``` git tag v0.11.0 git push...

Submodule to compute and visualise drift detection metrics

4

The `alibi_detect.cd.metrics` submodule implements utility functions to measure and visualize detector calibration and test power. These can be used for standalone experiments, and will also be used for our internal...

Tidy handling of optional deps in detector backend wrapper classes

1

We might be able to tidy up the handling of optional deps a little more in detector backend wrapper classes such as `MMDDrift`, `LSDDDrift` etc. In `MMDDrift` we do the...

We should add a troubleshooting page similar to `alibi`'s: https://docs.seldon.io/projects/alibi/en/stable/overview/faq.html. Below is a list of items to add (can add to this over time...): - [ ] This error can...

Any errors such as timeouts that occur when fetching huggingface models (and possibly datasets) in the new `saving/tests/test_saving.py` tests will cause the CI to fail: https://github.com/SeldonIO/alibi-detect/runs/7521461525 We should handle this...

Review content of metadata in detector config files

1

Our detector `self.meta` attribute currently contains the following information: ```python DEFAULT_META = { "name": None, "online": None, # true or false "data_type": None, # tabular, image or time-series "version": None,...

Revisit conda recipe

2

Our conda recipe gets stuck on "Solving environment" during install. We can still install from conda-forge with `mamba` (see https://github.com/SeldonIO/alibi-detect/issues/436#issuecomment-1026663095), but we should still work on addressing the above to...