Missing DVCLive metrics in Studio

[daavoo]

Hi there 🤗 !

I have a repository with multiple dvc.yaml, separated into directories.

In one of the directories, I am using DVCLive to log metrics.

While the experiment is running, I can see the metrics in the table but after I run dvc exp push, the metrics are reported as missing.

Reproduction repo:

https://github.com/daavoo/debug-missing-metrics

---

Using a custom directory model_training (this is the setup I would like to use):

The table looks like this:

In this setup, it looks like the running experiment causes an additional issue (column footrain is duplicated)

---

Importing the entire repository:

The table looks like this:

[daavoo]

The dvclive/metrics.json file is missing in the Git Ref itself:

[daavoo]

The missing metrics look like a DVCLive issue when running experiments from a CWD other than the root of the DVC repo. Changing the code to run from the root of the repo fixes the issue of missing metrics in the Git Ref:

https://github.com/daavoo/debug-missing-metrics/commit/9042c505f2db35679c99dbb1fc2ef26fcf4180c0

[dberenbaum]

Hi @daavoo! 👋

The missing metrics look like a DVCLive issue when running experiments from a CWD other than the root of the DVC repo.

Do you want to try to fix this one?

[daavoo]

Hi @daavoo! 👋

The missing metrics look like a DVCLive issue when running experiments from a CWD other than the root of the DVC repo.

Do you want to try to fix this one?

Hi @dberenbaum !

I most likely won't take a further look since I have found a simple enough workaround: creating and git add an empty dvclive/metrics.json before running the first experiment.