Maximilian Böther
Maximilian Böther
Thanks for the swift response. This leads to the same error as outlined. Note that I tried two things: `import tensorflow.keras` (which is equivalent to from tensorflow import keras) which...
Okay, I know what the issue is: By default (at least on my mac in a clean conda env), `pip install tensorflow` installs tf2.16, and `pip install tf_keras` installs tf_keras==2.15....
Just trying to avoid this issue becoming stale :-)
Apparently this is still an open issue, I cannot run squadv2 as well.
I mean what the [checkpoint.md](https://github.com/pytorch/torchtitan/blob/main/docs/checkpoint.md) docs of torchtitan call `dcp_to_torch`. So the `.pt` file generated from that, which is not - at least natively - supported by hf.
I am facing the same issue. Have you found a solution?
Do you plan to merge this at some point or does anything speak against that? From my understanding, most data mixing papers report the perplexity per token, so I am...