Elisabeth Fittschen comments

Repositories
Issues
Comments

Results 2 comments of


                                            Elisabeth Fittschen

Provide the shuffled index_mapping npy files for ease of reproducing training data

Hi, This doesn't answer your question regarding the deduped data index files. I just wanted to mention that the index files for the non deduped pile are available as part...

Update batch_viewer docs to accurately reflect data indexing

I think there might be an off‑by‑one in the slice boundaries. Instead of returning `(end_idx - start_idx +1) * 1024` the script returns `(end_idx - start_idx) * 1024 +1` Error...