Sam Sharpe comments

Repositories
Issues
Comments

Results 2 comments of


                                            Sam Sharpe

On the fly sample filtering and limiting of datasets

Yes, we are currently using HF dataset in streaming mode since we have datasets that are 200GB on disk in parquet files. Trying to find a way to more efficiently...

Error when running packed dataset with compile=True on nightlies

Was there a solution for this?