Jiawei Ou

Training slowed down as time progress with litdata streaming dataset

3

## 🐛 Bug Training slowed down as time progress. ### To Reproduce Unfortunately, I don't know what a good way to reproduce this is. This happens to certain datasets. The...

Assert when deserializing `no_header_numpy` or `no_header_tensor`.

4

## 🐛 Bug ### To Reproduce Steps to reproduce the behavior: 1. Create/serialize a dataset with integer tensor or numpy. 2. Read/deserialize the created dataset. #### Code sample ```py from...

## 🚀 Feature Request Uploading to s3 is running out of pool connections, and the uplink is underutilized ## Motivation `WARNING:urllib3.connectionpool:Connection pool is full, discarding connection: .s3.amazonaws.com. Connection pool size:...

**Bug Description** I have to keep telling CC to remove any Claude branding in commit message and PR message. Adding it to global memory with # helped reduce the frequency...