Miguel Angel Alba Acosta

Hi, I wonder if there is some sort of abstraction that can be used to load a custom/proprietary CLIP or SigLIP checkpoint thanks in advance :)

Pytorch lighting Fabric + lit data + DDP hangs when finishing epoch

5

## 🐛 Bug I am training CLIP using pytorch lighing fabric + litdata on a distributed set up (4 nodes each 4 GPUs). I noticed that when finishing the 1st...

GCSFuse mount + Vertex AI custom training jobs support

1

## 🚀 Feature DDP on models in GCP with data stored in GCS ### Question Has `litdata` being tested in the case you want to train on GCP (Vertex AI)...

TPU support

6

## 🚀 Feature TPU support ### Motivation Does litdata supports TPU environments, specifically when using lighting fabric? ### Additional context I have >16M image-text pairs I am writing in mosaic-ml...

[Usage]: Question about Multimodal token ids on offloaded tokenization

1

### Your current environment ```text PyTorch version: 2.5.1+cu124 Is debug build: False CUDA used to build PyTorch: 12.4 ROCM used to build PyTorch: N/A OS: Debian GNU/Linux 11 (bullseye) (x86_64)...