Marvin 42

cd VideoGPT: No such file or directory

2

Thanks for the great work!!! I just found out the repo directory has changed and VideoGPT/ is moved to src/sora/modules/ae/vqvae/videogpt/. But the README is still same, cd VideoGPT. could u...

What's HW requirement to run this model?

1

I tried A100 (40GB SXM4) with 30 vCPUs, 200 GiB RAM, 512 GiB SSD but immediately CUDA out of memory. which card / config shall i use? 8x A100 80GB?...

NVIDIA H100 PCIe with CUDA capability sm_90 is not compatible with the current PyTorch installation

2

Hi, I'm using H100 (80GB) , but the specified pytorch version (torch==1.13.1+cu117) does not support H100 CUDA sm_90. Has anyone met h100 issue? how to fix it? Much thanks!! NVIDIA...

Google Colab setup env hit Cuda/extension version mismatch issue

2

Thank you so much for the great work!!! I'm trying to setup the environment in Google Colab to train. but hit Cuda extension version mismatch issue. My python/pytorch/cuda version matches...

Feature Request: MoE only load activated expert(s) to GPU while rest non-used experts are not loaded (to CPU/GPU) for DeekSeek-R1 Inference on consumer GPU

13

### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [x] I searched using keywords...

Flux is by far the best open-weight Image Generation model. Recently Google Nano Banana / ImageGen 4 (and then ByteDance Seedream 4.0) is the top of Image Gen leaderboard. Nano...