Günter

Can allreduce (and other multi-GPU communications) work via SLI?

3

For quite some time I've been wondering how to get a "poor-man's" 4-GPU-accelerated DL machine at maximum price / performance ratio. PCIe is said to be the communications bottleneck. DGX-1...

platformio.ini suggests PIO, but it's Arduino IDE

2

As I´m still struggling with coupla dozen things in Arduino and connected Android projects, it took me a loooong time to realize this is NOT a PlatformIO project -- despite...

Generate (Android,..) project and use it as context in StarCoder (for whole life-cycle help)?

5

Seeing a lot of typical test examples like a Python counting function or code completion I'm wondering if there is something in the works to help on the project level....

pls put the .mp3 extension in Usage soundfile output example, i.e. `sf.write("parler-tts.mp3",...` Soundfile docs say MP3 is supported since 202206 and it doesn't seem to be responsible for the **...

embeddings curl example on Mac "could not load model: rpc error"

1

**LocalAI version:** 2.12.4 in Docker AMD64 emulation **Environment, CPU architecture, OS, and Version:** Mac M3 36GB & Docker DE latest **Describe the bug** `curl http://localhost:8080/embeddings -X POST -H "Content-Type: application/json"...

Nothing or 404 on port 8080,.. after seemingly working start

18

**LocalAI version:** 2.11.0 **Environment, CPU architecture, OS, and Version:** Windows 11 latest, Xeon(R) w5-3435X, 256GB, 2x 20GB RTX 4000 NVIDIA-SMI 550.65 Driver Version: 551.86 CUDA Version: 12.4, Docker Desktop via...

docs: Python -V must be >=3.9 AND <3.13 and to install PyTorch before Genesis fixes numpy ver problems

2

As even Hello ran into issues with the suggested setup (mainly numpy, e.g. ValueError) on any platform (x64 Ubuntu 24.04 & Win 11, MBP M3) I put some more work...

problem with Python 3.13.1 env and Taichi and PyTorch

2

Edit 3 or so: **Genesis (Taichi) and torchaudio,.. do not yet like Python 3.13.1** Install leaves the impression as if 3.10 is max for these, but 3.12 also installs on...

xLSTM is the 3rd of a kind (besides Transformers and Mamba) and its performace is touted to be superior by its creators at JKU (university in Linz on Danube), who...

xlstm_large/demo.ipnb torch.empty() invalid combination of arguments

3

1 of 2 After two weeks of trying to get inference to work, I came across the xlstm_large/ notebooks and was weary that I had overlooked working Triton examples, but...