leuc

Results 20 comments of leuc

It would be useful to have a link to the hydra API RSS feed, with the exact same parameters as the current executed search. Makes it easier to add feeds...

AniDB does support Anime lookup by the hash of a file, see: https://github.com/clip9/adbren https://github.com/adameste/anidbcli https://github.com/manami-project/anime-offline-database has some numbers on the amount of Anime's known from various sources https://github.com/ScudLee/anime-lists and here...

the following OpenMP/MKL device off-loading will compute matmul() on GPU supported by OneAPI adjust run.c ```C #include #include ``` ```C s->xb = mkl_calloc(p->dim, sizeof(float), 64); s->xb2 = mkl_calloc(p->dim, sizeof(float), 64);...

Loading the weights once into vram and not with every matmul() call improves the token speed to around 120-160/s. Also setting MKL_VERBOSE=2 has been very helpful to confirm that calculation...

I wanted to try faster whisper on a Intel A770 dGPU 16GB. A complete use of oneDNN could also enable that hardware support.

> Can this will be used for Intel Integrated Graphics like Graphics 630 ? No. From the installation guide the verified Hardware Platforms are: - Intel® Data Center GPU Flex...

seeing some speed-up for `time whisper --language en --model large tests/jfk.flac` with new intel_extension_for_pytorch 1.13.120+xpu real 0m23.510s 2.0.110+xpu real 0m19.706s intel-i915-dkms 1.23.5.19.230406.21.5.17.0.1034+i38-1 kernel 5.17.0-1020-oem

Offloading the weights to vram works really well, but the run-state struct might need some refactoring to fit OpenMPs data mapping requirements? Even when limiting the offloading to q, k,...

kernel `5.17.0-1020-oem` and intel-i915-dkms `1.23.3.19.230122.18.5.17.0.1020+i38-1` but bandwidth capped with PCI 3.0 ``` Platform: Intel(R) OpenCL HD Graphics Device: Intel(R) Arc(TM) A770 Graphics Driver version : 23.05.25593.18 (Linux x64) Compute units...

work-around for the save.dat location, since /app inside the flatpak sandbox isn't writable. ```yaml post-install: - ln -sf /tmp/save.dat /app/save.dat ``` wayland and access to controller is needed for Steam...