NeoCoreTechs - New Core Technologies
NeoCoreTechs - New Core Technologies
> @blueberry If you had a chance to try out 11.8.0, I assume that there are no issues. I'll still leave this open for a while, because the update for...
Should I log this under the JDK issue tracker here? https://bugreport.java.com/bugreport/
Just FYI I was encountering the same problem trying to run the Gemma1.1-2B and DevstralQ4 but it works fine with all the Llama's and Mistral-7b-Q8
Logged bug on bugreport.java.com internal review Id 9078583
> It feels more like this is a problem in [@mukel](https://github.com/mukel) 's code. Can you have a look? Might still be a Java problem but this seems rather unlikely. If...
I figured out the new Magistral model and integrated it and what do ya know, same IndexOutOfBoundsException! But now it's in vector dot. BTW the report says Oracle confirmed its...
> I assume by "breakages" you mean some compiler errors. And it looks like you just commented out some of the native functions. > > Well, if that works for...
Thanks for the insight. I want to believe it's far more than 100 users, there are 197 stars on the project alone! My own use case was exactly as you...
Sorry, my mistake about the name. Nonetheless, JCuda itself represents a noteworthy effort. I have to re-emphasize though, these are not your grandaddys Jetsons. It's unfortunate they chose to stick...
Compute capability major number refers to the architecture of the GPU, with 8 being the new Ampere and 9 being Hopper I believe. The minor number refers feature set with...