YellowRoseCx
YellowRoseCx
> Amazing! Thank you for bringing this to my attention. I will try to get in touch with the author of the ROCm library and support AMD GPUs by default....
nice work! thanks for the upload and I hope it gets pulled
> Do you know of a cross-platform way to detect if the user's GPU is AMD? I'm not aware of any personally. > > And isn't ROCm linux-only? I've looked...
Would be great to have this feature
Anyone have info regarding use with AMD GPUs? The 7b LLaMa model loads and accepts up to 2048 context tokens on my RX 6800xt 16gb I keep seeing people talking...
> This is an alternative way of distributing the work across workers. Not sure yet if it is more efficient. > > The idea is for each thread to process...
Replace by fee makes double spending easier and harm's Bitcoin's ability to be used as a currency in my opinion
> @oliverhu if you didn't compile the binary yourself (or compiled the binary on a machine with a different card) try doing that. By default, you will only get support...
> AMD in their new release of ROCm 6 will also do a lot of optimization around FP8 in `hipBLASLt` (and in general recommends that library for use in ML),...
I'm looking forward to this change. sometimes with enough finagling I can get DNS to be proxied but it's completely random