CoderTillAITakesOver
CoderTillAITakesOver
> Dear @QueryType , > > THANK YOU!! Super to answer me so quicky!! And... happy new year! > > I am still running on CPU: > > —— I...
> OK guys i pruned the weights, theyre now 11GB and no quality loss, it loads up faster, takes way less space in VRAM... Not sure why they were not...
Well, first shot did not work. I am on torch 2.3.1, Mac M2, 24GB. I loaded the schnell, fp8_e4m3fn. As is seen it does not use MPS and triggered a...
Unless pytorch support Float8_e4m3fn dtypes for MPS backends, people with less than 32GB unified memory should forget to run these locally on Apple Silicon.
> > Unless pytorch support Float8_e4m3fn dtypes for MPS backends, people with less than 32GB unified memory should forget to run these locally on Apple Silicon. > > Can't manage...
> same issues on fresh install on Mac. the failed msg mention a folder and file that exist even if the path is a quite long string : ImportError: cannot...
> Just chiming in on this as this was a helpful thread when I ran into the same issue. > > I have a sneaking suspicion that doing a MacOS...
Apple Silicon environment possible?