vmadhu

Results 19 comments of vmadhu

@ferreirafabio Hey Fabio, assuming the teacher is a large pretrained model, the optimizer would be required only for the student model. The following snippet depicts the usage of ipex, ```...

@pmusser Hey Peter Firstly to your questions, >Is this this the best I can expect? Since you are batch processing (~1900) records. We might have room to improve the throughput...

@pmusser great! that it worked for you. Btw did you observe a significant improvement in throughput ? I wouldn't be surprised if the A770 churned 1900 samples in less than...

@HyunJae5463 This doesn't seem like an IPEX issue. Tried the Automatic1111(current master branch) GFPGAN and Codeformer restoration on 1) cpu (without ipex) and 2) on gpu (with ipex), and for...

@regisss tried the autogptq route on optimum-habana and it was found to work only on TheBloke/Llama-2-7B-GPTQ. Other newer models (llama3.1 8B , 405B) are failing. docker : vault.habana.ai/gaudi-docker/1.19.1/ubuntu22.04/habanalabs/pytorch-installer-2.5.1:latest optimum-habana commit...

@contryboy Tested the ipex sample train [1] with `intel-extension-for-pytorch 2.1.20+xpu` and found the loss decreasing to ~1.4 over 5 epochs. Will share more updates if I get to run cj-mills...

@contryboy no worries, feel free to reach out if you still face issues.

Hi For the first pip install command, seems like there is a small typo on the link for fetching the wheels. This could be the reason for the 'ERROR: Could...

@MikyLanfra We have seen users reporting similar issues " Error loading "C:\Users\test.conda\envs\ipex_test\lib\site-packages\torch\lib\backend_with_compiler.dll" when using Windows PowerShell. If you were using PowerShell, try switching to Windows Command prompt or Anaconda Command...

@MikyLanfra Sure, lets debug a bit further. Lets try the following sequence of steps (share terminal output of steps 2-5) : 1. Open Windows Device Manager, under Display, check if...