Mustafa Cavus

Torchfx gptq pattern replacer

3

Required for GPTQ int4 LLMs. (ChatGLM2, ChatGLM3, Llama2) Includes the transformations below: - GPTQ Decompression pattern replacer  - GPTQ Multiplication pattern replacer 

This PR includes the new backend engine. It separates the OpenVINO execution from the Executable into an isolated class, IEBackendEngine. This will create an abstraction for integrating other device based...

Application crashes at the end of execution when using GPU (OpenVINO 2020.4)

1

[ltrace_out.tar.gz](https://github.com/tensorflow/ngraph-bridge/files/5345200/ltrace_out.tar.gz) [ngraph_log.tar.gz](https://github.com/tensorflow/ngraph-bridge/files/5345201/ngraph_log.tar.gz) [strace_out.tar.gz](https://github.com/tensorflow/ngraph-bridge/files/5345202/strace_out.tar.gz) When the backend device set to GPU, the application crashed just before the execution finishes. The crash happens in the destructor of "IE_Backend" when calling "m_exec_map.clear();" (line...

### Details: - Reshape dynamic input support updated to use Concat if there are unkown dimensions - Dynamic shape support added for arange and full ops. ### Tickets: - *ticket-id*...

## Description * Security related updates for dependent library versions ## Screenshots/videos: ## Checklist: - [ ] I have read [contributing wiki page](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Contributing) - [ ] I have performed a...