embeddedllm
embeddedllm copied to clipboard
[FEAT] Add NPU Engine
Is your feature request related to a problem? Please describe.
Intel has its own npu runtime library Reference : Phi-3 Cookbook - Intel NPU acceleration library
Describe the solution you'd like
Hence, NPU engine can be added to this repo
Additional context
Update in:
-
modelui.py -
engine.py -
setup.py -
README.md
Add:
-
npu_egnine.py -
requirements-npu.txt -
npu_models.md