Federico Parra

Matlab implementation of the adaptive version

4

Hi Jon, thank you for this amazing loss function! Any hopes for a Matlab implementation of the adaptive version? If you could get me started with the essential pseudocode, I...

BUG: using delegate with transformer | AttributeError: 'NoneType' object has no attribute 'c_void_p'

22

Running it on Orange Pi 5B Python 3.11 tflite_runtime 2.14.0 Installation of ARMNN etc works fine with other models (example: runs fine with mirNET) Link to tflite model that causes...

Phi-3 mini 4k instruct with MICROSOFT's quantization

3

## ⚙️ Request New Models - Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf - Is this model architecture supported by MLC-LLM? Yes ## Additional context I know others...

AutoTVM optimization?

3

I recently gone through this tutorial: https://tvm.apache.org/docs/tutorial/autotvm_relay_x86.html Model execution performance on Orange Pi Mali improved quite a lot during the optimization process; crucially, the optimization is **not** a fixed set...

Another error on another model and by now it's two out of three :(

22

[feather_lite.zip](https://github.com/ARM-software/armnn/files/14824271/feather_lite.zip) any of the three versions of this very simple model (that enlightens images) works fine with the default interpreter but fail with the armnn delegate (last version) with error:...

OpenCL and Mali GPU support left out of all execution providers

2

I was trying to migrate from MLC-LLM to onnxruntime to run Phi-3 on an Orange Pi 5 but I realize that among ALL your execution providers there isn't a single...

[Doc] Python API KV/memory reset details absent

6

## 📚 Documentation Hi, I just migrated to last version of MLC with new MLCengine from the old chat engine. In the old one the prompts and inferences were concatenated...