Mitchell DeHaven

Some improvements / bug fixes

10

Thanks for the repo, its really awesome to use! Using it I noticed a few problems / personal preferences that I made to improve it. I thought I would create...

Espeak is quite ubiquitous in TTS systems, both in small form factor implementations like Piper, as well as larger SOTA systems like StyleTTS2. A common issue brought up is the...

## ❓ General Questions I'm trying to add a model I'm interested in running with MLC-LLM, however is there a method for testing the intermediate `nn.Modules` that are part of...

[BFCL] Gemma Prompt Structure

1

**Describe the issue** The prompt structure for Gemma 3's leaderboard placement is: ``` class GemmaHandler(OSSHandler): def __init__(self, model_name, temperature) -> None: super().__init__(model_name, temperature) @override def _format_prompt(self, messages, function): """ "bos_token":...

The documentation for Gemma 3 (https://huggingface.co/google/gemma-3-1b-it for example) use a prompt structure that seems to be at odds with Google's Gemma documentation. Here is the documentation on Huggingface: ``` model_id...