gemma_pytorch icon indicating copy to clipboard operation
gemma_pytorch copied to clipboard

A web runtime supported version of gemma is really needed and high value

Open Zwe1 opened this issue 2 years ago • 2 comments

It's really a wild potential to use gemma in web runtime, so please provide a web runtime version (wasm or typescript version will be better) for the users! Thanks a lot and look forward to it!!!!

Zwe1 avatar Feb 22 '24 03:02 Zwe1

We'll consider this -- it might not be on the immediate roadmap, but feel free to contribute to this if it will be valuable for you!

suryabhupa avatar Mar 05 '24 16:03 suryabhupa

you can run Gemma models with MediaPipe in the web: https://ai.google.dev/edge/mediapipe/solutions/genai/llm_inference

also, for quick testing, you can try the model inside Google AI Studio: https://aistudio.google.com/

gustheman avatar Jul 15 '24 14:07 gustheman