michaelmoynihan

Results 4 comments of michaelmoynihan

why some prompt doesn't work, the hidden_states will be nan after GemmaModel.forward

Thanks @vupjing and @xrbailey for opening this issue and giving some details! I was able to reproduce your issue for 7b (I couldn't reproduce for 2b). I used a machine...

Cannot run on v4-16 worker 0 TPU VM: "Failed to get global TPU topology"

Hi @markusheimerl, thanks for the issue! It looks like you are setting `CKPT_PATH=/home/markusheimerl/gemma_ckpt/`. This should be unrelated to the underlying failure you are experiencing, but the `CKPT_PATH` should be the...

After deplyed google/gemma-7b-it, there always is error response.

Thanks! Could you share some more details? What is the error response you are receiving?

feat: DirectPredict, DirectRawPredict, StreamDirectRawPredict, and StreamRawPredict examples

> @michaelmoynihan: There are permissions issue with GCS directory "gs://grpc-predict-data/". Please check. Is there a public project where I should put this?