Matthias Wirth comments

Repositories
Issues
Comments

Results 2 comments of


                                            Matthias Wirth

Convert Transformer NMT model usin Trax2Keras error

Hi, This is how I manage to transfer my nmt model from trax to keras. Maybe this helps you out on your issue. I am still struggling how to best...

vLLM Integration via outlines.server returning full prompt

vLLM supports guided output now out of the box. So you may want to go back to a standard vLLM deployment with OpenAI compatible API server. We had the same...