Nischal Jain comments

Results 18 comments of


                                            Nischal Jain

url_prefix not working properly without trailing slash

hey @eleksis can you mark this as closed if its done?

Cannot call "receive" once a disconnect message has been received.

For me, when O1 is done performing a task, it can't do follow ups because of similar issue. First instruction works well.

bug: if event is too big, it gets dropped instead of dropping large input/output/metadata

Hi @marcklingen, I have been liking the platform till now but the lack of support for base64 images and large events is a big bummer. any TL on when these...

Convert to Gguf format to work with Llama.cpp?

any updates on this? the 4b intern model is killer for its size! would love to see it supported with llama.cpp

Multi node training not working on H100 gpus

Following. Were you able to resolve this?

Multi node training not working on H100 gpus

Nope

Can the musicLM creates song with the given lyric?

@Jackwaterveg were you able to figure this out?

attention mask and the pad token id were not set warning

Prior discussion #402

[Feature]: Ollama Built-in Support for Structured Output (i.e. for models that don't yet support it)

following this, would be great to have more support for structured outputs for providers that don't support it yet directly in litellm rather than clubbing it with libraries like instructor.

Support for OpenAI Realtime API (AEGHB-852)

That'd be awesome. Thanks!