solitude-alive

icon location A student at SHU, with a focus on AI and AI safety.

Results 5 comments of solitude-alive

Gemma lora

This is the lora single device test: This is the qlora single device test:

Gemma lora

LoRA single device: ``` INFO:torchtune.utils.logging:Memory Stats after model init: {'peak_memory_active': 5.547595264, 'peak_memory_alloc': 5.547595264, 'peak_memory_reserved': 5.559549952} Step 100 | peak_memory_active:14.325987328 peak_memory_alloc:14.325987328 peak_memory_reserved:24.664604672 ``` QLoRA single device: ``` INFO:torchtune.utils.logging:Memory Stats after model...

Support for Custom base_url to Use Locally Deployed LLMs

> Same problem as mine. Langchain/LangGraph can be connected using the openAI compatible API via the langchain-openai package. See my question specifically.[#195](https://github.com/langchain-ai/open_deep_research/issues/195) But open_deep_research doesn't seem to support this approach,...

Support for Custom base_url to Use Locally Deployed LLMs

> > > Same problem as mine. Langchain/LangGraph can be connected using the openAI compatible API via the langchain-openai package. See my question specifically.[#195](https://github.com/langchain-ai/open_deep_research/issues/195) But open_deep_research doesn't seem to support...

Support for Custom base_url to Use Locally Deployed LLMs

> > > > > Same problem as mine. Langchain/LangGraph can be connected using the openAI compatible API via the langchain-openai package. See my question specifically.[#195](https://github.com/langchain-ai/open_deep_research/issues/195) But open_deep_research doesn't seem...