Eric Z

@wegel were you able to make any progress here? Trying to understand the request... Given that the current code bins into windows of likely match, the skew addition (above) was...

This should be quite easy to do. I suppose the question is whether or not there are any legal or license reasons not to do so. @dpwe if there are...

added useful compute for timing offset to JSON return as standard, not verbosity mode; bump test script to profile against extra search time computation

Many parts of this change seemed useful, what was the remaining complication? Was it individual density specification, added stats, or something else?

This looks like a very light scaffolding, but perhaps this HF model layer could help: https://github.com/Solonce/HFAutogen There are a lot of place holders in the base class pointing to mixtral,...

Threading to #229 , #373, an examples from [openweb](https://github.com/open-webui/open-webui/discussions/3672#discussioncomment-11416005). It appears that you could get there via [this streaming example](https://github.com/open-webui/pipelines/blob/1367d9575060f7c2e8abdb1c2e009862020add9a/examples/pipelines/integrations/dify_pipeline.py#L55) with a little bit of work.

+1 that this is a cool feature -- perhaps there are two requests? One for final output and context and the other for intermediate results for some long-running processes? *...

Coming back here after more experience with the code, it looks like the `__emitter__` flow is within opewebui's modules only. Specifically, there are no constructs to pass that type of...

I like the detailed reference you found in langchain. Digging into event emitters more, the change required may be a little easier than we think. * openwebui appears to use...

I had a similar need and ended up patching my own version with [poetry](https://python-poetry.org/) and [semantic-release actions](https://github.com/marketplace/actions/action-for-semantic-release). If we look at what was used for [openwebui](https://github.com/open-webui/open-webui/blob/main/pyproject.toml), there are hints that...