Robin Kobus

Unable to discover bridge with upnp, nupnp fallback works

1

Hi, I don't know why, but the bridge discovery with upnp does not work for me. But even worse the fallback method in [bridge.py](https://github.com/mpolednik/script.kodi.hue.ambilight/blob/bb41f1f6292c2a2f426974c2a630894ea23243fd/resources/lib/bridge.py#L37) is never actually called. I had...

refactor: Remove speculative decoding parameters from stateful decoders

15

Simplify StatefulGptDecoderBatched constructor: - Remove speculative decoding mode parameter - Initialize with default mode=None - Update GptSession class accordingly Simplify setup method signatures in StatefulGptDecoder and StatefulGptDecoderBatched: - Remove maxTokensPerStep...

refactor: Replace DecoderFinishedEvent with CudaEvent in decoder classes

7

- Updated the `forwardAsync` method in `GptDecoderBatched` and `iGptDecoderBatched` to return `CudaEvent` instead of `DecoderFinishedEventPtr`, simplifying event handling. - Removed the `DecoderFinishedEvent` class and its associated usage across various files,...

refactor: Improve decoder finalize function

10

Please see the commit details.

refactor: Simplify disableLookahead and improve numDecodingEngineTokens handling

6

- Move `numDecodingEngineTokens` from `DecoderState->mJointDecodingInput` to `DecoderState` itself. - It's not needed in the inputs, but in the outer decoding loop. - Simplify disableLookahead - Don't take the batch size...

refactor: Expose DecoderState via bindings and integrate in TRTLLMDecoder

3

Please see commit details.

refactor: DisaggExecutorTest

3

# PR title Please write the PR title by following template: [JIRA ticket link/nvbug link/github issue link][fix/feat/doc/infra/...] \ For example, assume I have a PR hope to support a new...