Nathan Azrak

Unknown Attribute TAGame.PRI_TA:CurrentVoiceRoom

1

Looks like voice chat broke the parser. Error: `Exception: Error decoding frame: attribute unknown or not implemented: actor id / actor object id / attribute id: 9 / 118 /...

# Adds the option to pass the original prompt into the AgentExecutor for PlanAndExecute agents This PR allows the user to optionally specify that they wish for the original prompt/objective...

Raises exception if OutputParsers receive a response with both a valid action and a final answer Currently, if an OutputParser receives a response which includes both an action and a...

### System Info The MRKL and chat output parsers currently will allow an LLM response to generate a valid action, as well as hallucinate a "final answer" based on that...

# What does this PR do? Adds optimiser support for MPT Fixes #1433 I don't believe this PR requires any tests, and the documentation already states that MPT is supported...

Support for FP8 quantization with TensorRT-LLM

2

DJL does not support (or has not documented support) for FP8 quantization ([docs](https://demodocs.djl.ai/docs/serving/serving/docs/lmi/user_guides/trt_llm_user_guide.html#quantization-support)). FP8 is currently TensorRT-LLM's [recommended quantization technique](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/blogs/quantization-in-TRT-LLM.md#best-practices-to-choose-the-right-quantization-methods), with the lowest performance degradation with good speedup. It would...

Adds dependencies and extras for torch 2.3.0 with new xformers versions

2

Does not change any colab requirements - not sure if colab uses torch 2.3.0 by default. Enables testing with `torch.compile`.

Expose `ignore_eos_token` to HTTP endpoints

3

### Feature request I would like `ignore_eos_token` specifically built into TGI for benchmarking to become available to one of the HTTP endpoints (e.g. as an optional field in `parameter` defaulting...

Neat packing with pretraining?

8

### Reminder - [X] I have read the README and searched the existing issues. ### System Info llamafactory version: 0.9.1.dev0 Platform: Linux-5.4.0-162-generic-x86_64-with-glibc2.35 Python version: 3.10.12 PyTorch version: 2.4.0+cu121 (GPU) Transformers...

### System Info ``` Runtime environment: Target: x86_64-unknown-linux-gnu Cargo version: 1.80.0 Commit sha: a094729386b5689aabfba40b7fdb207142dec8d5 Docker label: sha-a094729 nvidia-smi: Mon Oct 21 10:38:14 2024 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.54.14 Driver Version: 550.54.14...