Dhruv Mullick

SpacyRecognizer: List of Tuples for check label groups argument

3

https://github.com/microsoft/presidio/blob/aa50e6bbcd8bef6c0281c7c0eb1b354bc20ae55e/presidio-analyzer/presidio_analyzer/predefined_recognizers/spacy_recognizer.py#L53 I believe this should be Optional[List[Tuple[Set, Set]]]. This would let us support multiple tuples like is the default case with self.CHECK_LABEL_GROUPS.

Quantization guidelines broken

3

### System Info Python: 3.10.12 Container: nvcr.io/nvidia/tritonserver:24.06-trtllm-python-py3 TensorRT-LLM: 0.10 ### Who can help? _No response_ ### Information - [X] The official example scripts - [ ] My own modified scripts...

Unable to launch triton server with TP

8

### System Info Built tensorrtllm_backend from source using dockerfile/Dockerfile.trt_llm_backend tensorrt_llm 0.13.0.dev2024081300 tritonserver 2.48.0 triton image: 24.07 Cuda 12.5 ### Who can help? @Tracin @kaiyux @schetlur-nv ### Information - [X] The...

Empty outputs with TRT engine built with W4A8, FP8 KV cache

2

### System Info tensorrt_llm 0.12.0.dev2024073000 CUDA 12.4 H100-PCIe ### Who can help? @Tracin @byshiue ### Information - [ ] The official example scripts - [X] My own modified scripts ###...

[Usage]: Llama4 tool parser

5

### Your current environment Is there any particular parser we should use for parsing tool calls with Llama4? Wondering if the Llama 3.1 parser is suitable here. ### How would...

GRPO + QLora + DS3 fails while merging model with adapters

3

### Please check that this issue hasn't been reported before. - [x] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior Should be able to run...