avtc

CancellationToken support

1

Please share how to pass CancellationToken to commands? Dapper has ability to consume them via CommandDefinition, see [https://stackoverflow.com/a/25545312](https://stackoverflow.com/a/25545312)

Added ability to inherit Attribute from `GenerateAutoInterfaceAttribute`. Added `GenerateGenericAutoInterfaceAttribute` which will generate an auto interface with implementer type as a generic parameter, example: ```cs [GenerateGenericAutoInterfaceAttribute] public class A : IA...

Update refact_self_hosting.yaml

1

BYOK self-hosting setup. - fix embedding model initialization - use LM Studio for chat model

[BUG] AWQ quantization fail for GLM-4.5-Air

11

1. Looks like AWQ does not honor the `layer_modules_strict=False` when certain modules are not placed on every layer. Stacktrace: ``` File "/home/ubuntu/venvs/gptqmodelt/lib/python3.13t/site-packages/gptqmodel/looper/module_looper.py", line 1156, in loop return self._loop_impl(fail_safe=fail_safe, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^...

[BUG] Vram on cuda:0 usage vs 4.2.5

40

Trying to quantize with gptqmodel commit hash d8f3c78988bb8f11982a5e52361537ffba05d145 with `mock_quantization=False`, and got an error on first layer with experts (layer 1) (GLM-4.5-Air): ``` Quantizing mlp.experts.32.gate_proj in layer [1 of 45]...

`balanced` mode does not work with GLM-4.5-Air and QQQ method, tried on 4 x 3090: ``` File "/home/ubuntu/venvs/gptqmodelt/lib/python3.13t/site-packages/gptqmodel/looper/module_looper.py", line 1156, in loop return self._loop_impl(fail_safe=fail_safe, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/venvs/gptqmodelt/lib/python3.13t/site-packages/torch/utils/_contextlib.py", line 120,...