steveepreston

[FR] Option to manually update sing-box core

1

Please provide an option to update sing-box core manually. (via app GUI or at last pasting in app dir) I tried this but failed: 1. Downloaded latest sing-box core from...

@arm64v8a Please update the core. current: `1.9.7`, latest:`1.11.0-alpha.1` Core crashing most of the times during URL test. in same config, sometimes all test done, sometimes crash in middle of tests....

[Bug] accelerate ignores `TPU`

1

### System Info ```Shell latest version. tested via both `pip install -U accelerate` and `pip install git+https://github.com/huggingface/accelerate` ``` ### Information - [ ] My own modified scripts - [x] The...

[Help][BUG] `KeyError: 'lm_head.weight'` on loading llama 3.2

4

Trying to load llama-3.2 on TPU VM v3-8 via this: ```python device_mesh = keras.distribution.DeviceMesh((1, 8), ["batch", "model"], devices=keras.distribution.list_devices()) layout_map = keras.distribution.LayoutMap(device_mesh) layout_map["token_embedding/embeddings"] = ("model", None) layout_map["decoder_block.*attention.*(query|key|value)/kernel"] = ("model", None, None)...

[Question] what to do when model doesn't have `tokenizer.model`?

2

while `tokenizer.model` is required in yaml config, but there are many models that doesn't have `tokenizer.model` (example: [unsloth/Llama-3.2-1B](https://huggingface.co/unsloth/Llama-3.2-1B/tree/main)) In these cases, how can we use `tokenizer.json` or `tokenizer_config.json` that are...

[Feature] add `mlflow` metric_logging

3

Please add `mlflow` metric_logging. The lack of `mlflow` integration in `torchtune` is so painful.

[Feature] Add option to run `llamafactory-cli webui` in background

7

### Problem: Running `llamafactory-cli webui` forces the notebook to keep cell running and then we can't interact with notebook anymore until we stop the cell from running. another problem is...

[Warning] `Merge lora module to 4-bit linear may get different generations`

18

### System Info peft 0.14.0 transformers 4.48.0 bitsandbytes 0.45.0 ### Who can help? @BenjaminBossan @sayakpaul ### Information - [ ] The official example scripts - [X] My own modified scripts...

Tried Markdown Editor v2.0.5 on PyCharm 2024.2.2 but dark mode not works. Dark Mode (dracula):  Light Mode (dracula): 

[Feature] ChatGPT Temporary chat

8

Please provide option to g4f create Temporary chat instead of normal chats.