obito

### Is there an existing issue for this? - [X] I have searched the existing issues ### Current Behavior Explicitly passing a `revision` is encouraged when loading a model with...

### Is there an existing issue for this? - [X] I have searched the existing issues ### Current Behavior Explicitly passing a `revision` is encouraged when loading a model with...

关于处理数据是报错 raise DatasetGenerationError("An error occurred while generating the dataset") from e datasets.builder.DatasetGenerationError: An error occurred while generating the dataset

7

g/ChatGLM-Tuning$ python tokenize_dataset_rows.py --jsonl_path data/alpaca_data.jsonl --save_path data/alpaca --max_seq_length 200 Downloading and preparing dataset generator/default to /home/appuser/.cache/huggingface/datasets/generator/default-42b5dc926dde3b41/0.0.0... Generating train split: 0 examples [00:00, ? examples/s]Explicitly passing a `revision` is encouraged when...

[BUG]: ModuleNotFoundError: No module named 'colossalai.utils.model.colo_init_context'

2

### 🐛 Describe the bug CUDA_VISIBLE_DEVICES=6 python train.py Traceback (most recent call last): File "train.py", line 13, in from colossalai.utils.model.colo_init_context import ColoInitContext ModuleNotFoundError: No module named 'colossalai.utils.model.colo_init_context' ### Environment absl-py...

[BUG]: torch.distributed.elastic.multiprocessing.errors.ChildFailedError:

1

### 🐛 Describe the bug ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 130182) of binary: /usr/bin/python3.8 Traceback (most recent call last): File "/usr/local/bin/torchrun", line 8, in sys.exit(main()) File "/usr/local/lib/python3.8/dist-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 345,...

Exception: expected value at line 1 column 1

5

### System Info - `transformers` version: 4.28.0.dev0 - Platform: Linux-5.4.0-144-generic-x86_64-with-glibc2.31 - Python version: 3.9.16 - Huggingface_hub version: 0.13.2 - PyTorch version (GPU?): 2.0.0+cu117 (True) - Tensorflow version (GPU?): not installed...

五万训练数据，lora微调 batchsize为2 目前跑了一个epoch，loss还是停留在2.0附近，没有下降正常吗

4

### Is there an existing issue for this? - [X] I have searched the existing issues ### Current Behavior 如何让loss下降到0.x ？ ### Expected Behavior _No response_ ### Steps To Reproduce...

KeyError: 'model.layers.{}.self_attn.W_pack.weight'

4

device: torch.device = torch.device(torch._C._get_default_device()), # torch.device('cpu'), Model config {'block_size': 2048, 'vocab_size': 32000, 'n_layer': 32, 'n_head': 32, 'dim': 4096, 'intermediate_size': 11008, 'n_local_heads': 32, 'head_dim': 128, 'rope_base': 10000, 'norm_eps': 1e-05} /mnt/user/wangchenpeng/venv/fast/lib/python3.8/site-packages/torch/_utils.py:831: UserWarning:...

- [ ] I didn't find a similar issue already open. - [ ] I read the documentation (README AND Wiki) - [ ] I have installed FFMpeg - [...

raise AttributeError(f"No {package_name} attribute {name}") AttributeError: No huggingface_hub attribute hf_api

1

File "run.py", line 7, in import datasets File "/home/appuser/miniconda3/envs/pt2/lib/python3.8/site-packages/datasets/__init__.py", line 37, in from .builder import ArrowBasedBuilder, BeamBasedBuilder, BuilderConfig, DatasetBuilder, GeneratorBasedBuilder File "/home/appuser/miniconda3/envs/pt2/lib/python3.8/site-packages/datasets/builder.py", line 44, in from .data_files import DataFilesDict, _sanitize_patterns...