PIXIU
PIXIU copied to clipboard
The-FinAI
This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financia...
Hi, the README says: - [FinMA v0.1 (NLP 7B version)](https://huggingface.co/TheFinAI/finma-7b-nlp) - [FinMA v0.1 (Full 7B version)](https://huggingface.co/TheFinAI/finma-7b-full) but none of those checkpoints exist. Only TheFinAI/finma-7b-full repo is there but it's missing...
Dear PIXIU team, thank you so much for your contribution to the open source community and congratulations for being accepted to the renowned NEURIPS Conference. I am trying to follow...
 Check this linkage but found:
 I followed the steps above to set up my repo, and I don't know why I'm failing, could it be that my transformer version is too high? My version...
HF_ENDPOINT=https://hf-mirror.com python eval.py --model "hf" --tasks "flare_ner,flare_sm_acl,flare_fpb" --model_args "pretrained=/home/jovyan/jhy/LLaMA-Factory/_jhy/finance/2_select_merge,tokenizer=/home/jovyan/jhy/LLaMA-Factory/_jhy/finance/2_select_merge" [nltk_data] Downloading package punkt to /home/jovyan/nltk_data... [nltk_data] Package punkt is already up-to-date! Selected Tasks: ['flare_fpb', 'flare_ner', 'flare_sm_acl'] Using device 'cuda' Loading...
File ".../PIXIU/src/eval.py", line 5, in import tasks File ".../PIXIU/src/tasks/__init__.py", line 7, in from . import flare File ".../PIXIU/src/tasks/flare.py", line 11, in from bart_score import BARTScorer ModuleNotFoundError: No module named 'bart_score'
Thank you so much for your work! I evaluated the model for the lending club task and I saw that the performance is not good as shown below. Can you...
Why did multiple performances result in zero in Table 3 - e.g.: FinQA ? in paper: https://arxiv.org/pdf/2402.12659
