John Wick

I use bert large for pretrain on vcr and encountered the error ResourceExhaustedError: OOM when allocating tensor

3

I tried using bert large instead of bert in the original code, and modified three parameters (hidden size=1024, hidden layers=24, attention heads=16) in bert config. Here's the error log: https://gist.github.com/AeroXi/d4d273da9f443c0f2cf9f6d6872eeffe...

### Description Running the command in the docs will result in a module not found error. So here should add a command `poetry install` ### Test Plan - - -...

AttributeError: 'OpenAIAuth' object has no attribute 'session_token'

17

after scanning the QR code: ``` shortMessage: 'Command failed with exit code 1: sh -c poetry run python3 src/generate_session.py [email protected] password', command: 'sh -c poetry run python3 src/generate_session.py [email protected] password',...

fix: the string should be f string

1

without f the string won't show the score correctly.

原版需要双卡，每GPU大约7G显存占用 此版本转换成gpu模型后，max_len=10时占用18G显存，调到20会增加，到200会超过24G显存 而原版是MAXSEQLEN=1024的，在这么大参数下只有一共14G显存占用 请问是否因为此版本存在什么问题导致占用更多的显存？有没有办法优化

Chaty login failed with status code 413

7

chaty checkVersion... +0ms ✖ check chaty version error: Request failed with status code 413 chaty Request failed with status code 413 +187ms ✖ check chaty version timeout Node v18.14.2 macOS...