NeMo icon indicating copy to clipboard operation
NeMo copied to clipboard

Yuya/add checkpoints section

Open yaoyu-33 opened this issue 1 year ago • 8 comments

What does this PR do ?

Add NeMo Dev docs to explain NeMo checkpoints, .nemo .ckpt, regular and distributed.

GitHub Actions CI

The Jenkins CI system has been replaced by GitHub Actions self-hosted runners.

The GitHub Actions CI will run automatically when the "Run CICD" label is added to the PR. To re-run CI remove and add the label again. To run CI on an untrusted fork, a NeMo user with write access must first click "Approve and run".

Before your PR is "Ready for review"

Pre checks:

  • [ ] Make sure you read and followed Contributor guidelines
  • [ ] Did you write any new necessary tests?
  • [ ] Did you add or update any necessary documentation?
  • [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
    • [ ] Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

  • [ ] New Feature
  • [ ] Bugfix
  • [x] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed. Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

  • Related to # (issue)

yaoyu-33 avatar May 28 '24 17:05 yaoyu-33

the great firewall. 配置代理吧,或者用他们cn哪个docker compose 文件

papandadj avatar Jun 19 '24 01:06 papandadj

the great firewall. 配置代理吧,或者用他们cn哪个docker compose 文件或者国内镜像配置, 各种加速汇总在这里: https://www.zhihu.com/search?type=content&q=加速汇总

yangboz avatar Jun 19 '24 01:06 yangboz

业余了,你应该给文章地址而不是搜索条件

papandadj avatar Jun 19 '24 01:06 papandadj

业余了,你应该给文章地址而不是搜索条件

https://segmentfault.com/q/1010000014213114

鼓励你提前搜索一下关键字,主动动手尝试让你不再业余 :)

yangboz avatar Jun 19 '24 01:06 yangboz

用cn的docker compose 文件+配置国内镜像可以了。

adzhua avatar Jun 19 '24 02:06 adzhua

用cn的docker compose 文件+配置国内镜像可以了。

Could you please provide the address for the domestic mirror? I have searched for some addresses, but none of them work. Thank you very much!

water-2022 avatar Jun 20 '24 03:06 water-2022

用cn的docker compose 文件+配置国内镜像可以了。

Could you please provide the address for the domestic mirror? I have searched for some addresses, but none of them work. Thank you very much!

vim /etc/docker/daemon.json, and add { "registry-mirrors": ["https://registry.docker-cn.com","https://nrbewqda.mirror.aliyuncs.com","https://dmmxhzvq.mirror.aliyuncs.com"] } sudo systemctl daemon-reload sudo systemctl restart docker

adzhua avatar Jun 21 '24 01:06 adzhua

docker compose -f docker-compose-CN-oc9.yml up -d WARN[0000] The "MACOS" variable is not set. Defaulting to a blank string. [+] Running 12/14 ✘ redis Error context canceled 138.1s ✘ mysql Error context canceled 138.1s ✘ ragflow Error Get "https://registry-1.docker.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 138.1s ⠙ es01 [⣿⣿⣿⣿⠀⣿⣿⣿⣿⣿] 77.99MB / 490.3MB Pulling 138.1s ✔ 572aee731353 Pull complete 115.2s ✔ 124cb7e3e37e Pull complete 115.4s ✔ 983416f418c0 Pull complete 115.4s ✔ 89732bc75041 Pull complete 115.4s ⠙ 8c785eaec661 Downloading [===> ] 33.52MB/445.9MB 134.1s ✔ eea140bef66b Download complete 57.0s ✔ d16bcad91132 Download complete 60.6s ✔ c23208337cf8 Download complete 63.7s ✔ 2d6112686745 Download complete 65.0s ✔ e6fc0d805b6e Download complete 66.6s Error response from daemon: Get "https://registry-1.docker.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

怎么解决啊,加了一堆镜像源了,es还没装完ragflow就失败了。

Ryan512527 avatar Nov 14 '24 15:11 Ryan512527

Not a RAGFlow issue.

yuzhichang avatar Nov 28 '24 07:11 yuzhichang

docker compose -f docker-compose-CN-oc9.yml up -d WARN[0000] The "MACOS" variable is not set. Defaulting to a blank string. [+] Running 12/14 ✘ redis Error context canceled 138.1s ✘ mysql Error context canceled 138.1s ✘ ragflow Error Get "https://registry-1.docker.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 138.1s ⠙ es01 [⣿⣿⣿⣿⠀⣿⣿⣿⣿⣿] 77.99MB / 490.3MB Pulling 138.1s ✔ 572aee731353 Pull complete 115.2s ✔ 124cb7e3e37e Pull complete 115.4s ✔ 983416f418c0 Pull complete 115.4s ✔ 89732bc75041 Pull complete 115.4s ⠙ 8c785eaec661 Downloading [===> ] 33.52MB/445.9MB 134.1s ✔ eea140bef66b Download complete 57.0s ✔ d16bcad91132 Download complete 60.6s ✔ c23208337cf8 Download complete 63.7s ✔ 2d6112686745 Download complete 65.0s ✔ e6fc0d805b6e Download complete 66.6s Error response from daemon: Get "https://registry-1.docker.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

怎么解决啊,加了一堆镜像源了,es还没装完ragflow就失败了。

请问最终解决了吗?

GongPing0 avatar Dec 06 '24 11:12 GongPing0

用cn的docker compose 文件+配置国内镜像可以了。

Could you please provide the address for the domestic mirror? I have searched for some addresses, but none of them work. Thank you very much!

vim /etc/docker/daemon.json, and add { "registry-mirrors": ["https://registry.docker-cn.com","https://nrbewqda.mirror.aliyuncs.com","https://dmmxhzvq.mirror.aliyuncs.com"] } sudo systemctl daemon-reload sudo systemctl restart docker

同问,这个办法我试过了,还是不行,有没有哪位过来人指点一下。

https://registry-1.docker.io/v2/ 这个网站我的电脑上是能访问的,curl也能通,但是就是一直报这个错

(base) hygx@hygx:~/code/ragflow$ docker compose -f docker/docker-compose.yml up -d
WARN[0000] The "HF_ENDPOINT" variable is not set. Defaulting to a blank string.
WARN[0000] The "MACOS" variable is not set. Defaulting to a blank string.
[+] Running 12/14
 ✘ ragflow Error                context canceled                                                                  33.3s
 ✘ mysql Error                  context canceled                                                                  33.3s
 ⠹ es01 [⣿⣿⣿⣿⣀⣿⣿⣿⣿⣿] 243.1MB / 747.8MB Pulling                                                                    33.3s
   ✔ 9e61d8b90935 Pull complete                                                                                   15.3s
   ✔ b72403a59eb9 Pull complete                                                                                   15.7s
   ✔ 9fe4457bccf6 Pull complete                                                                                   15.7s
   ✔ 89732bc75041 Pull complete                                                                                   15.7s
   ⠧ 7d1b8a7d0cf6 Downloading     [=============>                                     ]...                        30.7s
   ✔ 5f0c732baa5d Download complete                                                                                8.3s
   ✔ df9f9c79894f Download complete                                                                               11.2s
   ✔ 4cfe26a355c8 Download complete                                                                               14.8s
   ✔ 4d9c5e900237 Download complete                                                                               15.6s
   ✔ bc9c1e3bbcf8 Download complete                                                                               16.3s
 ✘ redis Error                  Get "https://registry-1.docker.io/v2/": dial tcp 69.171.228.74:443...             33.3s
Error response from daemon: Get "https://registry-1.docker.io/v2/": dial tcp 69.171.228.74:443: i/o timeout

JV-X avatar Dec 11 '24 06:12 JV-X

{ "registry-mirrors": [ "https://docker.1panel.live", "https://hub.rat.dev", "https://docker-0.unsee.tech" ] } 用这个镜像源吧 其他都用不了

用cn的docker compose 文件+配置国内镜像可以了。

Could you please provide the address for the domestic mirror? I have searched for some addresses, but none of them work. Thank you very much!

vim /etc/docker/daemon.json, and add { "registry-mirrors": ["https://registry.docker-cn.com","https://nrbewqda.mirror.aliyuncs.com","https://dmmxhzvq.mirror.aliyuncs.com"] } sudo systemctl daemon-reload sudo systemctl restart docker

NameJaho avatar Feb 26 '25 06:02 NameJaho