请教,win10如何避免nccl编译问题
报错如下: nccl.obj : error LNK2001: 无法解析的外部符号 ncclCommInitRank 。。。 build\lib.win-amd64-cpython-39\bmtrain\nccl_C.cp39-win_amd64.pyd : fatal error LNK1120: 15 个无法解析的外部命令。 感谢。
有没有大佬回复下,同样问题,其他模型安装都很成功,就这个一直安装不了,各种办法都试了
我也是,外部连接
build\lib.win-amd64-cpython-38\bmtrain\nccl_C.cp38-win_amd64.pyd : fatal error LNK1120: 15 个无法解析的外部命令
都一样,换ubuntu了,跑起来还要快点。
通过修改源码可以在win上运行: 1、拉BMTrain源码本地 2、去掉BMTrain的setup中nccl扩展模块 3、把BMTrain中用到nccl的地方改用torch.cuda.nccl 4、编译BMTrain到你的CPMBee环境 简单跑了一下1b,还有待进一步学习,看楼上老哥的回复,采用作者的nccl结果应该更好。
通过修改源码可以在win上运行: 1、拉BMTrain源码本地 2、去掉BMTrain的setup中nccl扩展模块 3、把BMTrain中用到nccl的地方改用torch.cuda.nccl 4、编译BMTrain到你的CPMBee环境 简单跑了一下1b,还有待进一步学习,看楼上老哥的回复,采用作者的nccl结果应该更好。
有待学习是翻译效果不好吗?还是速度慢了?速度怎么样呢?
是指我学习模型算法的意思,我的环境拉只能跑起来1b,速度挺好,可能是1b的原因结果比较简洁。
是指我学习模型算法的意思,我的环境拉只能跑起来1b,速度挺好,可能是1b的原因结果比较简洁。
感谢你的回复
如果翻译1000个字的话 大概需要多长时间呢?
准确性如何呢?
是指我学习模型算法的意思,我的环境拉只能跑起来1b,速度挺好,可能是1b的原因结果比较简洁。
感谢你的回复 如果翻译1000个字的话 大概需要多长时间呢? 准确性如何呢?
我的配置不行,千字直接炸,500字作文翻译时间:276.4154348373413,和百度对比了一下差不多
{'input': '在跳蚤书市买下了《活着》这本书,一直放在家中,一直等到最近,才将它挖掘出。《活着》在我看来似乎是一本悲剧,从头至尾福贵爷爷的人生故事贯穿着全书,而他的故事却是时而欢喜,时而哭泣。曾一度认为福贵爷爷的故事会在这或在那就终止,可一直到最后,作者只安排了一只老水牛“福贵”陪伴他。从一开始的目中无人的阔少到最后孤独苍老的老人,变化是如此得大,以至于让我无法承受。也许是时间决定了福贵老人的命运,时间创造了故事,创造了神奇,创造了人的一生,包括诞生和死亡。时间的变幻,让人不可小看。赫拉斯曾警告作者:“人的幸福要等到最后,在他生前和葬礼前,无人有权说他幸福。”的确,一个人的幸福并不是我们外人所能清晰的看到,我们看到的或许只是他的一部分也或许是外界模糊了我们的眼睛。幸福的基准对于不同人而言也是不同的,一位女性要求的或许只是一个温暖的家,一个儿童的瞬间幸福或许只是一个玩具,贫穷的农民求的只是三餐的温饱。是否幸福,只有他自己本人才清楚地知道。同样的,在我看来,福贵老人是不幸的,他的晚年充满死亡,而现在更是要孤独终老。但是对于福贵老人而言,或许现在简单的与“福贵”的生活就是幸福的。或许他从没想到自己能逃离战争,从没想过自己能活到现在,没想到还有那么多的亲人支持自己,太多太多的没想到,即便亲人已远离,但是他们都是相爱的,因此,福贵老人是幸福的,他得到了家人的谅解,而如今又有好朋友的陪伴。', 'prompt': '中翻英', '
是指我学习模型算法的意思,我的环境拉只能跑起来1b,速度挺好,可能是1b的原因结果比较简洁。
感谢你的回复 如果翻译1000个字的话 大概需要多长时间呢? 准确性如何呢?
我的配置不行,千字直接炸,500字作文翻译时间:276.4154348373413,和百度对比了一下差不多 {'input': '在跳蚤书市买下了《活着》这本书,一直放在家中,一直等到最近,才将它挖掘出。《活着》在我看来似乎是一本悲剧,从头至尾福贵爷爷的人生故事贯穿着全书,而他的故事却是时而欢喜,时而哭泣。曾一度认为福贵爷爷的故事会在这或在那就终止,可一直到最后,作者只安排了一只老水牛“福贵”陪伴他。从一开始的目中无人的阔少到最后孤独苍老的老人,变化是如此得大,以至于让我无法承受。也许是时间决定了福贵老人的命运,时间创造了故事,创造了神奇,创造了人的一生,包括诞生和死亡。时间的变幻,让人不可小看。赫拉斯曾警告作者:“人的幸福要等到最后,在他生前和葬礼前,无人有权说他幸福。”的确,一个人的幸福并不是我们外人所能清晰的看到,我们看到的或许只是他的一部分也或许是外界模糊了我们的眼睛。幸福的基准对于不同人而言也是不同的,一位女性要求的或许只是一个温暖的家,一个儿童的瞬间幸福或许只是一个玩具,贫穷的农民求的只是三餐的温饱。是否幸福,只有他自己本人才清楚地知道。同样的,在我看来,福贵老人是不幸的,他的晚年充满死亡,而现在更是要孤独终老。但是对于福贵老人而言,或许现在简单的与“福贵”的生活就是幸福的。或许他从没想到自己能逃离战争,从没想过自己能活到现在,没想到还有那么多的亲人支持自己,太多太多的没想到,即便亲人已远离,但是他们都是相爱的,因此,福贵老人是幸福的,他得到了家人的谅解,而如今又有好朋友的陪伴。', 'prompt': '中翻英', '': 'I had bought Living in the flea market and kept it at home until I found it. It seemed like a tragedy to me that from beginning to end, my grandfather's life story ran through this book; his stories were happy and sad, but sometimes they cried. I thought of him as if he would die here or there, but when I finally saw it, I could not bear it. Time decided how old he was. Time created stories, created magic, created man's whole life, including birth and death. The change in time was so great that I couldn't stand it any longer. Horace warned the author: "Man's happiness will come last, no one has the right to say whether he is happy before he dies." Indeed, a man's happiness isn't what we can see with our eyes. We see only part of him, maybe even part of us, and perhaps the world has blurred our eyes. The standard of happiness for different people may be different. A woman might want a warm home, a child's instant happiness might be just a toy, a poor farmer's hunger for food and shelter might be all that a man needs. Happiness is known only by himself. In the same way, it seems to me that the old man was unhappy because he spent most of his later years dying and now wanted to live alone. But for the old man, perhaps living simply with "the old man" would be good. Perhaps he did not think he could escape war, he did not know that he could live till he died, and yet there are so many other people who support him, too many others who do not know that they love them even though their loved ones have gone away, but still they love each other. Thus, the old man was happy. He got the family's understanding, and now he has friends around him.'}
非常感谢你的回复 为什么我用百度翻译2秒就出来了呢 https://fanyi.baidu.com/?aldtype=16047#zh/en/ 276.4154348373413是0.276秒吗? 那么英文翻译中文呢? 我电脑是win是没法配置环境 好难受
是指我学习模型算法的意思,我的环境拉只能跑起来1b,速度挺好,可能是1b的原因结果比较简洁。
感谢你的回复 如果翻译1000个字的话 大概需要多长时间呢? 准确性如何呢?
我的配置不行,千字直接炸,500字作文翻译时间:276.4154348373413,和百度对比了一下差不多 {'input': '在跳蚤书市买下了《活着》这本书,一直放在家中,一直等到最近,才将它挖掘出。《活着》在我看来似乎是一本悲剧,从头至尾福贵爷爷的人生故事贯穿着全书,而他的故事却是时而欢喜,时而哭泣。曾一度认为福贵爷爷的故事会在这或在那就终止,可一直到最后,作者只安排了一只老水牛“福贵”陪伴他。从一开始的目中无人的阔少到最后孤独苍老的老人,变化是如此得大,以至于让我无法承受。也许是时间决定了福贵老人的命运,时间创造了故事,创造了神奇,创造了人的一生,包括诞生和死亡。时间的变幻,让人不可小看。赫拉斯曾警告作者:“人的幸福要等到最后,在他生前和葬礼前,无人有权说他幸福。”的确,一个人的幸福并不是我们外人所能清晰的看到,我们看到的或许只是他的一部分也或许是外界模糊了我们的眼睛。幸福的基准对于不同人而言也是不同的,一位女性要求的或许只是一个温暖的家,一个儿童的瞬间幸福或许只是一个玩具,贫穷的农民求的只是三餐的温饱。是否幸福,只有他自己本人才清楚地知道。同样的,在我看来,福贵老人是不幸的,他的晚年充满死亡,而现在更是要孤独终老。但是对于福贵老人而言,或许现在简单的与“福贵”的生活就是幸福的。或许他从没想到自己能逃离战争,从没想过自己能活到现在,没想到还有那么多的亲人支持自己,太多太多的没想到,即便亲人已远离,但是他们都是相爱的,因此,福贵老人是幸福的,他得到了家人的谅解,而如今又有好朋友的陪伴。', 'prompt': '中翻英', '': 'I had bought Living in the flea market and kept it at home until I found it. It seemed like a tragedy to me that from beginning to end, my grandfather's life story ran through this book; his stories were happy and sad, but sometimes they cried. I thought of him as if he would die here or there, but when I finally saw it, I could not bear it. Time decided how old he was. Time created stories, created magic, created man's whole life, including birth and death. The change in time was so great that I couldn't stand it any longer. Horace warned the author: "Man's happiness will come last, no one has the right to say whether he is happy before he dies." Indeed, a man's happiness isn't what we can see with our eyes. We see only part of him, maybe even part of us, and perhaps the world has blurred our eyes. The standard of happiness for different people may be different. A woman might want a warm home, a child's instant happiness might be just a toy, a poor farmer's hunger for food and shelter might be all that a man needs. Happiness is known only by himself. In the same way, it seems to me that the old man was unhappy because he spent most of his later years dying and now wanted to live alone. But for the old man, perhaps living simply with "the old man" would be good. Perhaps he did not think he could escape war, he did not know that he could live till he died, and yet there are so many other people who support him, too many others who do not know that they love them even though their loved ones have gone away, but still they love each other. Thus, the old man was happy. He got the family's understanding, and now he has friends around him.'}
非常感谢你的回复 为什么我用百度翻译2秒就出来了呢 https://fanyi.baidu.com/?aldtype=16047#zh/en/ 276.4154348373413是0.276秒吗? 那么英文翻译中文呢? 我电脑是win是没法配置环境 好难受
我技术没有你那么厉害,也好难受
通过修改源码可以在win上运行:
1、拉BMTrain源码本地
2、去掉BMTrain的setup中nccl扩展模块
3、把BMTrain中用到nccl的地方改用torch.cuda.nccl
4、编译BMTrain到你的CPMBee环境
简单跑了一下1b,还有待进一步学习,看楼上老哥的回复,采用作者的nccl结果应该更好。
ˉˉ能说下具体改了哪些文件吗?这边改动会出错 《把BMTrain中用到nccl的地方改用torch.cuda.nccl》