wangjiayue

Results 5 comments of wangjiayue

Support for TensorRT 8.0

Hello. I have the same problem as above. I'm trying to build a package with TensorFlow 2.9.1, and when I tried to build it with TensorRT 8.2 update 1 support,...

Support for TensorRT 8.0

> My configuration：ubuntu 20.04, python 3.8, tensorflow 2.9.1, tensorRT 8.2.5.1, cuda 11.6 Build logs: 2022-09-06T01:55:49.4545036Z def _check_trt_version_compatibility(): 2022-09-06T01:55:49.4545652Z """Check compatibility of TensorRT version. 2022-09-06T01:55:49.4546168Z 2022-09-06T01:55:49.4546616Z Raises: 2022-09-06T01:55:49.4547177Z RuntimeError: if the...

Applying FA3 in qwen2 model fine-tuning is slower than FA2

When I started to configure the environment, I also encountered problem #1091 . After fixing this issue, tests were conducted following the successful configuration around August 1st. When was the...

Applying FA3 in qwen2 model fine-tuning is slower than FA2

OK, I'll use this commit to test it again.

Applying FA3 in qwen2 model fine-tuning is slower than FA2

> > OK, I'll use this commit to test it again. > > How about the performance? When I pretrain deepseek-v2 in H100-80G, I met the same（FA3 is slower than...