Xinyi Liu

> What is your GPU device model and what is the cuda version? If you compile on your own device, you can take a try to modify here(https://github.com/bytedance/lightseq/blob/master/CMakeLists.txt#L88) to "set(CMAKE_CUDA_ARCHITECTURES...

Thank you, I complie successfully. What I do is: 1.modified (https://github.com/bytedance/lightseq/blob/master/CMakeLists.txt#L88) to "set(CMAKE_CUDA_ARCHITECTURES 60 61 70 75)". 2.modified /usr/local/cuda/include/thrust/system/cuda/config.h `#ifndef THRUST_IGNORE_CUB_VERSION_CHECK` to `#ifdef THRUST_IGNORE_CUB_VERSION_CHECK` 3.compile the code with command cmake...

If I want to run py test code( such as test_ls_layers_new.py), what should I do after building all targets?

> If you want to run the test code, you can directly python3 test/xxx.py Then I met the first error 😂

I meet the same problem. And I wonder have you solve it now？

I have the same problem and I would like to know how did you solve the problem about position embedding? For T5 models, Huggingface uses relative position but Megatron uses...