Now, does tensor_parallel no longer support the huggingface trainer?

[HanGyeol-Yoo]

I'm trying to use the huggingface trainer after using tensor_parallel with the Llama2 7b model, by calling

model = tp.tensor_parallel(model)

but I'm getting the following error.

ValueError: Model parameters were moved to incorrect devices, did call on model.cuda() or model.to(device)? If so, please avoid doing that