TurboTransformers icon indicating copy to clipboard operation
TurboTransformers copied to clipboard

core::Tensor 处理

Open zejunwang1 opened this issue 4 years ago • 1 comments

你好,想请教一个关于 Tensor 的问题: 假设我现在有一个 {32,128,768} 维度的 Tensor,现在想去掉第二个维度的头尾向量,将 Tensor 的维度变为 {32,126,768},请问有什么好的解决办法吗?

zejunwang1 avatar Aug 19 '21 07:08 zejunwang1

这个在Turbo里处理不太方便,可以通过dlpack转化成pytorch tensor,然后用torch的接口处理完再转回来。 turbo tensor -> torch tensor torch_tensor = dlpack.from_dlpack(turbo_tensor.to_dlpack()) see this file for more detail turbo_transformers/python/turbo_transformers/layers/return_type.py

torch tensor -> turbo tensor convert2tt_tensor(t) see this file for more details: turbo_transformers/python/turbo_transformers/layers/utils.py

feifeibear avatar Sep 28 '21 08:09 feifeibear