Zewen (Evan) Li
Zewen (Evan) Li
> 不能用子账户的key来查询码? 请问解决了吗?
Hi, there. Do u figure out those parameters? Why the loss(softmax) does not reduce when I use the pre-trained model?
@chohk88 The CI failed. Can you take a look?
@chohk88 @narendasan I checked the aten schema where there are only two funcs return `Scalar` type, i.e., ``` - func: item(Tensor self) -> Scalar - func: _local_scalar_dense(Tensor self) -> Scalar...
Hi @Tomiinek, I refactored the layer norm with INormalization Layer. Could you confirm if this works for you? thanks!
@Tomiinek It seems the `trace` you pass into `torch_tensorrt.compile()` has type `_ModuleType.ts`, which means it will compile with `torchscript` frontend. Can you try using `dynamo` frontend instead? because the dynamo...
Hi @Tomiinek, For this error: ``` ImportError: /fsx_home/homes/tomiinek/prdel/lib/python3.11/site-packages/torch_tensorrt/lib/libtorchtrt.so: undefined symbol: _ZN3c104cuda9GetDeviceEPi ``` This is because you might install mismatched `libtorch` version. You can replace the corresponding part in WORKSPACE with...
@narendasan @peri044 Can you guys take a look?
@peri044 I remember we've already removed `cudnn` dependency on the release/2.3, but it still stays here: https://github.com/pytorch/TensorRT/blob/3f6999d6ab2f9b62c63b78e8405cacf216370214/py/torch_tensorrt/__init__.py#L9 This causes an error when I import torch-trt: ``` >>> import torch_tensorrt Traceback...
Cool thanks! And did you implement the unit test for `torch.ops.trt.quantize_fp8.default`?