tensorrt-utils icon indicating copy to clipboard operation
tensorrt-utils copied to clipboard

Attribute error _enter_ when running int8 compilation

Open harishprabhala opened this issue 3 years ago • 2 comments

I am getting this error while compiling for int8. The same code works fine for FP32 and FP16

[05/31/2022-05:46:12] [TRT] [E] 1: Unexpected exception 
Traceback (most recent call last):
  File "./onnx_to_tensorrt.py", line 218, in <module>
    main()
  File "./onnx_to_tensorrt.py", line 213, in main
    with builder.build_engine(network, config) as engine, open(args.output, "wb") as f:
AttributeError: __enter__

harishprabhala avatar May 31 '22 05:05 harishprabhala

I encountered with the same issue, did you solve it ?

I can generate the desired model by command line, but cannot use python api.

CharlesNord avatar Dec 06 '22 16:12 CharlesNord

I finally solved the problem,

Just delete the pycuda.autoinit in ImagenetCalibrator.py and add it in the beginning of the onnx_to_tensor.py the generated engine should live in the CUDA context created by the pycuda

CharlesNord avatar Dec 06 '22 16:12 CharlesNord