tensorrt-utils icon indicating copy to clipboard operation
tensorrt-utils copied to clipboard

How to save the calibration.bin files?

Open xingyueye opened this issue 4 years ago • 0 comments

Description

Hi, @rmccorm4 Currently, I'm trying to generate INT8 TRT engine with calibrations, like that calibrator = Calibrator(data_loader=calib_data(), cache="identity-calib.cache") build_engine = EngineFromNetwork( NetworkFromOnnxPath("identity.onnx"), config=CreateConfig(int8=True, calibrator=calibrator) ) But I was really confused about the mechanisms:

  1. when was calibration performed? within the 'EngineFromNetwork' process? I tried to set break-point at calibration::get_batch(), but It did not works;
  2. How to get the calibration.bin files? I have tried to call the function of "write_calibration_cache(self, cache)", But I don't know which 'cache' to pass in.

Please help me with these two problems, Thanks a lot.

xingyueye avatar Nov 20 '21 10:11 xingyueye