TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

Added PTQ section to BERT notebook

Open svenchilton opened this issue 3 years ago • 3 comments

Description

Added a section on post-training quantization to the BERT notebook. This follows @peri044's fixes in https://github.com/pytorch/TensorRT/pull/1191 to allow support for post-training quantization with multiple inputs.

Fixes # (issue)

Type of change

  • New feature (non-breaking change which adds functionality)

Checklist:

  • [x] My code follows the style guidelines of this project (You can use the linters)
  • [x] I have performed a self-review of my own code
  • [x] I have commented my code, particularly in hard-to-understand areas and hacks
  • [ ] I have made corresponding changes to the documentation
  • [ ] I have added tests to verify my fix or my feature
  • [ ] New and existing unit tests pass locally with my changes
  • [ ] I have added the relevant labels to my PR in so that relevant reviewers are notified

svenchilton avatar Jul 20 '22 21:07 svenchilton

@narendasan, the github-actions bot says that some C++ code doesn't conform to the style guidelines and is requesting that I make some changes. I haven't touched the C++ code.

svenchilton avatar Jul 26 '22 17:07 svenchilton

@peri044, the github-actions bot has once again requested that I make changes to some C++ code which it claims doesn't conform to the style guidelines. I haven't touched the C++ code.

svenchilton avatar Jul 28 '22 21:07 svenchilton

@peri044, the github-actions bot has once again requested that I make changes to some C++ code which it claims doesn't conform to the style guidelines. I haven't touched the C++ code.

Don't worry about it, it is talking about some standing issues that got checked in which will be resolved in an other PR

narendasan avatar Aug 04 '22 13:08 narendasan

This PR has not seen activity for 90 days, Remove stale label or comment or this will be closed in 10 days

github-actions[bot] avatar Nov 16 '22 00:11 github-actions[bot]