Thanh Dat Ngo issues

Repositories
Issues
Comments

Results 1 issues of


                                            Thanh Dat Ngo

[Feature] Add caching for NRTRDecoder for faster inference

[OpenNMT](https://github.com/OpenNMT/OpenNMT-py/issues/1551) and [HuggingFace](https://github.com/huggingface/transformers/blob/d822ab636b6a14ed50f7bca0797c1de42c19de61/src/transformers/modeling_bart.py#L551-L553) has implemented caching for transformers decoder to improve inference throughput. Should we try the same for MMOCR Transformers Decoders such as NRTR? Further information on improving Sequence...