Gavin comments

Repositories
Issues
Comments

Results 12 comments of


                                            Gavin

Network Division - BERT QSL dataset pre-processing

Can we assume the data to be passed is token IDs (uint64_t) rather than raw text tokens (text sub-strings)? Also, the model expects three inputs - token IDs, input mask,...

Network Division - BERT QSL dataset pre-processing

@nv-jinhosuh The segment ID is 0 up to the separator token and 1 afterwards. It splits the question from the text containing the answer. e.g. tokens - ['[CLS]', 'which', 'nfl',...