Q: Applicability to sequence tagging

[thangld201]

Hi @frederick0329, for sequence tagging (e.g. NER) one would need to predict label for each token in the sequence per a test sample. In this case, the loss is averaged across tokens and gradients of the last FFN can still be computed. I have two questions:

1. Do you think TracIn computations in this case would require any significant change ?
2. Would approximate nearest neighbor be usable in this case ?
3. Would fast random approximation (Appendix F) be usable as well ?