long-range-arena topic

List long-range-arena repositories

Mega-pytorch

203
Stars
12
Forks
Watchers

Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena

Hrrformer

46
Stars
4
Forks
Watchers

Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)