xformers
xformers copied to clipboard
MicroGPT example uses encoders
❓ Questions and Help
The MicrGPT example specifies block_type as "encoder" (https://github.com/facebookresearch/xformers/blob/main/examples/microGPT.py#L53). Shouldn't this be "decoder"?