xformers icon indicating copy to clipboard operation
xformers copied to clipboard
verified publisher icon facebookresearch

MicroGPT example uses encoders

Open rteehas opened this issue 2 years ago • 0 comments

❓ Questions and Help

The MicrGPT example specifies block_type as "encoder" (https://github.com/facebookresearch/xformers/blob/main/examples/microGPT.py#L53). Shouldn't this be "decoder"?

rteehas avatar Mar 26 '24 14:03 rteehas