12 layer (huggingface gpt-2 equivalent) ctrl model?

[zichaow]

Hi ! Wondering if smaller-sized, pre-trained ctrl models, e.g., the same size as the gpt-2 model on huggingface, are available - ideal for smaller-scale experiments without large-memory GPUs :)) Thanks !