MOSS icon indicating copy to clipboard operation
MOSS copied to clipboard
verified publisher icon OpenMOSS

Model Architecture

Open Hegelim opened this issue 2 years ago • 1 comments

What is the architecture of the model? Is it decoder-only or encoder-decoder or something else? Is there a technical report or paper?

Hegelim avatar May 23 '23 17:05 Hegelim

https://github.com/OpenLMLab/MOSS/blob/main/models/modeling_moss.py. I think it's only decoder.very common architecture

moseshu avatar Jun 16 '23 05:06 moseshu