LLaMA2 icon indicating copy to clipboard operation
LLaMA2 copied to clipboard

verified publisher icon aju22
→

Metadata

This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture...

Results 2 LLaMA2 issues
Sort by recently updated
recently updated
newest added

Question... (not issue)

can these python code uses trained model from Meta? I meant, is there a way to extract parameters from Meta's Llama 2 model and plug into this code to run...

etam89 avatar etam89

SiLU FFN

2 comment

https://github.com/aju22/LLaMA2/blob/5716de40720123bf03013f3e08673a7e0feb53ba/model.py#L216 in LlaMA2 source code, they obtain 'X_V' with the origin 'x', instead of 'swish'

Ricardokevins avatar Ricardokevins

← Metadata

48
Stars
7
Forks
Watchers

Owner

verified publisher icon aju22

Metadata

This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture...

Back