fms-fsdp icon indicating copy to clipboard operation
fms-fsdp copied to clipboard
verified publisher icon foundation-model-stack

Remove `embed_*` variants of model architectures in speculator training

Open sahilsuneja1 opened this issue 1 year ago • 0 comments

Assuming base model implementation supports returning embedding vectors. Contingent on https://github.com/foundation-model-stack/foundation-model-stack/pull/334

sahilsuneja1 avatar Sep 10 '24 22:09 sahilsuneja1