ml-stable-diffusion Why .mlpackage format no need the vocab.json & merges.txt file?

Hi all,

I want to know why the vocab.json and merges.txt are the same ones from the converting process? If we use a different CLIP model or Text Encoder model, shouldn't it be different?

Oct 03 '23 04:10 TimYao18

Its about the transformer. https://github.com/huggingface/transformers/issues/1083

Oct 05 '23 03:10 TimYao18

Sorry but I use this issue for questioning:

Why .mlpackage format no need the vocab.json & merges.txt file?

I found .mlmodelc and diffusers format both need these files but .mlpackage didn't.

Nov 06 '23 01:11 TimYao18

It is possible that those files are stored inside the text encoder piece of the .mlpackage.

Nov 09 '23 07:11 jrittvo