SentencePiece-Rust-example icon indicating copy to clipboard operation
SentencePiece-Rust-example copied to clipboard

verified publisher icon guillaume-be
→

Metadata

Supporting example for "A Rust SentencePiece implementation"

Implementation of SentencePiece in Rust

This is the supporting code for the article A Rust SentencePiece implementation. Please note that more complete implementation of teh SentencePiece encoding algorithm is available in the rust-tokenizer crate, the code provided in this repository is designed for educational purpose.

← Metadata

17
Stars
1
Forks
Watchers

Owner

verified publisher icon guillaume-be

Metadata

Supporting example for "A Rust SentencePiece implementation"

Back