speechbrain.tokenizers¶

Package defining the SentencePiece tokenizer

speechbrain.tokenizers.SentencePiece

Library for Byte-pair-encoding (BPE) tokenization.

Read the Docs v: 0.5.7

Versions: latest; stable; 0.5.7

Downloads

On Read the Docs: Project Home; Builds