Skill instructions (SKILL.md) could not be loaded from local cache or raw GitHub repository.
sentencepiece
star 0
Language-independent tokenizer treating text as raw Unicode. Supports BPE and Unigram algorithms. Fast (50k sentences/sec), lightweight (6MB memory), deterministic vocabulary. Used by T5, ALBERT, XLNet, mBART. Train on raw text without pre-tokenization. Use when you need multilingual support, CJK languages, or reproducible tokenization.
By TuYv schedule Updated 6/13/2026 Install via CLI
npx skills add https://github.com/TuYv/ccpm --skill sentencepiece
Repository Details
star Stars
0
call_split Forks
0
navigation Branch
main
article Path
SKILL.md
More from Creator
TuYv Explore all skills →