# ucto
> Tokenize text files by separating words from punctuation and splitting sentences

## Summary
Multilingual text tokenizer that separates words, punctuation, and sentences

## Capabilities
- Tokenize text into words
- Separate punctuation
- Split sentences
- Multi-language support
- Regular expression-based rules

## When to Use
- When you need text tokenization for NLP
- When processing multilingual text

## When NOT to Use
- When you need deep NLP analysis

## Related Tools
- [lingua-cli](/tools/lingua-cli) (complementary)
- [analiticcl](/tools/analiticcl) (complementary)
- [colibri-core](/tools/colibri-core) (complementary)

---
Source: https://littlescripts.sh/tools/ucto
