Source Package python-pytorch-tokenizers

Subpackages

• python3-pytorch-tokenizers - C++ implementations for various tokenizers
• python3-pytorch-tokenizers-devel - C++ implementations for various tokenizers