Source Package rust-tokenizers

Subpackages

• rust-tokenizers+default-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers+esaxx_fast-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers+fancy-regex-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers+hf-hub-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers+http-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers+indicatif-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers+onig-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers+progressbar-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers+rustls-tls-devel - Implementation of today's most used tokenizers in Rust
• rust-tokenizers-devel - Implementation of today's most used tokenizers in Rust