python3-tokenizers-0.22.2-2.fc45 in Fedora Rawhide
↵ Return to the main page of python3-tokenizers
View build
Search for updates
Package Info (Data from x86_64 build)
🠗 Changelog
🠗 Dependencies
🠗 Provides
🠗 Files
Changelog
| Date | Author | Change |
|---|---|---|
| 2026-04-09 | Benjamin A. Beasley <code at musicinmybrain dot net> - 0.22.2-2 | - Conditionalize datasets test dependency for F42/F43 |
| 2026-02-12 | Alexander F. Lent <lx at xanderlent dot com> - 0.22.2-1 | - Initial import of 0.22.2, fixes rhbz#2388154 |
Provides
- python-tokenizers
- python3-tokenizers
- python3-tokenizers(x86-64)
- python3.14-tokenizers
- python3.14dist(tokenizers)
- python3dist(tokenizers)
Files
- usr/
- lib/
- .build-id/
- f2/
- bc6b567bbae5e16bfe4919f75821d68472a1a7
- f2/
- .build-id/
- lib64/
- python3.14/
- site-packages/
- tokenizers/
- __init__.py
- __init__.pyi
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- decoders/
- __init__.py
- __init__.pyi
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- implementations/
- __init__.py
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- base_tokenizer.cpython-314.opt-1.pyc
- base_tokenizer.cpython-314.pyc
- bert_wordpiece.cpython-314.opt-1.pyc
- bert_wordpiece.cpython-314.pyc
- byte_level_bpe.cpython-314.opt-1.pyc
- byte_level_bpe.cpython-314.pyc
- char_level_bpe.cpython-314.opt-1.pyc
- char_level_bpe.cpython-314.pyc
- sentencepiece_bpe.cpython-314.opt-1.pyc
- sentencepiece_bpe.cpython-314.pyc
- sentencepiece_unigram.cpython-314.opt-1.pyc
- sentencepiece_unigram.cpython-314.pyc
- base_tokenizer.py
- bert_wordpiece.py
- byte_level_bpe.py
- char_level_bpe.py
- sentencepiece_bpe.py
- sentencepiece_unigram.py
- models/
- __init__.py
- __init__.pyi
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- normalizers/
- __init__.py
- __init__.pyi
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- pre_tokenizers/
- __init__.py
- __init__.pyi
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- processors/
- __init__.py
- __init__.pyi
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- tokenizers.abi3.so
- tokenizers.pyi
- tools/
- __init__.py
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- visualizer.cpython-314.opt-1.pyc
- visualizer.cpython-314.pyc
- visualizer-styles.css
- visualizer.py
- trainers/
- __init__.py
- __init__.pyi
- __pycache__/
- __init__.cpython-314.opt-1.pyc
- __init__.cpython-314.pyc
- tokenizers-0.22.2.dist-info/
- INSTALLER
- METADATA
- WHEEL
- licenses/
- LICENSE
- LICENSE.dependencies
- tokenizers/
- site-packages/
- python3.14/
- share/
- doc/
- python3-tokenizers/
- CHANGELOG.md
- README.md
- python3-tokenizers/
- licenses/
- python3-tokenizers/
- LICENSE
- LICENSE.dependencies
- python3-tokenizers/
- doc/
- lib/
Sources on Pagure