Contents filter
File Package Branch Repository Architecture
/usr/lib/python3.11/site-packages/tokenizers-0.15.0.dist-info/METADATA py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers-0.15.0.dist-info/RECORD py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers-0.15.0.dist-info/WHEEL py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/__init__.pyi py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/decoders/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/decoders/__init__.pyi py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/implementations/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/implementations/base_tokenizer.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/implementations/bert_wordpiece.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/implementations/byte_level_bpe.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/implementations/char_level_bpe.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/implementations/sentencepiece_bpe.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/implementations/sentencepiece_unigram.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/models/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/models/__init__.pyi py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/normalizers/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/normalizers/__init__.pyi py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/pre_tokenizers/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/pre_tokenizers/__init__.pyi py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/processors/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/processors/__init__.pyi py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/tokenizers.cpython-311-i386-linux-musl.so py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/tools/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/tools/visualizer-styles.css py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/tools/visualizer.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/trainers/__init__.py py3-tokenizers edge testing x86
/usr/lib/python3.11/site-packages/tokenizers/trainers/__init__.pyi py3-tokenizers edge testing x86