Package details
Package py3-tokenizers
Version 0.20.0-r0
Description Fast State-of-the-Art Tokenizers optimized for Research and Production
Project https://github.com/huggingface/tokenizers
License Apache-2.0
Branch edge
Repository testing
Architecture aarch64
Size 1.43 MB
Installed size 3.66 MB
Origin py3-tokenizers
Maintainer Patrycja Rosa
Build time 2024-08-15 19:11:09
Commit fc675104669d54fff4440e8c73a31c23b41bdf27
Git repository Git repository
Build log Build log
Contents Contents of package
Depends (4)
Required by (0)
Sub Packages (1)