Package details
Package py3-tokenizers
Version 0.21.0-r0
Description Fast State-of-the-Art Tokenizers optimized for Research and Production
Project https://github.com/huggingface/tokenizers
License Apache-2.0
Branch edge
Repository testing
Architecture x86
Size 1.6MiB
Installed size 3.6MiB
Origin py3-tokenizers
Maintainer Patrycja Rosa
Build time 2024-11-27 19:51:39
Commit b76fb9c982c16594e43feb4400e2b07120c3e74e
Merge request 76006
Git repository Git repository
Build log Build log
Contents Contents of package
Depends (5)
Required by (0)
Sub Packages (1)
Provides (1)
Install if (0)