Package details
Package | py3-tokenizers |
---|---|
Version | 0.21.0-r0 |
Description | Fast State-of-the-Art Tokenizers optimized for Research and Production |
Project | https://github.com/huggingface/tokenizers |
License | Apache-2.0 |
Branch | edge |
Repository | testing |
Architecture | x86 |
Size | 1.6MiB |
Installed size | 3.6MiB |
Origin | py3-tokenizers |
Maintainer | Patrycja Rosa |
Build time | 2024-11-27 19:51:39 |
Commit | b76fb9c982c16594e43feb4400e2b07120c3e74e | Merge request | 76006 |
Git repository | Git repository |
Build log | Build log |
Contents | Contents of package |