Package details
| Package | py3-tokenizers |
|---|---|
| Version | 0.21.2-r1 |
| Description | Fast State-of-the-Art Tokenizers optimized for Research and Production |
| Project | https://github.com/huggingface/tokenizers |
| License | Apache-2.0 |
| Branch | edge |
| Repository | testing |
| Architecture | x86_64 |
| Size | 1.7MiB |
| Installed size | 4.2MiB |
| Origin | py3-tokenizers |
| Maintainer | Patrycja Rosa |
| Build time | 2026-03-30 15:07:45 |
| Commit | 5d8c48cfdd17df3ab50a1ea515314494af3cbcdb | Merge request | N/A |
| Git repository | Git repository |
| Build log | Build log |
| Issues | Open packaging issues |
| Contents | Contents of package |