Start a project

← Back to the AI Evidence NetworkPermanent public evidence dossier

Hugging Face Tokenizers

package:pypi:tokenizers

This dossier keeps one entity, its published attributes, every direct edge and the supporting source snapshots under a stable URL.

Entity type · Software packagePublic dossier · indexable21 Jul 2026, 08:42

Identity extends only as far as the published stable identifier or explicit mapping. Similar names are not merged. Missing links mean not observed in the bounded sources—not absent in reality.

identity ≠ name similarity · edge ≠ causality

9direct evidenced connections

9exact-identifier edges

10referenced source snapshots

7published attributes

ONE-HOP EVIDENCE

Every direct connection and its proof

The relation label and evidence class describe the entire claim. Open the source record before drawing a broader conclusion.

Exact identifieredge:046be034eb4c167fec6f5fec

Relationshipdeclares_dependency

Repositoryuba-ki-lab/ressource-efficient-computer-vision

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

Exact identifieredge:16ec407e006381ff2d92fa9a

Relationshipdeclares_dependency

Repositoryuba-ki-lab/gsa-extraction

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

Exact identifieredge:4f0d7240bb1801619067db8d

Relationshipdeclares_dependency

Repositoryuba-ki-lab/retrieval-evaluation

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

Exact identifieredge:6d19985e38bffa1491f14a9c

Relationshipdeclares_dependency

Repositorylandeshauptstadt-muenchen/f-13-rag

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

Exact identifieredge:97c6a3a5cbd7c7a736707bc7

Relationshipdeclares_dependency

Repositoryuba-ki-lab/llm-testframework

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

Exact identifieredge:adef0d2f5578fba2694feaf1

Relationshipdeclares_dependency

Repositoryuba-ki-lab/coding-agent-usage-simulation

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

Exact identifieredge:b8740b90ff09570f0984509d

Relationshipdeclares_dependency

Repositoryuba-ki-lab/llm-questionnaire-benchmarking-framework

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

Exact identifieredge:cb9b7c8c7956297929bcf8d5

Relationshipdeclares_dependency

Repositorybaden-wuerttemberg/innenministerium/kiva.platform/kiva-llm-gateway

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

Exact identifieredge:d97e69f6abd27be37c8caf08

Relationshipdeclares_dependency

Repositoryuba-ki-lab/objection-management

repository_commit_manifest_package_identity

No additional excerpt published.

Open source ↗

PUBLISHED ATTRIBUTES

Fields retained with this identity

Attributes are descriptive source fields. They do not create cross-dataset identity unless an edge states that join explicitly.

Advisory Count: 0
Category: tokenization
Ecosystem: pypi
Identity: pypi:tokenizers
License Expressions: non-standard
Occurrence Count: 12
Repository Count: 9

PROVENANCE

Inspect the source snapshots

A source snapshot describes what was available at collection time. Corrections and later publications can change future observations.

01

german-public-sector-ai-dependency-atlaspypi:tokenizers · package_ecosystem_identity

02

german-public-sector-ai-dependency-atlasopencode:10775@9aa07461b879a6161b7e901ea4c2a382b8f1b4ae:pypi:tokenizers · repository_commit_manifest_package_identity

03

german-public-sector-ai-dependency-atlasopencode:5530@f5161e79d3f8c53877f9b1b0d72e1c10bff775ba:pypi:tokenizers · repository_commit_manifest_package_identity

04

german-public-sector-ai-dependency-atlasopencode:7811@f64bf528432908908d92b8263d6933301033bb7f:pypi:tokenizers · repository_commit_manifest_package_identity

05

german-public-sector-ai-dependency-atlasopencode:8712@ddae51bb41a08acf9c1bcdee5dc8ce92df04649c:pypi:tokenizers · repository_commit_manifest_package_identity

06

german-public-sector-ai-dependency-atlasopencode:5012@e8d6e99a1fa63b264e727acb553ed9b1499789b1:pypi:tokenizers · repository_commit_manifest_package_identity

07

german-public-sector-ai-dependency-atlasopencode:7674@fe8ab81af4926a34c6cf1f3a807ffeda2b398f32:pypi:tokenizers · repository_commit_manifest_package_identity

08

german-public-sector-ai-dependency-atlasopencode:10787@4e12ee9f3b0b6fdc77fe21cb89e6cfac17dc6ebd:pypi:tokenizers · repository_commit_manifest_package_identity

09

german-public-sector-ai-dependency-atlasopencode:7781@4a5cd798be9b97cc1bff7b30d930eafda774e380:pypi:tokenizers · repository_commit_manifest_package_identity

10

german-public-sector-ai-dependency-atlasopencode:4112@5c1425bf9990cf12c5ae8ada47d249710703af18:pypi:tokenizers · repository_commit_manifest_package_identity

Return to the full evidence network

Search every published entity, inspect one-hop neighbourhoods and find the bridges public data still cannot support.

Open Evidence Network Explore all tools

Related tools

Useful next steps

These tools complement the current result.

IndexPublic AI outcome ledgerFollow public AI funding from projects and organizations to reported outputs and citations. Every connection retains its evidence; patents and procurement appear only with exact identifier bridges.Provenance checkPublic-sector AI system passportSee which public records can be linked to each published government AI system through stable identifiers or exact source-declared repository URLs—with a source for every edge and visible evidence boundaries.IndexPublic AI actorsSearch organizations across funding, research, procurement, influence and infrastructure. Every role stays tied to its source; matching names are queued for review only.