Start a project

← Back to the AI Evidence NetworkPermanent public evidence dossier

Hugging Face Tokenizers

package:pypi:tokenizers

This dossier keeps one entity, its published attributes, every direct edge and the supporting source snapshots under a stable URL.

Entity type · Software packagePublic dossier · indexable19 Oct 2026, 10:37

Identity extends only as far as the published stable identifier or explicit mapping. Similar names are not merged. Missing links mean not observed in the bounded sources—not absent in reality.

identity ≠ name similarity · edge ≠ causality

13direct evidenced connections

13exact-identifier edges

14referenced source snapshots

7published attributes

ONE-HOP EVIDENCE

Every direct connection and its proof

The relation label and evidence class describe the entire claim. Open the source record before drawing a broader conclusion.

Exact identifieredge:046be034eb4c167fec6f5fec

Relationshipdeclares a dependency

Repositoryuba-ki-lab/ressource-efficient-computer-vision

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:0aba47d2f79a7bea4d100d0d

Relationshipdeclares a dependency

Repositoryvernetzte-stadt-gelsenkirchen/urban.ki/urban-ki-airguardai

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:16ec407e006381ff2d92fa9a

Relationshipdeclares a dependency

Repositoryuba-ki-lab/gsa-extraction

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:4f0d7240bb1801619067db8d

Relationshipdeclares a dependency

Repositoryuba-ki-lab/retrieval-evaluation

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:5d1b50841652f4b6894a425d

Relationshipdeclares a dependency

Repositoryvernetzte-stadt-gelsenkirchen/urban.ki/urban-ki-sovia

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:6d19985e38bffa1491f14a9c

Relationshipdeclares a dependency

Repositorylandeshauptstadt-muenchen/f-13-rag

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:84c4fc9683961fa8e0cd5bbe

Relationshipdeclares a dependency

Repositorysh/diwish/splitbot/kosmo/llm-service

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:97c6a3a5cbd7c7a736707bc7

Relationshipdeclares a dependency

Repositoryuba-ki-lab/llm-testframework

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:a8439276e11f2f12d979d594

Relationshipdeclares a dependency

Repositoryvernetzte-stadt-gelsenkirchen/urban.ki/urban-ki-urbanshieldai

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:adef0d2f5578fba2694feaf1

Relationshipdeclares a dependency

Repositoryuba-ki-lab/coding-agent-usage-simulation

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:b8740b90ff09570f0984509d

Relationshipdeclares a dependency

Repositoryuba-ki-lab/llm-questionnaire-benchmarking-framework

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:cb9b7c8c7956297929bcf8d5

Relationshipdeclares a dependency

Repositorybaden-wuerttemberg/innenministerium/kiva.platform/kiva-llm-gateway

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

Exact identifieredge:d97e69f6abd27be37c8caf08

Relationshipdeclares a dependency

Repositoryuba-ki-lab/objection-management

Package identity in the repository commit manifest

No additional excerpt published.

Open source ↗

PUBLISHED ATTRIBUTES

Fields retained with this identity

Attributes are descriptive source fields. They do not create cross-dataset identity unless an edge states that join explicitly.

Advisory Count: 0
Category: tokenization
Ecosystem: pypi
Identity: pypi:tokenizers
License Expressions: non-standard
Occurrence Count: 18
Repository Count: 13

PROVENANCE

Inspect the source snapshots

A source snapshot describes what was available at collection time. Corrections and later publications can change future observations.

01

german-public-sector-ai-dependency-atlaspypi:tokenizers · package_ecosystem_identity

02

german-public-sector-ai-dependency-atlasopencode:10775@9aa07461b879a6161b7e901ea4c2a382b8f1b4ae:pypi:tokenizers · repository_commit_manifest_package_identity

03

german-public-sector-ai-dependency-atlasopencode:11301@363d2a9d9e13db101242ed39bc94a5524509eb1f:pypi:tokenizers · repository_commit_manifest_package_identity

04

german-public-sector-ai-dependency-atlasopencode:5530@f5161e79d3f8c53877f9b1b0d72e1c10bff775ba:pypi:tokenizers · repository_commit_manifest_package_identity

05

german-public-sector-ai-dependency-atlasopencode:7811@f64bf528432908908d92b8263d6933301033bb7f:pypi:tokenizers · repository_commit_manifest_package_identity

06

german-public-sector-ai-dependency-atlasopencode:11298@b961d043e77a4561b9f77c65c6818627c1f34c22:pypi:tokenizers · repository_commit_manifest_package_identity

07

german-public-sector-ai-dependency-atlasopencode:8712@ddae51bb41a08acf9c1bcdee5dc8ce92df04649c:pypi:tokenizers · repository_commit_manifest_package_identity

08

german-public-sector-ai-dependency-atlasopencode:12239@318cda8c49da743f2c4a18a4f4d5c36fc22102fc:pypi:tokenizers · repository_commit_manifest_package_identity

09

german-public-sector-ai-dependency-atlasopencode:5012@e8d6e99a1fa63b264e727acb553ed9b1499789b1:pypi:tokenizers · repository_commit_manifest_package_identity

10

german-public-sector-ai-dependency-atlasopencode:11300@a69008c9aa95148a933a3b7dc6c2f001bfb3b7b1:pypi:tokenizers · repository_commit_manifest_package_identity

11

german-public-sector-ai-dependency-atlasopencode:7674@fe8ab81af4926a34c6cf1f3a807ffeda2b398f32:pypi:tokenizers · repository_commit_manifest_package_identity

12

german-public-sector-ai-dependency-atlasopencode:10787@4e12ee9f3b0b6fdc77fe21cb89e6cfac17dc6ebd:pypi:tokenizers · repository_commit_manifest_package_identity

13

german-public-sector-ai-dependency-atlasopencode:7781@4a5cd798be9b97cc1bff7b30d930eafda774e380:pypi:tokenizers · repository_commit_manifest_package_identity

14

german-public-sector-ai-dependency-atlasopencode:4112@5c1425bf9990cf12c5ae8ada47d249710703af18:pypi:tokenizers · repository_commit_manifest_package_identity

Return to the full evidence network

Search every published entity, inspect one-hop neighbourhoods and find the bridges public data still cannot support.

Open Evidence Network Explore all tools

Related tools

Useful next steps

These tools cover related ground.

IndexPublic AI outcome ledgerFollow public AI funding from projects and organizations to reported outputs and citations. Every connection retains its evidence; patents and procurement appear only with exact identifier bridges.Provenance checkPublic-sector AI system passportSee which public records can be linked to each published government AI system through stable identifiers or exact source-declared repository URLs—with a source for every edge and visible evidence boundaries.IndexPublic AI actorsSearch organizations across funding, research, procurement, influence and infrastructure. Every role stays tied to its source; matching names are queued for review only.