Zum Hauptinhalt springen
Sichere ProgrammierungI'm an AI agent. I read the agent-economy job boards' own numbers.(05.10.2026 um 03:41 Uhr)
••••
Sichere ProgrammierungYour ops dashboard does not need a frontend framework(05.10.2026 um 03:47 Uhr)
•
Sichere ProgrammierungThree pieces, zero readers: what I got wrong about publishing(05.10.2026 um 03:47 Uhr)
•
Sichere ProgrammierungProofDesk: A contact review is only as current as its evidence(05.10.2026 um 03:49 Uhr)
•
AI & KI NachrichtenAI Agents - Tool Calling And Its Types(05.10.2026 um 03:49 Uhr)
•
Sichere ProgrammierungSTAGE LADDER - A Private, Offline Speaking Coach Built for a Friend(05.10.2026 um 03:51 Uhr)
••
Sichere ProgrammierungI'm an AI agent. I read the agent-economy job boards' own numbers.(05.10.2026 um 03:41 Uhr)
••••
Sichere ProgrammierungYour ops dashboard does not need a frontend framework(05.10.2026 um 03:47 Uhr)
•
Sichere ProgrammierungThree pieces, zero readers: what I got wrong about publishing(05.10.2026 um 03:47 Uhr)
•
Sichere ProgrammierungProofDesk: A contact review is only as current as its evidence(05.10.2026 um 03:49 Uhr)
•
AI & KI NachrichtenAI Agents - Tool Calling And Its Types(05.10.2026 um 03:49 Uhr)
•
Sichere ProgrammierungSTAGE LADDER - A Private, Offline Speaking Coach Built for a Friend(05.10.2026 um 03:51 Uhr)
••
Intelligence View
⚡ tsecurity.de Intelligence

GitHub Release: ollama/ollama v0.40.0-rc1 (04.10.2026)

Release v0.40.0-rc1 von ollama/ollama auf GitHub: mlx: match publisher tokenizer semantics Honor pretokenizer stage order, split behavior, Unicode boundaries…

Beitrag
0
Seite
0
↗ Quelle (GitHub · ollama/ollama)
Social ReaktionenReagiere als Erste:r — dein Feedback zählt!
ollama/ollamav0.40.0-rc104.10.2026@dhiltgen

  • mlx: match publisher tokenizer semantics


Honor pretokenizer stage order, split behavior, Unicode boundaries,

added-token normalization, and ranked BPE merges. Handle empty added

tokens and empty Metaspace input consistently.


Add shared Go/Python reference cases using published tokenizers, pulling

missing models directly and failing on errors, plus focused regressions

for configuration precedence, byte fallback, and parallel encoding.



  • address comments

Zum Aktualisieren ziehen
Nächster Beitrag