A 40B model that does 125 tok/s on a laptop, and a 7B model that does 1.5 tok/s on a 2011 CPU with the same amount of RAM. Same ballpark of memory, ~80× difference in speed. Almost every explanation you will read for that gap is wrong, and the wrong explanation costs people money. Here is the number that actually decides it: how many bytes your... Weiterlesen: Tokens per second is a memory bandwidth number. Measure it in 2 seconds.
Intelligence View
⚡ tsecurity.de Intelligence
Tokens per second is a memory bandwidth number. Measure it in 2 seconds.
A 40B model that does 125 tok/s on a laptop, and a 7B model that does 1.5 tok/s on a 2011 CPU with the same amount of RAM. Same ballpark of memory, ~80× …
Social ReaktionenReagiere als Erste:r — dein Feedback zählt!
Powered by tsecurity.de
tsecurity.de Hub
Intelligence Digest gratis Dagelijks het belangrijkste beveiligingsnieuws · kan op elk moment worden opgehaald
Community Rating & Social Proof
⭐ Leser-Wertung
–
Ø / 5.0
★★★★★
Nog geen recensies van lezers
Was deze pagina nuttig?
0
Powered by tsecurity.de
tsecurity.de Hub
Verwant Story Cluster & Sources (vector AI)
13 Bronnen
AI Makes Linux 7.4 Merge Window the Largest in Kernel History
12 andere bronnen
SSlashdot1 uur geledenAI Makes Linux 7.4 Merge Window the Largest in Kernel History VVulDB Updates4 uur geledenCVE-2026-72383 | Linux Kernel up to 6.18.39/7.1.4/7.2-rc1 sctp sctp_free_addr_wq use after free VVulDB Updates4 uur geledenCVE-2026-72375 | Linux Kernel up to 6.18.39/7.1.4/7.2-rc1 afs lib/debugobjects.c afs_lock_work race condition VVulDB Updates4 uur geledenCVE-2026-72329 | Linux Kernel up to 7.1.4/7.2-rc2 liquidio liquidio_vf.c pcie_flr null pointer dereference VVulDB Updates4 uur geledenCVE-2026-72320 | Linux Kernel up to 6.12.96/6.18.39/7.1.4/7.2-rc2 nft_lookup nft_lookup_eval privileges management VVulDB Updates4 uur geledenCVE-2026-72395 | Linux Kernel up to 7.2-rc1 Hwmon Pmbus regulator_handle_critical event state issue
+6
11 Bronnen
CVE-2026-106207 | Google Chrome up to 154.0.8037.97 V8 race condition (WID-SEC-2026-3761)
10 andere bronnen
VVulDB Updates6 uur geledenCVE-2026-106209 | Google Chrome up to 154.0.8037.97 Mobile clickjacking (WID-SEC-2026-3761) VVulDB Updates6 uur geledenCVE-2026-106210 | Google Chrome up to 154.0.8037.97 Scroll information disclosure (WID-SEC-2026-3761) VVulDB Updates6 uur geledenCVE-2026-106213 | Google Chrome up to 154.0.8037.97 WebAudio race condition (WID-SEC-2026-3761) VVulDB Updates6 uur geledenCVE-2026-106211 | Google Chrome up to 154.0.8037.97 TabStrip use after free (WID-SEC-2026-3761) VVulDB Updates6 uur geledenCVE-2026-106214 | Google Chrome up to 154.0.8037.97 Proxy information disclosure (WID-SEC-2026-3761) VVulDB Updates6 uur geledenCVE-2026-106215 | Google Chrome up to 154.0.8037.97 ANGLE uninitialized resource (WID-SEC-2026-3761)
+4
9 Bronnen
CVE-2026-109715 | Mozilla Firefox up to 115.42/153.4/157 JavaScript Engine integer overflow (Nessus ID 374794)
8 andere bronnen
VVulDB Updates1 uur geledenCVE-2026-109740 | Mozilla Firefox up to 153.4/157 Win32 sandbox (Nessus ID 374794) VVulDB Updates1 uur geledenCVE-2026-109706 | Mozilla Firefox up to 115.42/153.4/157 IndexedDB use after free (Nessus ID 374794) VVulDB Updates1 uur geledenCVE-2026-109724 | Mozilla Firefox up to 153.4/157 DOM/HTML use after free (Nessus ID 374794) VVulDB Updates1 uur geledenCVE-2026-109713 | Mozilla Firefox up to 153.4/157 Crash Reporting use after free (Nessus ID 374794) VVulDB Updates1 uur geledenCVE-2026-109745 | Mozilla Firefox up to 153.4/157 Web Serial uninitialized pointer (Nessus ID 374794) VVulDB Updates1 uur geledenCVE-2026-109709 | Mozilla Firefox up to 153.4/157 Process Sandboxing privileges management (Nessus ID 374794)
+2
Mehr aus dieser Kategorie
Blättern: Pfeiltasten [ ← ] [ → ] · Tasten j / k · mobil: Wischen
HAND-OFF
Auf Smartphone übergeben (ADVISORY)
Scannen Sie den QR-Code mit der Smartphone-Kamera für sofortigen mobilen Zugriff:
https://tsecurity.de/nl/4291468/veilig-programmeren/tokens-per-second-is-a-memory-bandwidth-number-measure-it-in-2-seconds/