A 40B model that does 125 tok/s on a laptop, and a 7B model that does 1.5 tok/s on a 2011 CPU with the same amount of RAM. Same ballpark of memory, ~80× difference in speed. Almost every explanation you will read for that gap is wrong, and the wrong explanation costs people money. Here is the number that actually decides it: how many bytes your... Weiterlesen: Tokens per second is a memory bandwidth number. Measure it in 2 seconds.
Intelligence View
⚡ tsecurity.de Intelligence
Tokens per second is a memory bandwidth number. Measure it in 2 seconds.
A 40B model that does 125 tok/s on a laptop, and a 7B model that does 1.5 tok/s on a 2011 CPU with the same amount of RAM. Same ballpark of memory, ~80× …
Social ReaktionenReagiere als Erste:r — dein Feedback zählt!
Powered by tsecurity.de
tsecurity.de Hub
Intelligence Digest — free The top security news daily · unsubscribe anytime
Community Rating & Social Proof
⭐ Leser-Wertung
–
Ø / 5.0
★★★★★
No reader ratings yet
Was this page helpful?
0
Powered by tsecurity.de
tsecurity.de Hub
Related story clusters & sources (vector AI)
19 sources
Several Linux Kernel Vulnerabilities Accidentally Posted To Public Kernel Mailing List
18 more sources
CCyber Security News2 hours agoCritical Unpatched Linux Kernel Flaws Accidentally Disclosed on Public List VVulDB Updates6 hours agoCVE-2025-68319 | Linux Kernel up to 6.17.7 netconsole update_userdata state issue (Nessus ID 298897 / WID-SEC-2025-2868) VVulDB Updates6 hours agoCVE-2025-68230 | Linux Kernel up to 6.12.59/6.17.9 amdgpu gfx_v9_4_3_switch_compute_partition memory corruption (Nessus ID 302766 / WID-SEC-2025-2868) VVulDB Updates6 hours agoCVE-2025-68251 | Linux Kernel up to 6.17.5 z_erofs_load_lcluster_from_disk infinite loop (EUVD-2025-203645 / Nessus ID 298897) VVulDB Updates6 hours agoCVE-2025-68209 | Linux Kernel up to 6.17.8 mlx5_add_cq_to_tasklet initialization (Nessus ID 296481 / WID-SEC-2025-2868) VVulDB Updates6 hours agoCVE-2025-68236 | Linux Kernel up to 6.17.9 scsi Power_Condition initialization (Nessus ID 302766 / WID-SEC-2025-2868)
+12
18 sources
CVE-2026-79848 | HPE AOS-8 up to 8.10.0.23/8.13.3.0 code injection
17 more sources
VVulDB Updates5 hours agoCVE-2026-79853 | HPE AOS-10 up to 10.4.1.13/10.7.2.6/10.8.1.1 code injection VVulDB Updates5 hours agoCVE-2026-79869 | HPE AOS-10 up to 10.4.1.13/10.7.2.6/10.8.1.1 code injection VVulDB Updates5 hours agoCVE-2026-79852 | HPE AOS-8/AOS-10 up to 10.8.1.1 code injection VVulDB Updates5 hours agoCVE-2026-79857 | HPE AOS-8 up to 8.10.0.23/8.13.3.0 code injection VVulDB Updates5 hours agoCVE-2026-79862 | HPE AOS-8/AOS-10 up to 10.8.1.1 code injection VVulDB Updates5 hours agoCVE-2026-79871 | HPE AOS-10 up to 10.4.1.13/10.7.2.6/10.8.1.1 code injection
+11
15 sources
CVE-2026-79858 | HPE AOS-8 privilege escalation
14 more sources
VVulDB Updates5 hours agoCVE-2026-79956 | HPE AOS-8 up to 8.10.0.23/8.13.3.0 privilege escalation VVulDB Updates5 hours agoCVE-2026-79874 | HPE AOS-10 up to 10.4.1.13/10.7.2.6/10.8.1.1 Local Privilege Escalation VVulDB Updates4 hours agoCVE-2026-95709 | HPE AOS-10 up to 10.4.1.13/10.7.2.6/10.8.1.1 privilege escalation VVulDB Updates4 hours agoCVE-2026-79882 | HPE AOS-10 up to 10.4.1.13/10.7.2.6/10.8.1.1 Local Privilege Escalation VVulDB Updates6 hours agoCVE-2026-95721 | HPE Unknown product up to 8.10.0.23/8.13.3.0 Local Privilege Escalation (EUVD-2026-108415) VVulDB Updates6 hours agoCVE-2026-95717 | HPE Unknown product up to 10.8.1.1 privilege escalation (EUVD-2026-108411)
+8
Mehr aus dieser Kategorie
Blättern: Pfeiltasten [ ← ] [ → ] · Tasten j / k · mobil: Wischen
HAND-OFF
Auf Smartphone übergeben (ADVISORY)
Scannen Sie den QR-Code mit der Smartphone-Kamera für sofortigen mobilen Zugriff:
https://tsecurity.de/en/4291468/secure-programming/tokens-per-second-is-a-memory-bandwidth-number-measure-it-in-2-seconds/