New AI startup could shrink server-sized models for use on iPhones

PrismML, a startup that uses mathematical wizardry to shrink the size of large language models, could be used to bring more advanced AI capabilities to iPhones in the future.


The company has already been able to compress the 54GB Qwen 3.6 model to just 4GB. And, importantly, the technology that it uses doesn't impact the model's performance.

Apple is already keen to find ways to shrink LLMs that would normally run on servers. The company prefers such models to run on-device, but has so far been limited by the huge amount of data that more advanced models require.


Continue Reading on AppleInsider | Discuss on our Forums