TECH - New Research Paper Shows How Apple Could Bring On-Device AI To Older iPhones | Benzinga
A recently published research paper reveals that Apple Inc. (NASDAQ:AAPL) might be planning to introduce on-device generative AI capabilities on iPhones.
What Happened: Apple’s research paper suggests a strategy for running large language models (LLMs) on devices with limited RAM. In this case, it would help iPhones immensely since they have relatively less RAM than their Android counterparts.
Instead of loading the complete model at once, Apple’s approach involves storing model parameters and pulling portions into the device’s RAM as needed.
The paper suggests that this method could facilitate the operation of models up to twice the size of the available memory, leading to 4-5x and 20-25x increases in inference speed in CPU and GPU, respectively.
The potential introduction of on-device generative AI, which typically benefits ...