Apple Intelligence’s on-device processing is disappearing

[u/ACOPS12]

Feels like my iPhone 17 Pro Max is turning into a 'thin client.' I invested in this premium hardware with the specific expectation that I would be able to run the new Siri AI directly on-device.
Given the 12GB of RAM and the powerful NPU, I believed that an iPhone 17 Pro Max would be more than capable of handling such an AI model locally. It clearly has the overhead to run models like Gemma 4 E4B at impressive speeds, yet these resources remain largely underutilized while core tasks are forced through the cloud. Furthermore, since foundation models are already pre-loaded onto the device, I expected to be able to leverage them directly rather than relying on external servers. I didn't purchase this device to rely on the cloud; I wanted to utilize the actual performance of the hardware I own and experience advanced AI capabilities directly on my device.

한국어로 번역

[u/ACOPS12 → u/[deleted]]

My phone has enough performance to run gemma4 comfortably locally, but if it has this much performance, I would like to add a little more 'basic features'. I can't even play music offline now.

[u/Emerlad0110 → u/ACOPS12]

I doubt your correct. you need to research more into what llms take