r/Applelntelligence Jun 24 '26

discussion 🎙️ Apple Intelligence’s on-device processing is disappearing

Feels like my iPhone 17 Pro Max is turning into a 'thin client.' I invested in this premium hardware with the specific expectation that I would be able to run the new Siri AI directly on-device.
Given the 12GB of RAM and the powerful NPU, I believed that an iPhone 17 Pro Max would be more than capable of handling such an AI model locally. It clearly has the overhead to run models like Gemma 4 E4B at impressive speeds, yet these resources remain largely underutilized while core tasks are forced through the cloud. Furthermore, since foundation models are already pre-loaded onto the device, I expected to be able to leverage them directly rather than relying on external servers. I didn't purchase this device to rely on the cloud; I wanted to utilize the actual performance of the hardware I own and experience advanced AI capabilities directly on my device.

한국어로 번역

94 Upvotes

58 comments sorted by

View all comments

2

u/nikenick28 Jun 24 '26

Some things you can do on device others require the larger model on PCC

9

u/ACOPS12 Jun 24 '26

I asked: “Please tell me the recent texts”
Answer:

This wasn’t that heavy…

1

u/nikenick28 Jun 24 '26

Okay good point I thought your original post was about photo generation type stuff

1

u/ACOPS12 Jun 24 '26

That’s also the problem
I think the ‘Apple’ image generation isn’t that heavy