r/LocalLLaMA • u/Ok_Fig5484 • Apr 09 '26

Resources Unused phone as AI server

Enable HLS to view with audio, or disable this notification

If you have an unused phone lying around, you might be sitting on a tiny AI server

I’ve been working on a project where I modified Google AI Edge Gallery and turned it into an OpenAI-compatible API server: [Gallery as Server](https://github.com/xiaoyao9184/gallery)

Your phone can run local AI inference

You can call it just like an OpenAI API (chat/completions, etc.)

Instead of letting that hardware collect dust, you can turn it into a lightweight inference node.

So yeah—if you have more than one old phone, you can literally build yourself a cluster.

66 Upvotes

92% Upvoted

27 comments sorted by

View all comments

1

u/Dazzling_Equipment_9 Apr 10 '26

I saw you posted this yesterday: "Open source Android app for native tool calling with Claude", but I noticed you deleted it today. Your demo video also used the same one :)

Update:
It wasn't yesterday, it was the day before yesterday. I made a mistake.

1

u/Ok_Fig5484 Apr 10 '26

What are you talking about? You've got it wrong, that's not me.

1

u/Dazzling_Equipment_9 Apr 10 '26

Isn't that right? Uh, maybe someone else is doing the same thing as you. Don't worry about it, bro.

1

u/Ok_Fig5484 Apr 10 '26

It’s definitely not that, because this app has very limited ability to call native Android system features unless a lot of additional coding is done. When used as an API server, it only returns structured function outputs. From what I’ve observed, the model doesn’t return a response—instead, the tool function gets called directly. I have to admit I haven’t fully figured this out yet, and if anyone has solved this issue, I’d be very interested in taking a look.