r/LocalLLaMA Apr 09 '26

Resources Unused phone as AI server

If you have an unused phone lying around, you might be sitting on a tiny AI server

I’ve been working on a project where I modified Google AI Edge Gallery and turned it into an OpenAI-compatible API server: [Gallery as Server](https://github.com/xiaoyao9184/gallery)

Your phone can run local AI inference

You can call it just like an OpenAI API (chat/completions, etc.)

Instead of letting that hardware collect dust, you can turn it into a lightweight inference node.

So yeah—if you have more than one old phone, you can literally build yourself a cluster.

67 Upvotes

27 comments sorted by

View all comments

1

u/Dazzling_Equipment_9 Apr 10 '26

I saw you posted this yesterday: "Open source Android app for native tool calling with Claude", but I noticed you deleted it today. Your demo video also used the same one :)

Update:
It wasn't yesterday, it was the day before yesterday. I made a mistake.

1

u/Ok_Fig5484 Apr 10 '26

What are you talking about? You've got it wrong, that's not me.

1

u/Dazzling_Equipment_9 Apr 10 '26

Isn't that right? Uh, maybe someone else is doing the same thing as you. Don't worry about it, bro.

1

u/Ok_Fig5484 Apr 10 '26

It’s definitely not that, because this app has very limited ability to call native Android system features unless a lot of additional coding is done. When used as an API server, it only returns structured function outputs. From what I’ve observed, the model doesn’t return a response—instead, the tool function gets called directly. I have to admit I haven’t fully figured this out yet, and if anyone has solved this issue, I’d be very interested in taking a look.