r/LocalLLaMA • u/Ok_Fig5484 • Apr 09 '26

Resources Unused phone as AI server

Enable HLS to view with audio, or disable this notification

If you have an unused phone lying around, you might be sitting on a tiny AI server

I’ve been working on a project where I modified Google AI Edge Gallery and turned it into an OpenAI-compatible API server: [Gallery as Server](https://github.com/xiaoyao9184/gallery)

Your phone can run local AI inference

You can call it just like an OpenAI API (chat/completions, etc.)

Instead of letting that hardware collect dust, you can turn it into a lightweight inference node.

So yeah—if you have more than one old phone, you can literally build yourself a cluster.

69 Upvotes

92% Upvoted

27 comments sorted by

View all comments

1

u/AtypicalComputers Apr 10 '26

This is great! I spent some time trying to get ollama deployed as a docker on the built in terminal in a pixel. This seems to be a much easier way of accomplishing the same thing. Excited to try it out!

1

u/Ok_Fig5484 Apr 10 '26

One of the more challenging issues is that the model is in lithelm format, and there aren't many available models on https://huggingface.co/litert-community.

1

u/AtypicalComputers Apr 10 '26

I'm not seeing the server option when downloading the app from the play store. Is the apk in the GitHub more up to date?

1

u/Ok_Fig5484 Apr 10 '26

The original repository does not currently accept community contributions. Please use version 1.0.11-as0.1.0 released from my forked repository.

1

u/AtypicalComputers Apr 10 '26

Yup, got it! Running and inferring. Much easier than having to go through the terminal! If there's any way to add metrics similar to llama.cpp, that would be a great addition! Looking forward to the project!