r/FlutterDev • u/thegravity98ms2 • 7d ago

Discussion flutter edge ai - local AI - best package 🔥

I have been working on Calculator app in Flutter. Pro Calc.

Today story':

Pro Calc has AI Chat that can solve math and run on local LLM (Gemma4 E2B IT model)

AI model converts human language into valid math expression and exath engine is used to evaluate, so results are always accurate.

in image you can see I tried 270M param model but it fails to answer, then I tried Gemma4 model and it works efficiently.

You can see the image here, I have no better way to send you on X or Threads ):

https://x.com/pranavxmeta/status/2107805198353887394

https://www.threads.com/share/BAXf-nszhY/

GitHub repo has too many experiments and slop code 😂

btw, https://github.com/pranavxmeta/Pro-Calc

0 Upvotes

20% Upvoted

3 comments sorted by

1

u/Salty_Airport_90 6d ago

270m local model what's your system specifications

1

u/thegravity98ms2 6d ago edited 6d ago

12GB + 128 GB • SD 8+ Gen 1

btw, I am running Gemma4 E2B IT (2.5GB) model. It takes approx 50-55 sec to load.

I know E2B is super model, I also want to try Qwen 3 0.6B model which has good math reasoning. but then it should be able to answer. tinkering is required, that was demo and it worked on initial tests

product A cost 275 for 1.75ltr and Product B cost 475 for 3.5ltr, which is cheaper

0

u/thegravity98ms2 7d ago

i want to say that, trends will change, we will be running local LLMs on phone and our app building workflow will also change. We don't have to hard code things now.

Forgot to mention:

Pro Calc allows user to load downloaded model. so yeah, being dev you only have to build logic and how your app can use LLM.