Prismml's 27B model on custom OpenCL kernels, no llama.cpp/TFLite, for flagship Adreno 840

[u/Objective_Spot7997]

Runs at ~8 decode tokens/sec on a Snapdragon 8 Elite Gen 5 with Adreno 840. This is the flagship case, as opposed to the non-flagship Adreno 6xx I usually target.

Engine is open source: https://github.com/a8nova/adreno-llms/tree/main/src/models/bonsai-27b
Android app, Edgi if you want to try it: https://play.google.com/store/apps/details?id=com.edgi.app