Cloud? My phone runs it.
Code: see pinned repos below.
Cloud? My phone runs it.
Code: see pinned repos below.
Run MoE models bigger than your RAM. A 284B on a 12 GB phone, CPU only, lossless, on stock llama.cpp
On-device AI meeting assistant — real-time transcription & LLM insights, 100% offline
Forked from tetherto/qvac
QVAC - Local AI SDK and libraries for building private, cross-platform, peer-to-peer AI applications. Run LLMs, speech-to-text, translation, and more locally on Linux, macOS, Windows, Android, and …
JavaScript