Testing out offline language model (SmolLM2-360M) along with in-browser database (pglite.dev with pgvector) for a completely local RAG system that runs on a phone.

Thanks @xenova.bsky.social for building so many demos and examples to build on top of! :)

KittenTTS is under 25 megabytes at ~15M parameters. Quality is crazy good for this size. I'm super excited about the opportunities here.

www.reddit.com/r/LocalLLaMA...

Vil gerne blive bedre til at dele hvad jeg har gang i. Også selvom det måske er en smule upoleret.

Her er sidste nyt: Whisper-large-v3-turbo som web app, 100% lokalt så din data aldrig forlader din computer. Virker bedst i Chrome! (pga. webgpu support)

rasgaard.com/p/transcribe/