Tiny Language Model

MicroGPT-C is a dependency-free, single-file C implementation of a character-level transformer that runs inference at 10,168,430 tokens per second single-threaded on an Apple M5 Pro using NEON — a 4,192-parameter name generator, not a large language model. The headline number is real, but context matters: this measures raw matvec throughput on a tiny model, not general AI performance. Here is what the benchmark means, how the optimizations work, and why the Apple comparison is fair. ...

LabLLM is a free, native macOS app (Swift/SwiftUI) that lets you train tiny language models from scratch on Apple Silicon — no cloud, no subscription, everything stays on your Mac. Released as a beta in August 2026, it bundles a model builder, dataset browser, tokenizer, training dashboard, LoRA and DPO fine-tuning, a sampler, a chat window, and checkpoints into one GUI, so you can watch a small LLM “emerge” live on your own machine. ...