MicroGPT-C Pure C Inference Hits 10M TPS on Apple M5
MicroGPT-C is a dependency-free, single-file C implementation of a character-level transformer that runs inference at 10,168,430 tokens per second single-threaded on an Apple M5 Pro using NEON — a 4,192-parameter name generator, not a large language model. The headline number is real, but context matters: this measures raw matvec throughput on a tiny model, not general AI performance. Here is what the benchmark means, how the optimizations work, and why the Apple comparison is fair. ...