Mixture-of-Experts

The Kimi K3 Moment — What Happened on July 16, 2026 On July 16, 2026, Moonshot AI released Kimi K3, a 2.8-trillion-parameter open-weight model that instantly reshaped the competitive landscape of the large language model market. Built on a novel Mixture of Experts architecture with 16 out of 896 experts activated per token, K3 became the largest open-source model ever released and sent shockwaves through both Chinese and global AI markets. Within hours of the announcement, shares of competing Chinese AI companies plunged — Zhipu AI dropped 28% and MiniMax fell 16% — as investors recalibrated expectations for who leads the frontier. ...

Qwen3’s original open-weight release arrived on April 29, 2025. It contains six dense models and two mixture-of-experts (MoE) models. This guide covers that release; later Qwen3 updates and Qwen3.x families must be checked against their own model cards. Source: Qwen’s release announcement. Correction — October 7, 2026: The previous version gave the wrong release year, dense-model count and size range. It also mixed advertised context limits with runtime memory requirements. Those claims have been corrected; unsupported benchmark rankings and hardware-speed promises have been removed. ...