JARVIS-1: Open-World Multi-Task Agents with Memory-Augmented Multimodal LLMs — Full Review
What Is JARVIS-1 and Why Does It Matter for Open-World AI Agents? JARVIS-1 is an open-world multi-task agent that combines multimodal large language models with a growing memory system to complete over 200 different tasks in Minecraft using human-like control and observation spaces. Developed by Team CraftJarvis at Peking University and BIGAI, JARVIS-1 achieves a 5x reliability improvement over previous state-of-the-art agents on the challenging ObtainDiamondPickaxe task and near-perfect performance on short-horizon tasks like chopping trees. Its key innovation is a multimodal memory that blends pre-trained knowledge from the LLM with actual game survival experiences, enabling self-improvement without retraining. ...