Arize Phoenix Guide: Open-Source LLM Observability for Developers

Arize Phoenix Guide: Open-Source LLM Observability for Developers (2026)

Arize Phoenix is a free, open-source LLM observability platform that gives developers full-stack visibility into LLM applications — tracing requests, evaluating outputs, and debugging RAG pipelines — without requiring a cloud subscription or vendor account. It runs locally in a Python process or scales to Docker and Kubernetes for production deployments. What Is Arize Phoenix and Why It Matters in 2026 Arize Phoenix is an open-source observability platform built specifically for LLM applications, agents, and retrieval-augmented generation (RAG) pipelines. Unlike generic APM tools, Phoenix understands LLM-native concepts — spans, traces, embeddings, prompts, retrieved contexts, and model outputs — and surfaces them in a UI designed for AI engineers. As of 2026, Phoenix has surpassed 9,000 GitHub stars, making it one of the most-adopted open-source observability tools in the AI ecosystem. The platform is backed by Arize AI but released under a permissive open-source license, meaning you can run it entirely on your own infrastructure with no usage caps or feature gating. ...

May 17, 2026 · 13 min · baeseokjae
Claude Sonnet 5 Review: 82.1% SWE-bench, Dev Team Mode & Pricing Guide

Claude Sonnet 5 Review: 82.1% SWE-bench, Dev Team Mode & Pricing Guide

Claude Sonnet 5 is Anthropic’s mid-tier frontier model released February 3, 2026, scoring 82.1% on SWE-bench Verified — the highest coding benchmark score ever recorded at launch. It introduces Dev Team multi-agent mode, a 1 million token context window, and holds the same $3 per million input token price as its predecessor. For most development teams, it’s the most capable coding model available at a non-flagship price. What Is Claude Sonnet 5? (Fennec Model Overview & Release Details) Claude Sonnet 5 — internally codenamed “Fennec” after the large-eared desert fox — is Anthropic’s third-generation Sonnet model and the first AI model to break the 80% ceiling on SWE-bench Verified. It was officially released on February 3, 2026, simultaneously across the Anthropic API, Amazon Bedrock, and Google Vertex AI, with the identifier claude-sonnet-5@20260203 first spotted in Vertex AI deployment logs days before the announcement. The codename Fennec is not arbitrary marketing: it nods to the model’s 1 million token context window — metaphorically “large ears” for listening to entire codebases. Unlike Claude Opus 4.7, which targets deep multi-step reasoning at a premium price, Sonnet 5 is positioned as the workhorse model for engineering teams who need frontier-grade coding capability without flagship-grade cost. It replaced Claude Sonnet 4.6 as the default model for Claude Code Free and Pro users on launch day. The model runs on Google’s Antigravity TPU infrastructure, which Anthropic credits for the latency improvements over Sonnet 4.6. For API users, the migration path from claude-sonnet-4-6 to claude-sonnet-5 is a one-line model ID change — same tool format, same system prompt conventions. ...

May 17, 2026 · 13 min · baeseokjae
OpenAI Codex Skills Guide: Reusable Agent Behaviors for Developer Workflows

OpenAI Codex Skills Guide: Reusable Agent Behaviors for Developer Workflows

OpenAI Codex Skills are reusable, self-contained packages that encode a developer workflow once and let Codex invoke that workflow on demand — without re-prompting. If you’ve ever corrected Codex on the same PR review pattern three times, a skill makes that correction permanent. What Are OpenAI Codex Skills? (The Agent Macro Model) A Codex Skill is a task-specific package of instructions, optional scripts, reference documents, and assets that Codex can invoke autonomously when it determines a skill is relevant. Launched as an experimental feature in December 2025 and reaching wide availability in early 2026, Skills solve a specific problem: AI coding agents are powerful but stateless — every new session forgets your team’s conventions. Skills make those conventions persistent and composable. ...

May 17, 2026 · 22 min · baeseokjae
Claude Mythos Cybersecurity Guide 2026: Zero-Day Detection and Project Glasswing Explained

Claude Mythos Cybersecurity Guide 2026: Zero-Day Detection and Project Glasswing Explained

Claude Mythos is Anthropic’s most advanced AI security model, achieving a 73% success rate on expert-level CTF tasks and identifying thousands of zero-day vulnerabilities across every major OS and browser before its April 2026 release. Access is gated through Project Glasswing, a vetted defensive coalition of 12 named partners including Microsoft, Google, and CrowdStrike, plus 40+ critical infrastructure organizations. What Is Claude Mythos Preview? (And Why Anthropic Kept It Secret) Claude Mythos Preview is Anthropic’s frontier cybersecurity model — a purpose-built AI system that autonomously discovers, analyzes, and proves exploitability of software vulnerabilities at a capability level no model had reached before April 2025. Unlike Claude Opus or Sonnet, which are general-purpose assistants, Mythos was trained specifically to perform security research tasks: reading source code across millions of lines, forming hypotheses about vulnerable code paths, writing proof-of-concept exploits, and iterating until a working attack chain is confirmed. The model was kept in restricted preview for over a year before its April 7, 2026 announcement because Anthropic’s internal red teams confirmed it could assist with real-world offensive operations — including completing a 32-step corporate network attack simulation that human experts estimate would take 20 hours, in 3 of 10 controlled attempts. The decision to restrict rather than broadly release the model reflects Anthropic’s Responsible Scaling Policy: Mythos crossed an internal threshold requiring mandatory containment measures before any external access. The result is a model that is simultaneously the most powerful defensive security tool ever deployed at scale and one of the most carefully gated AI releases in the industry’s history. ...

May 17, 2026 · 18 min · baeseokjae
Google ADK vs LangGraph vs Mastra 2026: Choosing the Right Agent Framework

Google ADK vs LangGraph vs Mastra 2026: Choosing the Right Agent Framework

The global AI agent market reached $7.84 billion in 2025 and is projected to hit $52.62 billion by 2030 at a 46.3% CAGR. Three frameworks account for most serious production deployments in 2026: Google ADK, LangGraph, and Mastra. Choosing between them is not a question of which is best — it is a question of which fits your language, cloud, and complexity requirements. The 2026 Agent Framework Landscape: Why This Decision Matters Gartner predicts 40% of enterprise applications will embed task-specific AI agents by end of 2026, up from less than 5% in 2025 — a shift that makes framework selection a foundational infrastructure decision rather than a library choice. The wrong framework locks months of codebase and team skill into an architecture that resists migration. LangGraph leads the Python ecosystem with 34.5 million monthly downloads and 24,000+ GitHub stars, backed by production deployments at Uber, JP Morgan, BlackRock, Cisco, LinkedIn, and Klarna. Mastra dominates the TypeScript side with 300,000+ weekly npm downloads, 22,000+ GitHub stars, and a $13M seed round in February 2026, with enterprise adoption at Replit, PayPal, Adobe, Marsh McLennan (75,000 employees), and SoftBank’s Satto Workspace. Google ADK graduated to 1.0 GA with 8,200+ GitHub stars, multi-language support across Python, TypeScript, Go, and Java, and native A2A protocol support now governed by the Linux Foundation across 150+ production organizations. All three have reached production maturity — the decision criteria is fit, not quality. ...

May 17, 2026 · 16 min · baeseokjae
How Cursor Hit $2B ARR: Product Decisions That Shaped AI IDE Dominance

How Cursor Hit $2B ARR: Product Decisions That Shaped AI IDE Dominance

Cursor hit $2B in annualized recurring revenue in February 2026 — doubling from $1B in a single quarter. Zero marketing dollars. Four MIT students. Three years. Here is the breakdown of every product decision that compounded into the fastest SaaS ramp in history. From MIT CSAIL to $2B ARR: The Three-Year Sprint Nobody Saw Coming Cursor is an AI-first IDE built by Anysphere, a company founded in 2022 by four MIT Computer Science and Artificial Intelligence Laboratory students: Michael Truell, Sualeh Asif, Arvid Lunnemark, and Aman Sanger. In just under three years, they scaled the company from a dorm-room experiment to a $29.3B valuation on $2B ARR — outpacing every B2B SaaS company ever measured, including Wiz (18 months to $100M), Deel (20 months), Ramp (24 months), Slack, Zoom, and Snowflake. The four founders had no enterprise sales team when they crossed $100M ARR. They had no marketing department. What they had was a product that developers immediately understood was categorically different from anything that existed before. Cursor’s revenue trajectory follows a steep exponential: $100M ARR by January 2025, $500M by June 2025, $1B by November 2025, $2B by February 2026. That second billion arrived in approximately 90 days — a rate of growth the B2B software industry had never seen at that scale. By April 2026, the company had reached slight gross-margin profitability and was forecasting a $6B+ annualized run rate by year-end. The company now counts 1M+ paying customers, 2M+ monthly active users, 50,000+ enterprise teams, and representation from nearly 70% of the Fortune 1,000 in its customer base. ...

May 16, 2026 · 16 min · baeseokjae
OpenAI Codex Desktop Guide 2026: Full Agentic IDE Workflows and GPT-5-Codex

OpenAI Codex Desktop Guide 2026: Full Agentic IDE Workflows and GPT-5-Codex

OpenAI Codex Desktop는 GPT-5-Codex 모델을 기반으로 코드를 자율적으로 작성·수정·테스트하고 GitHub PR까지 생성하는 에이전트형 IDE 도구다. 단순한 자동완성 도구가 아니라, 하나의 지시만으로 멀티 파일 수정 → 테스트 실행 → PR 제출을 30분 안에 완료하는 완전 자율 코딩 에이전트다. What Is OpenAI Codex Desktop in 2026? OpenAI Codex Desktop은 2026년 현재 GPT-5.5 모델을 탑재한 자율 코딩 에이전트 플랫폼으로, Terminal-Bench 2.0 기준 82.7% 정확도로 모든 공개 모델 중 최고 성능을 기록하고 있다. 기존 GitHub Copilot이 줄 단위 자동완성에 집중했다면, Codex Desktop은 “이 버그 고쳐줘"라고 입력하면 저장소 전체를 분석하고, 관련 파일을 수정하고, 테스트를 통과시키고, PR까지 자동으로 열어주는 엔드투엔드 에이전트 워크플로를 실행한다. macOS(Apple Silicon M1 이상)와 Windows(2026년 3월 4일부터 공식 지원) 양쪽에서 네이티브 앱으로 동작하며, 로컬에서 실행하는 방식과 Codex Cloud에서 백그라운드로 실행하는 방식 모두 지원한다. 작업 완료 시간은 복잡도에 따라 1분에서 30분 사이이며, 팀 환경에서는 여러 에이전트를 병렬로 실행해 수일치 작업을 몇 시간으로 압축할 수 있다. AI 코딩 에이전트가 수동 코딩 시간을 30~50% 줄인다는 연구 결과처럼, Codex Desktop은 그 효과를 가장 직접적으로 실현하는 도구 중 하나다. 이 가이드는 설치부터 병렬 에이전트 운영, AGENTS.md 고급 설정까지 실무자 관점에서 단계별로 다룬다. ...

May 16, 2026 · 13 min · baeseokjae
Langfuse Acquired by ClickHouse: What It Means for Open-Source LLM Observability

Langfuse Acquired by ClickHouse: What It Means for Open-Source LLM Observability

On January 16, 2026, ClickHouse announced it had acquired Langfuse — the most widely deployed open-source LLM observability platform — alongside a $400M Series D that tripled ClickHouse’s valuation to $15 billion. The MIT license stays intact, self-hosting remains a first-class option, and the Langfuse roadmap is unchanged. But this acquisition reshapes the competitive landscape for LLM monitoring in ways worth understanding before you commit to a toolchain. What Is Langfuse? A Quick Primer on the Platform Langfuse is an open-source LLM engineering platform that lets developers trace, evaluate, and debug AI applications in production. Founded in 2023 by Marc Klingen, Maximilian Deichmann, and Clemens Rawert as a Y Combinator W23 company, Langfuse grew from a debugging tool into a full-stack observability platform covering tracing, prompt management, evaluation pipelines, and a dataset playground for regression testing. By the end of 2025, Langfuse had over 20,000 GitHub stars, 26 million SDK installs per month, and was processing data for 2,300+ companies and billions of observations per month — a scale that few open-source AI infrastructure projects achieve in under three years. ...

May 16, 2026 · 13 min · baeseokjae
AI Developer Productivity Metrics 2026: Real Data From TELUS, Zapier, and Stripe

AI Developer Productivity Metrics 2026: Real Data From TELUS, Zapier, and Stripe

AI developer productivity in 2026 is no longer theoretical — companies like TELUS, Stripe, and Zapier have published hard numbers showing 30–250% productivity improvements, though the data reveals a troubling pattern: individual gains rarely translate to organizational delivery wins without deliberate measurement and workflow redesign. Why Developer Productivity Metrics Are Broken in the AI Era Developer productivity measurement in the AI era is fundamentally broken because the tools that generate value are also the tools that break traditional measurement. DORA metrics — deployment frequency, lead time for changes, change failure rate, time to restore — were designed for human-paced engineering workflows. When Stripe’s autonomous agents merge 1,300 pull requests per week with zero human-written code, deployment frequency spikes without reflecting genuine human productivity. When AI generates 41–46% of all code (GitHub’s 2026 data), lines of code per developer becomes meaningless as a baseline metric. The Harness engineering report found 89% of teams believe their current metrics accurately reflect AI’s impact — yet 94% of those same teams admit key factors like tech debt accumulation, AI validation time, and developer burnout are completely absent from their dashboards. This contradiction is the central measurement crisis in 2026 engineering: orgs feel productive, their tools tell them they’re productive, but the underlying delivery system is flying partially blind. The gap between self-reported and actual gains is real: METR’s survey of 349 technical workers found median self-reported speed increases of 3x, while organizational delivery metrics showed far more modest improvements. Understanding this paradox is the starting point for building measurement that actually works. ...

May 16, 2026 · 17 min · baeseokjae
Comet Opik Review 2026: Open-Source LLM Evaluation and Observability Platform

Comet Opik Review 2026: Open-Source LLM Evaluation and Observability Platform

Comet Opik is a fully open-source LLM evaluation and observability platform that lets teams trace LLM calls, run automated evaluations, and optimize prompts — all under the Apache 2.0 license with no feature gating between free and paid tiers. What Is Comet Opik? Comet Opik is an open-source LLM observability and evaluation platform built by Comet ML — a company with over seven years of history in ML experiment tracking. Released in mid-2024, Opik grew from zero to 12,500 GitHub stars in roughly eight to nine months, making it one of the fastest-growing projects in the LLM observability space. Unlike LangSmith (proprietary) or partially open alternatives, Opik exposes its full feature set under the Apache 2.0 license: tracing, automated evaluation metrics, LLM-as-a-judge workflows, prompt management, a Prompt Playground, and the Agent Optimizer. As of 2026, Opik processes over 40 million traces daily and is trusted by more than 150,000 developers, ranging from solo builders to Fortune 500 engineering teams. Comet was recognized in the 2026 Gartner Market Guide for AI Evaluation and Observability Platforms — a significant milestone for an open-source project in a market projected to reach $9.26 billion by 2030. The core value proposition is straightforward: a single, coherent platform that covers the entire LLM development lifecycle from prototype to production, without forcing teams to pay for observability features that competitors lock behind enterprise paywalls. ...

May 16, 2026 · 16 min · baeseokjae