Autoprompt is an open-source skill for coding agents that wraps planning, implementation, testing, review, and repair around tools like Claude Code, Codex, and OpenCode. According to the project’s own benchmark run, it solved 73 of 89 Terminal-Bench 2.1 tasks versus a 60-task baseline, raising pass rate from 67.42% to 82.02% and cutting failures by 45%. The trade-off is roughly 3x execution time and 2x tokens, making it most valuable on hard, ambiguous tasks.

What Is Autoprompt? (A Multi-Agent Orchestration Layer for Coding Agents)

Autoprompt is not a single coding agent. It is an agent-skill orchestration layer that sits on top of existing coding tools and sequences a full development lifecycle inside one invocation. The core idea is separation of concerns: the same model is prevented from planning a task, implementing it, approving its own work, and then verifying that approval.

The design deliberately stops short of unlimited autonomy. The orchestration loop runs until a decision requires authority the skill does not hold — for example, choosing between two competing designs or confirming a destructive action — at which point it pauses and asks the human. Everything else, from scoping to verification, is delegated to sub-agents that can run code and check real outcomes.

Because Agent Skills load only when relevant, Autoprompt stays out of the way during ordinary requests. It must be invoked explicitly. On Codex you call $autoprompt; on Oh My Pi you use /skill:autoprompt. This opt-in model means the orchestration loop is isolated from everyday prompts rather than hijacking every query you make.

The broader context matters. As a Dev.to analysis of the most popular AI coding skills notes, agent skills went from a quiet Anthropic format to repositories with more stars than many of the frameworks we build on. Autoprompt is riding that wave, which itself grew out of the Agent Skills format Anthropic popularized.

The Benchmark Claim: 45% Fewer Failures on Terminal-Bench 2.1

The headline number behind the “Autoprompt coding agent skill” search comes from a single measured run published by the author. On Terminal-Bench 2.1, the raw harness solved 60 of 89 tasks (67.42%). With Autoprompt wrapping the same harness, the count rose to 73 of 89 (82.02%).

That is +13 solved tasks and +14.61 percentage points. Failures dropped from 29 tasks to 16, which is where the 45% figure originates (13 fewer failures on a base of 29 is roughly 44.8%).

Here is the data in one table:

MetricBaseline (OpenCode 1.18.7)With AutopromptChange
Tasks solved60 / 8973 / 89+13
Pass rate67.42%82.02%+14.61 pp
Failures2916-44.8% (~45%)
HarnessOpenCode 1.18.7OpenCode 1.18.7Same setup

It is important to read this number honestly. This is one benchmark run, on one harness, published by the project’s own author. The GitHub README is explicit that the measured run used OpenCode 1.18.7 and that DeepSeek’s 82.7% on the leaderboard used its own separate setup and should be treated as a reference point only, not a comparable measurement. The result is strong evidence the design helps, not a promise you will reproduce exactly on your codebase.

How Autoprompt Works: The Plan-Build-Test-Review-Repair-Verify Loop

Under the hood, Autoprompt runs a layered pipeline that mirrors the way a small engineering team works. The loop, expressed as a sequence of stages, looks like this:

  • Plan: a sub-agent scopes the task, producing a plan before any code is written.
  • Build: an implementation sub-agent writes the changes against that plan.
  • Test: the work is executed and tests are run against real output.
  • Review: a reviewer sub-agent reads the diff with evidence in hand.
  • Repair: if the reviewer or the test run finds a defect, a repair stage fixes it.
  • Verify: the loop repeats until tests pass and the reviewer agrees, or a human decision is needed.

The “judge-with-evidence” property is what makes this different from a single agent that simply double-checks its own answer. The reviewer can actually run the code and disagree with the builder, so the verification is grounded in observable behavior rather than the model’s confidence about itself.

This carries an important corollary that shapes where you should use it: the review-and-repair stages only add value when there is something concrete to run and check. On tasks with no testable output, half the loop has nothing to do. The value concentrates on problems where correctness can be demonstrated.

The Real Cost: 3x Time and 2x Tokens

Accuracy does not come free. The expected trade-off, disclosed as a planning estimate rather than a measured figure, is roughly 3x wall-clock execution time and 2x token consumption. The author is explicit that timing and token logs were not retained, so these are planning estimates, not audited numbers.

Why is it so expensive? Every stage of the loop invokes the model again. A single task that one agent might complete in one pass becomes a sequence of plan, build, test, review, and possibly repair passes, each consuming tokens. Additional model calls, not faster reasoning, are what buy the accuracy.

That trade-off has a clear practical implication. If a task is trivial — a one-line fix, a rename, a mechanical edit — wrapping it in Autoprompt multiplies the cost for no benefit. The value is highest on hard, ambiguous, or easily-broken work where a failed attempt costs an expensive repair loop or rework downstream.

Which Coding Agents Does Autoprompt Support?

Autoprompt is not tied to one vendor. The repository reports nine audited coding agents:

AgentVersion floor
Claude Code2.1.219+
CodexCurrent
OpenCode1.18.7+
Kilo Code7.4.22+
VS Code1.133+
Prime AgentCurrent
Oh My PiCurrent
DeepSeek HarnessCurrent
ReasonixCurrent

The measured benchmark run used OpenCode 1.18.7. Invocation differs slightly by host: Codex uses $autoprompt, while Oh My Pi uses /skill:autoprompt. The skill runs comfortably on modest hardware; the SSD Nodes walkthrough demonstrates it on a small VPS using mode=custom max_subs=2 to keep concurrency low enough for the box.

Controlling Concurrency: mode=tokensaver, mode=wide, and mode=custom

Because the orchestration loop fans out into multiple sub-agents, concurrency control is a first-class feature. Autoprompt exposes three modes:

  • mode=tokensaver caps the number of concurrent sub-agents at 6, balancing speed against token burn.
  • mode=wide opens all lanes, maximizing parallelism at the highest token cost.
  • mode=custom lets you set max_subs=N directly and pass agents= for explicit model routing, giving fine-grained control.

For constrained environments, mode=custom max_subs=2 is the recommended setting mentioned in the SSD Nodes walkthrough — enough parallelism to help accuracy while staying inside small-VPS memory and token budgets. Model routing via the agents= argument also lets you assign cheap models to mechanical stages and stronger models to planning or review.

When Autoprompt Shines (and When It Doesn’t)

Community discussion, including a Reddit thread on having coding agents autonomously verify their own work, positions this class of tool as best suited to difficult tasks. The evidence supports a few clear boundaries.

Use Autoprompt when:

  • The task is hard, ambiguous, or easy to get subtly wrong.
  • Correctness can be demonstrated (there is something to run and verify).
  • A failed first attempt would be expensive to repair manually.
  • You have token and time budget to spend on verification.

Skip it when:

  • The change is trivial or mechanical.
  • There is nothing concrete to run and check.
  • You are highly token- or latency-sensitive.
  • You need maximum throughput for many small, independent tasks.

The honest summary from the research angles file is that the 45% reduction is one author-published run on one harness — evidence the design helps, not a number you will reproduce on any codebase. Budget the 3x time and 2x tokens into your decision, and reserve Autoprompt for problems where accuracy beats throughput.

How to Get Started (Install, Invoke, and Uninstall)

Installation is a single interactive command:

npm install -g autoprompt-skill && autoprompt

The npm package autoprompt-skill is at version 1.0.4, has zero dependencies, and records roughly 535 weekly downloads. The project is MIT-licensed, which is worth noting if you plan to modify or embed it.

After installing, invoke it explicitly depending on your host — $autoprompt on Codex, /skill:autoprompt on Oh My Pi. Explicit invocation is deliberate: it keeps the orchestration loop isolated from ordinary requests. Uninstall follows standard npm behavior with npm uninstall -g autoprompt-skill.

Adoption is visible. The project reported roughly 1,170 GitHub stars as of August 2026 per the SkillsLLM scan and about 419 listings on a JavaScript GitHub radar at the time of the ArsEntev summary, so it is growing quickly as part of the broader agent-skill ecosystem.

Final Verdict: Who Should Use Autoprompt in 2026

Autoprompt earns its attention for one reason: it addresses a real weakness of single coding agents, the blind spot where the same model plans, executes, and then approves its own work. By splitting those roles and making the reviewer run actual code, it builds genuine verification into the loop. The result, on the author’s published run, is a meaningful accuracy gain.

But “autoprompt coding agent skill” reviews must be candid about the caveats. The headline figures come from one harness and one author-run. The 3x time and 2x token costs are estimates, not audited metrics. And the skill’s value collapses on trivial tasks or any work with nothing to run.

The verdict for 2026: if you handle hard, verifiable coding tasks, have token budget to spare, and want a controlled, opt-in orchestration layer rather than a tool that rewrites every prompt, Autoprompt is worth adding to your stack. If your workload is mostly small, mechanical, or throughput-bound, spend your tokens elsewhere. Test it on one genuinely hard task first, measure the real time and token cost on your setup, and decide with your own numbers rather than a benchmark from the README.

FAQ

What is the autoprompt coding agent skill? Autoprompt is an open-source Agent Skills module that wraps a plan, build, test, review, repair, and verify loop around coding agents like Claude Code, Codex, and OpenCode, running until the work passes or a human decision is required.

Does Autoprompt really cut failures by 45%? In the author’s published run on Terminal-Bench 2.1, failures fell from 29 to 16 tasks, which is about 45% fewer. It is a single measured run on OpenCode 1.18.7 published by the author, so treat it as evidence the design helps rather than a universal guarantee.

What are the costs of using Autoprompt? The disclosed planning estimates are roughly 3x wall-clock time and 2x token consumption, driven by the extra model calls each pipeline stage makes. Timing and token logs were not retained, so these are estimates rather than measured figures.

Which tools does Autoprompt work with? The repository reports nine audited coding agents including Claude Code 2.1.219+, Codex, OpenCode 1.18.7+, Kilo Code 7.4.22+, VS Code 1.133+, Prime Agent, Oh My Pi, DeepSeek Harness, and Reasonix.

How do I install Autoprompt? Run npm install -g autoprompt-skill && autoprompt interactively. The package is at version 1.0.4 with zero dependencies and is MIT-licensed.