<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/"><channel><title>Research Software on RockB</title><link>https://baeseokjae.github.io/tags/research-software/</link><description>Recent content in Research Software on RockB</description><image><title>RockB</title><url>https://baeseokjae.github.io/images/og-default.png</url><link>https://baeseokjae.github.io/images/og-default.png</link></image><generator>Hugo</generator><language>en-us</language><lastBuildDate>Sat, 01 Aug 2026 21:02:06 +0000</lastBuildDate><atom:link href="https://baeseokjae.github.io/tags/research-software/index.xml" rel="self" type="application/rss+xml"/><item><title>Scientific Computing in the Age of Agentic AI: OpenAI's Vision for Research Software</title><link>https://baeseokjae.github.io/posts/scientific-computing-agentic-ai-openai/</link><pubDate>Sat, 01 Aug 2026 21:02:06 +0000</pubDate><guid>https://baeseokjae.github.io/posts/scientific-computing-agentic-ai-openai/</guid><description>OpenAI&amp;#39;s field report on 8 agent-assisted scientific computing projects reveals how coding agents transform research software development, shifting scientists from builders to verifiers.</description><content:encoded><![CDATA[<p>Scientific computing is undergoing a fundamental transformation as agentic AI systems take on increasingly complex roles in research software development. OpenAI&rsquo;s July 2026 field report on eight agent-assisted scientific computing projects demonstrates that coding agents like Codex and Claude Code can modernize legacy research libraries, automate simulation workflows, and free scientists to focus on verification and discovery rather than implementation. This shift promises to accelerate research across life sciences, materials science, and beyond.</p>
<h2 id="what-is-openais-vision-for-agentic-ai-in-scientific-computing">What Is OpenAI&rsquo;s Vision for Agentic AI in Scientific Computing?</h2>
<p>OpenAI&rsquo;s exploratory field report, published in July 2026, documents eight projects where agentic AI systems were deployed to tackle real scientific computing challenges. The projects span genomic data parsing, immunology prediction, sequence alignment, gravitational wave analysis, and materials simulation. Five projects used Codex alone, while three employed a combination of Codex and Claude Code to handle different aspects of the workflow.</p>
<p>The central thesis is clear: agentic AI can dramatically reduce the engineering burden that has long constrained scientific software development. Rather than treating coding agents as simple autocomplete tools, OpenAI positions them as autonomous collaborators capable of understanding project context, navigating legacy codebases, and iterating toward working solutions with minimal human intervention.</p>
<h2 id="why-is-scientific-software-maintenance-a-crisis">Why Is Scientific Software Maintenance a Crisis?</h2>
<p>Research software is notoriously fragile. A 2022 study published in Nature Scientific Data (doi:10.1038/s41597-022-01143-6) found that scientific research software often fails to install properly in fresh computing environments or run as documented. This reproducibility crisis is compounded by the fact that much of this software is maintained by graduate students and postdocs who move on to other positions, leaving critical tools orphaned.</p>
<p>A study in PLoS Biology (doi:10.1371/journal.pbio.3000333) revealed that researchers using omics tools spend substantial time on configuration and debugging rather than actual research. This maintenance tax slows discovery and creates barriers to entry for labs without dedicated software engineering support.</p>
<table>
  <thead>
      <tr>
          <th>Problem</th>
          <th>Impact</th>
          <th>Source</th>
      </tr>
  </thead>
  <tbody>
      <tr>
          <td>Software fails to install in fresh environments</td>
          <td>Reproducibility crisis</td>
          <td>Nature Scientific Data, 2022</td>
      </tr>
      <tr>
          <td>Researchers spend more time debugging than researching</td>
          <td>Reduced scientific output</td>
          <td>PLoS Biology, 2020</td>
      </tr>
      <tr>
          <td>Maintainers leave academia after short tenures</td>
          <td>Orphaned tools and libraries</td>
          <td>OpenAI Field Report, 2026</td>
      </tr>
      <tr>
          <td>Legacy build systems incompatible with modern toolchains</td>
          <td>Inability to leverage new hardware</td>
          <td>OpenAI Field Report, 2026</td>
      </tr>
  </tbody>
</table>
<p>Agentic AI directly addresses these pain points by making engineering labor less of a constraint. When an AI agent can modernize a legacy build system or port a library to GPU acceleration in hours rather than weeks, the bottleneck shifts from implementation capacity to the validation of agent output.</p>
<h2 id="what-did-openais-eight-case-studies-reveal">What Did OpenAI&rsquo;s Eight Case Studies Reveal?</h2>
<p>The eight projects in OpenAI&rsquo;s report cover a diverse range of scientific computing challenges:</p>
<h3 id="cyvcf2-modernizing-genomic-data-parsing">Cyvcf2: Modernizing Genomic Data Parsing</h3>
<p>The cyvcf2 library, a widely used VCF (Variant Call Format) parser in genomics, was modernized using GPT-5.5 to update its legacy build and packaging systems. This project demonstrated that agentic AI can handle the tedious but critical work of bringing research software into compliance with modern toolchains, enabling better performance and easier installation.</p>
<h3 id="mhcflurry-immunotherapy-prediction">MHCflurry: Immunotherapy Prediction</h3>
<p>MHCflurry, a tool for predicting peptide-MHC binding affinity used in immunotherapy research, was refactored with agent assistance. The project showed how agents can navigate complex scientific codebases and make targeted improvements without breaking established functionality.</p>
<h3 id="rustar-aligner-sequence-alignment">Rustar-Aligner: Sequence Alignment</h3>
<p>The rustar-aligner project involved porting sequence alignment algorithms to Rust for improved performance. This case study highlighted the ability of coding agents to work across programming languages and optimize scientific code for modern hardware.</p>
<h3 id="gravitational-wave-data-analysis">Gravitational Wave Data Analysis</h3>
<p>A separate study on arXiv (2605.28916) conducted the first head-to-head comparison of agentic AI systems — Claude Code versus Codex — applied to gravitational wave data analysis. Both systems were tasked with autonomously executing an end-to-end scientific data analysis pipeline. The researchers found behavioral differences with significant implications for reproducibility and deployment in scientific workflows.</p>
<h3 id="genius-autonomous-simulation-protocols">GENIUS: Autonomous Simulation Protocols</h3>
<p>Beyond OpenAI&rsquo;s report, the GENIUS framework, published in Nature Communications Engineering in 2026, demonstrated an agentic AI system that autonomously designs and executes simulation protocols. GENIUS automates Quantum ESPRESSO input generation and error recovery, democratizing electronic-structure simulations for integrated computational materials engineering (ICME) applications worldwide.</p>
<h2 id="how-does-the-researchers-role-change-from-builder-to-verifier">How Does the Researcher&rsquo;s Role Change from Builder to Verifier?</h2>
<p>One of the most profound shifts documented in OpenAI&rsquo;s report is the changing role of the research scientist. When agents handle implementation, the scientist&rsquo;s primary function evolves from writing code to verifying and orchestrating agent output.</p>
<p>This transition mirrors earlier shifts in scientific computing — from writing assembly to using high-level languages, from manual memory management to garbage-collected runtimes. Each abstraction layer freed researchers to think at higher levels. Agentic AI represents the next abstraction: researchers now specify what they want, and agents figure out how to build it.</p>
<p>The implication is that future scientists will need stronger skills in:</p>
<ul>
<li><strong>Prompt engineering and task decomposition</strong>: Breaking complex scientific problems into agent-manageable subtasks</li>
<li><strong>Code review and validation</strong>: Verifying that agent-generated code produces correct scientific results</li>
<li><strong>Integration thinking</strong>: Understanding how agent-produced components fit into larger research pipelines</li>
<li><strong>Numerical precision awareness</strong>: Catching edge cases that agents may overlook</li>
</ul>
<h2 id="what-is-the-last-mile-challenge-in-agent-generated-code">What Is the &ldquo;Last Mile&rdquo; Challenge in Agent-Generated Code?</h2>
<p>OpenAI&rsquo;s report identifies a critical pattern: agents produce quick initial implementations, but the &ldquo;last mile&rdquo; — handling edge cases, ensuring numerical precision, and achieving production-grade robustness — takes disproportionate effort.</p>
<p>This finding aligns with broader software engineering experience. An AI agent can scaffold a working solution in minutes, but the remaining 20% of functionality often consumes 80% of the total effort. In scientific computing, where numerical accuracy and edge-case handling directly impact research validity, this last mile is especially consequential.</p>
<table>
  <thead>
      <tr>
          <th>Phase</th>
          <th>Agent Time</th>
          <th>Human Time</th>
          <th>Key Challenges</th>
      </tr>
  </thead>
  <tbody>
      <tr>
          <td>Initial implementation</td>
          <td>Minutes to hours</td>
          <td>Days to weeks</td>
          <td>Scaffolding, basic functionality</td>
      </tr>
      <tr>
          <td>Edge case handling</td>
          <td>Hours to days</td>
          <td>Days</td>
          <td>Boundary conditions, error states</td>
      </tr>
      <tr>
          <td>Numerical validation</td>
          <td>Hours</td>
          <td>Days to weeks</td>
          <td>Precision, floating-point behavior</td>
      </tr>
      <tr>
          <td>Production hardening</td>
          <td>Days</td>
          <td>Weeks</td>
          <td>Error recovery, performance tuning</td>
      </tr>
      <tr>
          <td>Documentation</td>
          <td>Minutes</td>
          <td>Hours</td>
          <td>API docs, usage examples</td>
      </tr>
  </tbody>
</table>
<p>The report emphasizes that feedback-driven iteration outperforms one-shot approaches. Agents that can see error messages, adjust their approach, and retry produce significantly better results than those that attempt to generate the complete solution in a single pass.</p>
<h2 id="how-do-we-ensure-long-term-stewardship-of-agent-modified-code">How Do We Ensure Long-Term Stewardship of Agent-Modified Code?</h2>
<p>A paradox emerges from OpenAI&rsquo;s findings: lower implementation costs risk fragmenting the scientific software ecosystem. When any researcher can use an agent to create a custom fork or variant of a tool, the scientific community may face a proliferation of incompatible versions.</p>
<p>OpenAI&rsquo;s report stresses that long-term stewardship and proper attribution are essential to prevent this fragmentation. Key recommendations include:</p>
<ul>
<li><strong>Centralized repositories</strong>: Maintaining canonical versions of agent-modified libraries in established repositories</li>
<li><strong>Attribution tracking</strong>: Clearly documenting which parts of a codebase were agent-generated and which were human-authored</li>
<li><strong>Testing infrastructure</strong>: Automated test suites that validate agent contributions against scientific benchmarks</li>
<li><strong>Community governance</strong>: Clear ownership models for agent-maintained projects</li>
</ul>
<p>The Nature portfolio has published at least six papers on agentic AI in scientific contexts in 2025-2026 alone, spanning X-ray crystallography, neurodegenerative disease diagnosis, materials science, and rare disease diagnosis. This rapid publication rate underscores both the promise and the urgency of establishing stewardship norms.</p>
<h2 id="what-is-the-broader-agentic-science-landscape-beyond-openai">What Is the Broader Agentic Science Landscape Beyond OpenAI?</h2>
<p>OpenAI&rsquo;s report is part of a much larger movement. Nature has published multiple studies demonstrating agentic AI in action:</p>
<ul>
<li><strong>Autonomous X-ray crystallography</strong>: An agentic AI system that autonomously aligns single crystals at synchrotron beamlines, published in Nature Machine Intelligence (doi:s42256-026-01261-5)</li>
<li><strong>Agentic science frameworks</strong>: A Nature Comment article (doi:s42256-025-01110-x) outlines how AI is transforming scientific discovery through semi-autonomous agents capable of reasoning, planning, and interacting with digital and physical environments</li>
<li><strong>Materials simulation automation</strong>: The GENIUS framework for autonomous Quantum ESPRESSO workflows, published in Nature Communications Engineering (doi:s43246-026-01167-0)</li>
</ul>
<p>These developments span the full spectrum of scientific computing: from routine maintenance tasks to GPU-native redesigns to fully autonomous laboratory experimentation. The common thread is that agentic AI is not merely accelerating existing workflows — it is enabling entirely new approaches to research that were previously impractical.</p>
<h2 id="how-do-codex-and-claude-code-compare-for-scientific-workflows">How Do Codex and Claude Code Compare for Scientific Workflows?</h2>
<p>The head-to-head comparison published on arXiv (2605.28916) provides the first systematic evaluation of competing agentic AI systems in a scientific computing context. Both Codex and Claude Code were tasked with autonomously executing an end-to-end gravitational wave data analysis pipeline.</p>
<table>
  <thead>
      <tr>
          <th>Dimension</th>
          <th>Codex</th>
          <th>Claude Code</th>
      </tr>
  </thead>
  <tbody>
      <tr>
          <td>Initial setup speed</td>
          <td>Faster scaffolding</td>
          <td>More thorough exploration</td>
      </tr>
      <tr>
          <td>Error recovery</td>
          <td>Iterative retry</td>
          <td>Context-aware debugging</td>
      </tr>
      <tr>
          <td>Code quality</td>
          <td>Functional, sometimes verbose</td>
          <td>Concise, well-structured</td>
      </tr>
      <tr>
          <td>Scientific accuracy</td>
          <td>Good for standard methods</td>
          <td>Better for edge cases</td>
      </tr>
      <tr>
          <td>Documentation generation</td>
          <td>Automatic</td>
          <td>Requires prompting</td>
      </tr>
      <tr>
          <td>Integration handling</td>
          <td>Strong with Python ecosystem</td>
          <td>Strong with multi-language projects</td>
      </tr>
  </tbody>
</table>
<p>The behavioral differences have direct implications for scientific reproducibility. Researchers found that the choice of agent system affects not just speed but the nature of the output — different agents make different assumptions, handle errors differently, and produce code with different structural characteristics. For scientific computing, where reproducibility is paramount, these differences matter.</p>
<h2 id="what-are-the-implications-for-the-future-of-scientific-discovery">What Are the Implications for the Future of Scientific Discovery?</h2>
<p>The convergence of agentic AI and scientific computing points toward several transformative outcomes:</p>
<p><strong>Democratization of computational research</strong>: Tools like GENIUS make advanced simulation techniques accessible to labs without specialized computational expertise. A materials science lab that previously could not run Quantum ESPRESSO simulations can now do so with agent guidance.</p>
<p><strong>Accelerated iteration cycles</strong>: When agents handle implementation, researchers can test more hypotheses in less time. The bottleneck shifts from &ldquo;can we build this?&rdquo; to &ldquo;should we build this?&rdquo; — a fundamentally more strategic question.</p>
<p><strong>New research modalities</strong>: Autonomous agents that can run experiments, analyze results, and adjust parameters in real time open the door to closed-loop discovery systems that operate at scales impossible for human researchers alone.</p>
<p><strong>Reproducibility challenges</strong>: The same agents that accelerate discovery also introduce new reproducibility concerns. Agent-generated code may behave differently across runs, and the stochastic nature of LLM outputs means that the same prompt can produce different implementations.</p>
<h2 id="conclusion-agents-as-tools-not-replacements">Conclusion: Agents as Tools, Not Replacements</h2>
<p>OpenAI&rsquo;s field report makes a compelling case that agentic AI is becoming an indispensable tool in scientific computing. The eight case studies demonstrate real, measurable impact on research software development — from modernizing legacy libraries to enabling entirely new computational workflows.</p>
<p>However, the report also makes clear that agents are tools, not replacements. The researcher&rsquo;s role evolves from implementation to verification, but it does not disappear. Scientific judgment, domain expertise, and rigorous validation remain essential. The best outcomes in OpenAI&rsquo;s study came from tight human-agent collaboration, where scientists provided domain knowledge and agents handled implementation details.</p>
<p>As agentic AI continues to mature, the scientific community must develop norms, tools, and practices for integrating these systems responsibly. The promise is enormous: faster discovery, broader access to computational methods, and liberation from the maintenance crisis that has long plagued research software. The challenge is ensuring that speed does not come at the cost of rigor.</p>
<h2 id="frequently-asked-questions">Frequently Asked Questions</h2>
<p><strong>What is agentic AI in scientific computing?</strong>
Agentic AI in scientific computing refers to autonomous AI systems — primarily large language model-based coding agents — that can understand research software contexts, write and modify code, debug errors, and iterate toward working solutions with minimal human intervention, applied to scientific research software development and data analysis.</p>
<p><strong>How did OpenAI evaluate agentic AI for scientific computing?</strong>
OpenAI published an exploratory field report in July 2026 documenting eight agent-assisted scientific computing projects, five using Codex alone and three using Codex combined with Claude Code. The projects spanned genomics, immunology, sequence alignment, and gravitational wave analysis.</p>
<p><strong>What is the &ldquo;last mile&rdquo; problem in agent-generated scientific code?</strong>
The &ldquo;last mile&rdquo; problem refers to the observation that AI agents produce quick initial implementations, but handling edge cases, ensuring numerical precision, and achieving production-grade robustness takes disproportionate effort — often 80% of the total project time despite representing only 20% of the functionality.</p>
<p><strong>How does the researcher&rsquo;s role change with agentic AI?</strong>
Researchers shift from being implementers — writing and debugging code — to being verifiers and orchestrators who specify scientific requirements, review agent output for correctness, and ensure that generated code produces valid scientific results. This requires stronger skills in prompt engineering, code review, and numerical validation.</p>
<p><strong>Can agentic AI replace human scientists in research computing?</strong>
No. OpenAI&rsquo;s report emphasizes that agents are tools, not replacements. Scientific judgment, domain expertise, and rigorous validation remain essential. The best outcomes come from tight human-agent collaboration where scientists provide domain knowledge and agents handle implementation details.</p>
]]></content:encoded></item></channel></rss>