Skip to main content
LLMgram · AI News · 2026-08-18

Microsoft Research Webwright lifts GPT-5.4 long-horizon web tasks from 33.5% to 60.1%

Microsoft Research Webwright lifts GPT-5.4 long-horizon web tasks from 33.5% to 60.1%

Microsoft Research's Webwright reframes web automation by giving agents a terminal to write and run code instead of clicking through interfaces step by step. Towards Data Science reports that on long-horizon web tasks, the same GPT-5.4 model rises from 33.5% to 60.1% success and leaves a reusable command-line tool rather than a click trace. The article ties click-based agents' failures to cumulative errors from visual state tracking on extended workflows, while generated code offers more auditable execution. For builders, that points toward treating web automation as code generation rather than a computer-vision loop, which may improve reliability and reduce infrastructure tied to fragile GUI parsing. The packet excerpt cuts off benchmark details and does not confirm task definitions or deployment limits behind the cited percentages.

Sources

Microsoft Research Webwright lifts GPT-5.4 long-horizon web tasks from 33.5% to 60.1%

Microsoft Research Webwright lifts GPT-5.4 long-horizon web tasks from 33.5% to 60.1%

Microsoft Research's Webwright gives web agents a terminal to write and run code instead of clicking step by step. On long-horizon tasks, the same GPT-5.4 model jumps from 33.5% to 60.1% success, and leaves a reusable command-line tool rather than a click trace.

Key takeaway

Code generation via a terminal is a more robust paradigm for long-horizon web automation than step-by-step visual clicking.

What happened

According to Towards Data Science, Microsoft Research's Webwright gives web agents a terminal to write and run code instead of clicking step by step through graphical interfaces.

The same reporting states that on long-horizon web tasks, GPT-5.4 success jumps from 33.5% to 60.1% under Webwright and the run produces a reusable command-line tool rather than a click trace.

Evidence

  • Webwright lets web agents write and run code via a terminal instead of clicking step by step.

    Towards Data Science · attributed

    Microsoft Research's Webwright gives web agents a terminal to write and run code instead of clicking step by step.

  • On long-horizon tasks, GPT-5.4 success rises from 33.5% to 60.1% with Webwright.

    Towards Data Science · attributed

    On long-horizon tasks, the same GPT-5.4 model jumps from 33.5% to 60.1% success

  • Webwright leaves a reusable command-line tool rather than a click trace.

    Towards Data Science · attributed

    leaves a reusable command-line tool rather than a click trace.

  • Code generation outperforms click-based agents on complex tasks and replaces fragile visual state tracking.

    Towards Data Science · attributed

    giving LLMs a terminal to write code outperforms traditional click-based agents on complex tasks, boosting success rates from 33.5% to 60.1% with GPT-5.4. This approach replaces fragile visual state tracking wi…

  • Shifting from GUI clicking to code generation improves long-horizon reliability by reducing cumulative error rates.

    Towards Data Science · attributed

    Shifting from GUI-based clicking to code generation for web agents significantly improves long-horizon task reliability by reducing cumulative error rates.

Why it matters

Builders may cut fragile GUI-tracking costs and gain auditable, reusable CLI artifacts by framing web agents as programmers rather than clickers.

Limits and uncertainties

Packet excerpts truncate benchmark methodology and task definitions behind the 33.5% and 60.1% figures.

Coverage is a Towards Data Science article summary rather than full primary Microsoft Research publication detail in the packet.

Practical implications

Prefer terminal code-generation workflows over step-by-step click traces when automating long-horizon web tasks.

Design agent pipelines to emit reusable command-line tools that can be rerun and audited instead of brittle GUI action logs.

What to watch

Whether Microsoft Research publishes full benchmark specs, task sets, and constraints behind the GPT-5.4 long-horizon results.

How Webwright-style code agents perform outside the cited long-horizon web task setting described in the article.

Sources

LLMgram editorial selection and synthesis · @llmgram. LLMgram is not the original publisher of this information.
Continue on LLMgram: Open in AI Signal →
Original reporting: Webwright: Why AI Web Agents Should Write Code, Not Click