Security/paper/2026-10-02

Off-By-1 Labs Study Assesses AI Effectiveness in Applying Vulnerability Patches

A study by Off-By-1 Labs, reported by NewsBytes, found that AI-generated vulnerability patches were effective in a low percentage of cases. The study indicates that AI successfully fixed approximately one-quarter of patches in open-source projects. The central claim regarding the effectiveness rate originates solely from Off-By-1 Labs.

2 articles from 1 outlet covered this story. The underlying claim is sourced from a paper.

What do all outlets agree on?

1 outlet covered “Off-By-1 Labs Study Assesses AI Effectiveness in Applying Vulnerability Patches”. All of them report the following:

  • Off-By-1 Labs conducted a study
  • Study focused on AI vulnerability patches
  • Study examined open-source projects
  • AI-generated patches had low effectiveness

Which figures do outlets report differently?

1 figure in this story is reported with conflicting values:

AI patch effectiveness25% vs 26%

Which outlets covered this?

All 2 articles found on this story, grouped by the stance of the piece. Every link goes to the original publisher.

What related stories are there?

Which companies does this involve?

Get the week in AI in one email

What happened, which outlets reported it, and where their coverage differed. One issue a week.

The first issue hasn’t gone out yet. Subscribe and it’s the one you’ll get.

We’ll send the digest and nothing else. One-click unsubscribe. Privacy.