Sdtimes iconSdtimesSep 30, 2026 ~7 min source read

SmartBear report finds a gap: leaders more confident in AI than practitioners are

SmartBear’s State of Software Quality and Testing 2026 survey shows strong executive faith that AI can catch its own errors, while software practitioners and real-world outcomes reveal less certainty — prompting many teams to keep human checks and adopt staged validation.

AI confidence is high, evidence lags behind, SmartBear report finds

Share this story

Send the public story page.

Useful takeaways from this story.

Most organizations keep humans in the loop: only 3% use only AI self-validation, while 84% use at least one human review step.

Teams use a three-stage validation approach: check specs before generation (46%), review before commit (49% review >60% of AI code), and test before release (60% test >60%).

The useful part

In fact, according to the survey, 46% of teams have shipped code that later failed, but of those, 69% still say that have a lot or complete confidence that the code is acting as it was created. Part of that validation includes having people checking AI's work to ensure the software works as intended and is not riddled with errors. Again, developers are more cautious about tests than leaders, with 56% reporting they trust AI tests more than human-written tests.

How it works

  • Web.dev provides actionable guidance and analysis for developers to test their sites and apps or start learning how…...
  • continue reading As any business leader will tell you, data is the lifeblood of organizations operating in the 21st century.
  • A company's ability to effectively gather and use data can make all the difference in its success.
  • A number of factors can compromise data's health, making it unmanageable and therefore unusable for today's businesses.
  • Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website.

What to take from it

So while AI is helping some testing teams achieve more coverage, it's not necessarily solving the problem of cost. continue reading Google is giving web developers a place to learn, create and solve problems on the web with the launch of web.dev. Organizations aren't quite ready to abandon testers, as only 3% of respondents say they rely solely on AI self-validation, while 84% use at least one form of human review for validation of AI-created tests, the report found.

Example or evidence

  • The cookie is used to store and identify a users' unique session ID for the purpose of managing user session on the website.
  • One of the key arguments against having AI test its own code is that reviewers cannot validate that code if they don't know what specification the AI is writing against, SmartBear wrote in the report.
  • Before generation: 46% of responders say they check that the specificaiton reflects the intent of the code before AI generates it.
  • Before commit: 49% report an independent review ofmore than 60% of code before commiting.

Details worth keeping

AI confidence is high, evidence lags behind, SmartBear report finds. The divide between what leaders believe and what practitioners see is wide, and it is up to the developers and engineers working with the software to make their results match the expectations of leadership, "whether or not they have the proper tools and processes to do so," the report noted. Validation has never been more important While the use of AI to test software is needed as AI generates more code at great speed, organizations need the right checks in place to verify its work throughout the development life cycle.

Related coverage

  • Devops: Something specific happened to software delivery in the past two years.
  • Infosecurity Magazine: A new report by ISACA found that 71% of orgs have not run AI incident response exercises as teams face rising pressure
  • Dev: Originally published at nlocoding.com Only 18% of developers trust their AI debugging assistant to suggest production-ready fixes without review.
  • Computerweekly: More and more code is being produced by AI tools. A poll finds that software teams are struggling to keep pace
  • Sdtimes: Artificial intelligence has become deeply embedded in the modern software development workflow.

More context around this story.

Test Creation Was Never the Bottleneck
Devops iconDevopsSep 9, 2026

Test Creation Was Never the Bottleneck

Something specific happened to software delivery in the past two years. The 2026 survey data is unusually clear about what it was. Sonar’s 2026 State of Code Developer Survey found that AI-generated or AI-assisted code accounted for 42% of code committed by respondents, with developers projecting that share to reach 65

Advanced AI Debugging Assistants: Real Results & 2026 Data
Dev iconDevSep 8, 2026

Advanced AI Debugging Assistants: Real Results & 2026 Data

Originally published at nlocoding.com Only 18% of developers trust their AI debugging assistant to suggest production-ready fixes without review. The other 82%? They’re still glued to Stack Overflow, tabs multiplying like rabbits. (Source: JetBrains State of Developer Ecosystem 2026) Software eats itself faster every y

Loading more related stories...

Keep reading in the app

Open the app view to save this story, compare related coverage, and continue from the same source.

Open in app