TRENDING
A mountain gorilla looks at the camera from green forest undergrowth
October 29, 2026
How to Compress Time-Series Metrics in Python With Gorilla Delta-of-Delta and XOR Encoding
A bronze-framed hourglass with white sand beside a small Ferris wheel ornament on a wooden table against a teal wall
October 29, 2026
NIST’s Final Post-Quantum Transition Report Puts Every Quantum-Vulnerable Public-Key Scheme on One 2030 and 2035 Clock, and Three Federal Documents Word the Deadline Three Ways
Six weathered stone columns of the Temple of Apollo at Delphi, Greece, standing on a stone platform above a valley of olive groves
October 29, 2026
Honeypots Recorded Probes Against Oracle E-Business Suite CVE-2026-101767 Seven Days After Its Patch, and the Finder’s Write-Up Is Dated Patch Day
Vintage silver stopwatch with a chain on a black background, its dial showing seconds from 5 to 60
October 29, 2026
How to Find a Slow Query in PostgreSQL 18 With pg_stat_statements, Read Its EXPLAIN ANALYZE Plan, and Fix It With the Right Index
A wooden Tower of Hanoi puzzle on a market table, with three pegs and stacked discs of different sizes
October 29, 2026
Two Labs’ Claimed Refutations of the Exponential Time Hypothesis Turn Verification Into a Statement-Reading Problem, and Their Lean Theorems Promise Only That a Constant Exists
29 Oct 2026
SXZ.io SXZ.io
  • Home
Search the Site
Popular Searches:
Technology Amazon AI
Recent Posts
A flock of snow geese in flight, seen as dark silhouettes against an orange and red sunset sky with layered clouds
How to Run Zero-Downtime Schema Migrations on PostgreSQL 18 and Block Unsafe ALTER TABLE Statements With a Python Lint Gate
October 28, 2026
An old green steel truss bridge resting on temporary supports beside a new arch bridge under completion on a river in Portland, Oregon
The Angular 2 Rewrite Turns a Migration Lesson Into a Security Bill: AngularJS Still Draws 533,480 Downloads a Week, and 10 Advisories Have No Open-Source Fix
October 28, 2026
Hundreds of yellow rubber ducks floating in a river enclosure during a duck race
WordPress 7.1.4 Closes an Unauthenticated Race in Its Own Update Routine, but 19 Older Branches Had No Backport Hours After Release
October 28, 2026
SXZ.io SXZ.io
  • Home

Categories

Articles 270 Posts
News 273 Posts
Learning Hub 243 Posts
Home/News/Offensive Security Researchers Say AI Guardrails Are Getting in Their Way
News

Offensive Security Researchers Say AI Guardrails Are Getting in Their Way

Offensive security researchers say AI guardrails from Anthropic and OpenAI, built to stop hackers, are also slowing down legitimate vulnerability research.

July 24, 2026 4 Min Read
68

For months, Anthropic and OpenAI have built vetted access programs and default safety guardrails to keep their most capable models out of the hands of malicious hackers. According to new reporting from TechCrunch, those same guardrails are now getting in the way of the legitimate offensive security researchers whose job is to find dangerous vulnerabilities before criminals do.

Table Of Content

  • Vetted Access Programs Built to Thread a Narrow Needle
  • Researchers Say the Guardrails Still Get in the Way
  • Workarounds: Local Models and Self-Imposed Limits
  • Why This Matters for Security Teams

Vetted Access Programs Built to Thread a Narrow Needle

The tension traces back to Anthropic’s Mythos and Fable models. In June 2026, the U.S. government imposed export control restrictions on both after a report suggested it was possible to bypass the guardrails meant to stop the models from being used to build and run cyberattacks. Those restrictions have since eased: Fable 5 returned to general access on July 1, while Mythos 5 remains available only to vetted U.S. organizations as part of the government’s review process, according to TechCrunch.

That kind of vetting is not unique to Mythos. Anthropic runs a comparable program called the Cyber Verification Program (CVP), which lets approved security teams work with fewer default restrictions. In a June 2 update on Project Glasswing, its effort to give partner organizations early access to Claude Mythos Preview for vulnerability scanning, Anthropic said it intends to scale up the CVP further, “which would grant Mythos-class capabilities to many more organizations for specific cyberdefense tasks.”

OpenAI runs a parallel effort called Trusted Access for Cyber (TAC), introduced in February 2026 and expanded in April with the release of GPT-5.4-Cyber, a version of GPT-5.4 tuned for defensive work with a lower refusal boundary and added binary reverse engineering capability, according to Help Net Security. Individuals verify their identity at chatgpt.com/cyber, while enterprises apply through an OpenAI representative; approved users get reduced friction around safeguards that would otherwise flag dual-use cyber activity.

Researchers Say the Guardrails Still Get in the Way

Despite those programs, TechCrunch spoke with several offensive security professionals who described guardrails that interfere with day-to-day work, vetted or not. Mark Dowd, a veteran vulnerability researcher who has spent decades finding and selling zero-days to Western governments, said on a cybersecurity podcast that “it’s not really comfortable to me that these random large companies are making arbitrary decisions about what is safe in security and what’s not.”

Chris Anley, chief scientist at security consultancy NCC Group, told TechCrunch that asking a model to try to exploit a bug is often how his team confirms a vulnerability is real and worth fixing. When a guardrail refuses that request outright, it slows down defenders just as much as it blocks attackers. “This is where the whole offensive versus defensive and guardrails part comes in, because ‘fix this code’ as a prompt is both an essential mechanism for defense but also a roadmap for finding critical vulnerabilities in the code base,” Anley said. “So at the same time, the same tool is both an offensive tool and a defensive tool, and the two can’t really be unpicked.” He compared the models to a hammer: “You can’t build a house without a hammer. It’s definitely a tool but it’s also irreducibly a weapon as well.”

Chris Thompson, chief executive of the security firm RemoteThreat and founder of the offensive-security event Offensive AI Con, told TechCrunch that in his experience the guardrails can be inconsistent, sometimes behaving differently from one day to the next.

Workarounds: Local Models and Self-Imposed Limits

Some researchers have adapted by working around the vetted programs entirely. Paolo Stagno, chief technology officer at Crowdfense, a firm that develops, acquires, and sells unknown vulnerabilities to government agencies, told TechCrunch his team uses frontier cloud models only for reverse engineering. For the more sensitive work of finding vulnerabilities and building exploits, they rely on open source models run locally, since sending that material to a cloud provider risks leaking it or having it absorbed into a future training run. Stagno said AI companies “essentially treat customers like children who need babysitting” with their vetted programs and guardrails.

Not every researcher sees the guardrails as an obstacle. Giuseppe Cali, who develops exploits for a living, told TechCrunch he uses AI mainly for reverse engineering and building supporting tools, not for the core work of discovering and weaponizing bugs. “I still want to own the actual bug discovery and weaponization myself and that wouldn’t change if all guardrails were lifted tomorrow,” Cali said. “I am jealous of my bugs, and I like this game too much to let models play it for me.”

One researcher at a smartphone component manufacturer, who spoke to TechCrunch on condition of anonymity because he is not authorized to talk to the press, said his employer is not part of Anthropic’s CVP, so its AI tools are largely unusable for vulnerability work: any hint that a prompt is security related and the model simply stops responding.

Why This Matters for Security Teams

The complaints point to a structural problem, not a one-off bug. Anthropic and OpenAI are both trying to build a single set of guardrails that separates legitimate vulnerability research from actual attack preparation, using the same prompts and the same underlying capability to do it. Anley’s framing, that the tool cannot be neatly split into offensive and defensive halves, is the crux of the issue: a restriction tight enough to stop a criminal will often catch a defender doing the identical task for a patch instead of an exploit.

For security teams evaluating whether to build workflows around Claude or GPT models, the practical takeaway is to check vetted-access status before relying on a frontier model for exploit-confirmation work, and to keep a fallback, such as a locally run open source model, ready for the sensitive stages of vulnerability research where cloud guardrails or data handling policies are not acceptable.

Tags:

AI SecurityAnthropicCybersecurityOpenAIVulnerability Research

Share

Airmen sit at computer monitors below an OPERATIONS CENTER sign, with wall-mounted status screens showing tracked metrics behind them
Previous Post

How to Trace and Debug a Local LangChain AI Agent With LangSmith

Delaware Air National Guard 1st Lt. Aaron Rosenmund teaches a cybersecurity assessment class during the Cyber Shield 2026 training exercise in Little Rock, Arkansas
Next Post

Zenity’s AgentForger Turns a ChatGPT Link Into a Forged AI Insider

No Comment! Be the first one.

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Latest
28 Oct
How to Run Zero-Downtime Schema Migrations on PostgreSQL 18 and Block Unsafe ALTER TABLE Statements With a Python Lint Gate
28 Oct
The Angular 2 Rewrite Turns a Migration Lesson Into a Security Bill: AngularJS Still Draws 533,480 Downloads a Week, and 10 Advisories Have No Open-Source Fix
Trending
October 28, 2026
How to Run Zero-Downtime Schema Migrations on PostgreSQL 18 and Block Unsafe ALTER TABLE Statements With a Python Lint Gate
October 28, 2026
The Angular 2 Rewrite Turns a Migration Lesson Into a Security Bill: AngularJS Still Draws 533,480 Downloads a Week, and 10 Advisories Have No Open-Source Fix
October 28, 2026
WordPress 7.1.4 Closes an Unauthenticated Race in Its Own Update Routine, but 19 Older Branches Had No Backport Hours After Release
October 28, 2026
How to Compress Time-Series Metrics in Python With Gorilla Delta-of-Delta and XOR Encoding
October 28, 2026
NIST’s Final Post-Quantum Transition Report Puts Every Quantum-Vulnerable Public-Key Scheme on One 2030 and 2035 Clock, and Three Federal Documents Word the Deadline Three Ways
October 28, 2026
Honeypots Recorded Probes Against Oracle E-Business Suite CVE-2026-101767 Seven Days After Its Patch, and the Finder’s Write-Up Is Dated Patch Day

Related Posts

Rows of server racks in a data center representing network infrastructure targeted by botnets
News

C0XMO Botnet Shows Why Old Router Firmware Still Matters

June 7, 2026
Close-up of a USB flash drive, representing physical data-theft risk in office security incidents
News

Fake IT Support Is Now Walking Through the Front Door

June 7, 2026
A phone security app on a smartphone resting on a laptop keyboard.
News

Everest Forms Pro Flaw Is Being Exploited to Create Rogue WordPress Admins

June 7, 2026
A customer-support representative wearing a headset against a dark studio background.
Articles

The Meta AI Support Hack Was a Plain Old Authorization Failure

June 7, 2026
SXZ.io SXZ.io
  • [email protected]

Categories

Articles
Learning Hub
News

All Rights Reserved by SXZ.io ©2026