Dreadnode

Incoming: Dreadnode paper drop from Shane Caldwell and the crew.

PentestJudge—Judging Agent Behavior Against Operational Requirements: arxiv.org/abs/2508.02921

Explore how we built an LLM-as-judge system for evaluating the operations of pentesting agents (inspired by PaperBench).

✍ After talking AI Action Plan on @cyberscoop.bsky.social, wrote up @dreadnode.bsky.social thoughts on implementation ➡️ dreadnode.io/blog/five-ta...

‼️ While we debate frameworks, adversaries build AI attack capabilities. We need: evaluation ecosystems, red teaming, and procurement standards.

Evals: The Foundation for Autonomous Offensive Security Learn how to build robust evaluations for autonomous red team agents that can perform Windows Active Directory operations. This blog covers action space design, programmatic verification, and measurin...

In our latest blog, Shane Caldwell breaks down the process of creating a fully integrated, self-verifying agentic system that can do modern Windows Active Directory red team operations, without human interaction.

Read it here: dreadnode.io/blog/evals-t...

Building and Deploying Offensive Security Agents with Dreadnode YouTube video by Off By One Security

Rise and shine! We're going live on Off By One with Stephen Sims this afternoon—meet us here at 11 AM PT: www.youtube.com/live/BzOmGw-...

At Military Cyber Professionals Association's #HammerCon event today? Hear Daria present on this topic at 2 PM in the Growing Innovations in Tech (GIT) track, or connect with the crew at our booth!

From Compute to Congress: Setting the Global Standard for AI Security Daria explores how the TEST AI Act and red teaming standards can establish American leadership in AI security—a winning policy roadmap from Critical Effect DC 2025.

In this edition of our From Compute to Congress policy blog series, Dreadnode Head of Policy Daria Bahrami explores how the TEST AI Act and red teaming standards can establish U.S. leadership in AI security: dreadnode.io/blog/from-co...

AI Red Teaming Case Study: Claude 3.7 Sonnet Solves the Turtle Challenge See how Claude solved a notoriously difficult AI/ML CTF challenge, going beyond pattern matching to genuine problem-solving under adversarial conditions.

Read @rad-ads.bsky.social's breakdown of Claude's attack sequence against the notoriously hard-to-solve "turtle" challenge: dreadnode.io/blog/ai-red-...

Introducing AIRTBench, an AI red teaming benchmark for evaluating language models’ ability to autonomously discover and exploit AI/ML security vulnerabilities.

Read the paper on arXiv: arxiv.org/abs/2506.14682

Open-source dataset and benchmark eval code repo: github.com/dreadnode/AI...

GitHub - vmsv/pivot2025-llmworkshop Contribute to vmsv/pivot2025-llmworkshop development by creating an account on GitHub.

Check out @machinavelli.com's "Build with AI" Rigging workshop from @pivotcon.bsky.social: github.com/vmsv/pivot20...

v3 of Rigging is out now. If you’re working with LLMs to build agents or run evaluations, check it out. We just added:

- Prompt caching for supported providers
- A unified tool system for function calling and fallbacks to xml/json parsing
- Native MCP integration

docs.dreadnode.io/open-source/...

Introducing our new blog series: "From Compute to Congress: Decoding AI Policy" by Dreadnode Head of Policy Daria Bahrami | Read the first post here: dreadnode.io/blog/from-co...

Are manual or automated attacks more effective when attacking LLMs?

We found that automated approaches achieve significantly higher success rates (69.5%) compared to manual techniques (47.6%).

More insights on LLM attack execution methods here 👉 dreadnode.io/blog/the-aut...

Strikes waitlist. Now open.

platform.dreadnode.io/waitlist/str...

[must have a Dreadnode account]

What's your take on the growing dominance of automated attacks and the implications for AI red teams? Here's ours— based on our analysis of 30 LLM challenges, attempted by 1,674 unique Crucible users, across 214,271 attack attempts: arxiv.org/abs/2504.19855

YouTube video by CyberScoop Dreadnode CEO Will Pearce on the ever-changing field of offensive AI security

@moohax.bsky.social joins @gregotto.bsky.social on CyberScoop's Safe Mode podcast! Tune in at the 10-minute mark for a discussion on how AI fits into the offensive security narrative and what it means for tooling and defenses: www.youtube.com/watch?v=ZReR...

Headed to RSA? Come meet the Dreadnode crew!

Whether you're looking for a private deep dive into our tech or want to hang out and talk offensive AI research, we'd love to connect.

Limited availability; Come and get it: calendly.com/tori-dreadno...

#BayArea #SanFrancisco #RSAC2025 #OffensiveAI

Hey, we know that guy! Catch Dreadnode's @radads.bsky.social on NASDAQ #TradeTalks alongside @bugcrowd.com CEO
@davegerryjr.bsky.social and NFL CISO @tomasmald.bsky.social.

Tune in for a candid conversation on the intersection of AI and cybersecurity: www.nasdaq.com/videos/ever-...

Will be talking about @dreadnode.bsky.social‘s great open-source rigging repo and how to build your own LLM workflows! Super excited!

🌭🔪⚾️🦥🔥🔄🤨🛜

8 new Challenges now live in Crucible: platform.dreadnode.io/crucible

These Challenges might look familiar… they first appeared at DEFCON 30 and were recently refactored for Crucible—enjoy! [Filter>Subject>DEFCON-30]

Dreadnode’s Policy Recommendations for the U.S. AI Action Plan Read Dreadnode’s AI policy recommendations for the U.S. AI Action Plan, which focuses on leveraging AI to protect America and attacking AI to find its limits.

New blog: Dreadnode’s Policy Recommendations for the U.S. AI Action Plan. Our response focuses on two critical strategies:

1️⃣ Leveraging AI to protect America
2️⃣ Attacking AI to find its limits

Read our complete response on the Dreadnode blog: dreadnode.io/blog/policy-...

Live Stream with Dreadnode Founders | LinkedIn 📅 Date: Wednesday, March 19, 2025 | ⏰ Time: 10 AM PT / 1 PM ET Dreadnode, the company at the forefront of offensive AI research and development, recently announced its Series A funding announcement ...

We're LIVE: www.linkedin.com/events/lives...

Shoutout to these three Crucible users, who were first to solve this week's new Phantom Cheque Challenge. 👏👏👏

1. conor-99
2. Bilal
3. ken

Cheque it out: platform.dreadnode.io/crucible/pha...

Cheque, check, one-two. We have a new Crucible Challenge for you: Phantom Cheque! Can you evade the cheque scanner and determine the areas of JagaLLM that need to be improved?

Act fast; first three to solve this model extraction Challenge announced Friday: platform.dreadnode.io/crucible/pha...

can’t recommend @dreadnode.bsky.social enough - learning a lot going through the challenges and docs

GitHub - dreadnode/dyana: A sandbox environment designed for loading, running and profiling a wide range of files, including machine learning models, ELFs, Pickle, Javascript and more A sandbox environment designed for loading, running and profiling a wide range of files, including machine learning models, ELFs, Pickle, Javascript and more - dreadnode/dyana

Dyana on GitHub: github.com/dreadnode/dy...

In this week's new Crucible Challenge, find the hidden phrase in the backdoored model using dyana, an open source tool created by Dreadnode's Ads Dawson.

Can you outwit the llamas? platform.dreadnode.io/crucible/dya...

Dreadnode Secures $14M to Build AI Systems that Advance the State of Offensive Security Dreadnode Raises $14M to Advance Offensive Security | Series A Announcement

Big news from our crew today! We announced our $14M Series A funding led by Decibel with participation from Next Frontier Capital, In-Q-Tel (IQT), Sands Capital, and Indie VC and released two new solutions: Strikes and Spyglass.

Read the announcement: dreadnode.io/blog/series-...

PSA: We have an active Discord with nearly 1000 members. Join our channel to get tips, discuss Challenges, and connect with others in the community: discord.gg/AxzwtdCN

Raiders of the Lost AI: Attempt our new Crucible Challenge, Palimpsest! Decode the hidden message in the scroll, find the flag.

First three to solve will be announced Friday, right here.

Get started: crucible.dreadnode.io/challenges/p...

Kudos to these individuals for killing this week’s Crucible Challenge. First three to solve Popcorn:

1️⃣ conor-99
2️⃣ garr
3️⃣ mejokim

Have you attempted Popcorn yet? Enter Crucible: crucible.dreadnode.io/challenges/p...