The Agentic Post
Breaking
Gemini’s Multimodal Features, Explained  Â·  ChatGPT Custom GPTs, Explained  Â·  What Is Constitutional AI? Explained  Â·  AI Capex Explained for Investors  Â·  AI Startup Valuations: How They Are Set  Â·  How to Reskill for an AI Job Market  ·  
Home/AI Safety
DeepSeek Used in Autonomous Cyberattack

DeepSeek Used in Autonomous Cyberattack

AI Safety

Palo Alto Networks' Unit 42 found a threat actor wiring DeepSeek into an open-source agent framework to autonomously attack 460+ servers. Here's what happened.

A Chinese-speaking threat actor built a working, largely autonomous AI cyberattack pipeline — and got caught because the AI agent accidentally exposed its own operator’s files to the internet. Palo Alto Networks’ Unit 42 published the findings this week: an operator tracked as “knaithe” (also “KnYuan”) wired DeepSeek into the open-source Hermes Agent framework and directed it, largely hands-off, against more than 460 internet-facing targets.

Quick facts

  • Unit 42 attributes the campaign to a China-based actor known as “knaithe” / “KnYuan,” assessed to be operating from Zhuhai, China.
  • DeepSeek served as the “reasoning” engine inside the Hermes Agent framework, targeting more than 460 systems across seven exploit paths and eight CVEs.
  • Confirmed impact: data exfiltration from three organizations via a Citrix NetScaler flaw (CVE-2026-3055) and command execution on 11 Marimo notebook instances (CVE-2026-39987).
  • The operation was discovered only because Hermes Agent accidentally launched a public web server from its own working directory, exposing the operator’s tools and logs.
  • OpenAI’s server-side safeguards reportedly flagged and disabled an account linked to the campaign before Unit 42 even shared its findings — DeepSeek’s model-only guardrails did not.

How the attack worked

According to Unit 42’s report, the operator gave Hermes Agent instructions over Telegram, and the agent handled the rest with little further input: enumerating internet-facing targets, evaluating which CVEs applied, sourcing public exploit code, and adapting its approach when an attempt failed. DeepSeek acted as the decision-making layer behind that process, while Hermes supplied terminal access and tool orchestration through the Model Context Protocol. In parallel, Unit 42 found the same operator had configured — but rarely used — other models including Qwen, GLM, Kimi, MiniMax, Claude Code, and OpenAI’s Codex, suggesting an ongoing evaluation of which AI systems would actually cooperate with offensive tasks.

Most of the autonomous attempts failed outright — target systems weren’t actually vulnerable, or didn’t match the exploit’s assumptions. But Unit 42 confirmed real impact in a handful of cases: memory read access and exfiltration from three organizations through a Citrix NetScaler vulnerability, and command execution against 11 exposed Marimo notebook instances. One of the Citrix compromises appears to have targeted a Malaysian government entity.

The detail that actually matters: guardrails that catch misuse vs. guardrails that don’t

The most consequential finding in the report isn’t the attack itself — it’s what separated the AI providers the operator tried to use. Unit 42 says OpenAI’s own safety systems detected and disabled an account connected to this campaign on their own, flagging misuse patterns over time and revoking access before Unit 42 had even disclosed anything. DeepSeek, whose safeguards live primarily in the model itself rather than in server-side monitoring, didn’t catch the same behavior — which is part of why the operator settled on it as the primary tool.

That’s a specific, testable distinction for anyone thinking about AI agent safety: a model-only guardrail can potentially be prompted around, and once it’s bypassed there’s no account, no usage pattern, and no audit trail for anyone to catch. A server-side system that watches behavior over time can catch exactly the kind of persistent, repeated misuse this campaign involved — even without inspecting any single request in isolation.

What defenders should actually do

If you run any of the affected systems, the practical response is ordinary patch hygiene, not panic: Citrix has confirmed CVE-2026-3055 affects customer-managed NetScaler ADC and Gateway appliances configured as SAML identity providers, and has published fixed builds. Unit 42’s report also lists Apache Tomcat (CVE-2026-34486), Marimo Notebook (CVE-2026-39987), and Windows IKE VPN (CVE-2026-33824) among the exploit paths the operator used or attempted. None of these are novel zero-days — they’re known, patchable vulnerabilities that an AI agent turned out to be quite good at finding unpatched instances of at scale.

What is Hermes Agent, and who is “knaithe”?

Hermes Agent is an open-source AI agent framework that gives a language model terminal access, task orchestration, and the ability to call external tools through the Model Context Protocol — the same kind of plumbing legitimate developer tools use to let an AI agent actually take actions instead of just generating text. That’s precisely why it made a capable offensive tool once someone pointed it at attack tasks instead of coding tasks: the underlying capability is neutral, and the operator supplied the malicious intent, targeting, and offensive skills on top of it.

Unit 42 attributes the campaign to a persona going by “knaithe” and “KnYuan,” who describes themselves as a “binary security researcher” and is assessed to be operating out of Zhuhai, China, based on publicly available data. The attribution came directly from the operator’s own exposed environment — the accidental web server leaked API keys, exploit scripts, target lists, shell history, and the AI system’s own attack logs, giving researchers an unusually complete view into how the operation was actually run.

Why this is a bigger deal than one failed campaign

Taken on its own, this campaign was a limited success for the attacker — three confirmed compromises out of 460+ attempts. But Unit 42’s own framing is the one worth sitting with: the workflow confirms a functional, end-to-end autonomous offensive capability exists today, running on a widely available open-weight model, orchestrated over a consumer chat app. That’s a different threat model than a skilled human operator working exploits by hand, and it lands the same week regulators in the EU and California began enforcing new AI transparency rules — a reminder that transparency requirements and safety guardrails are solving related but distinct problems.

Key takeaway

An open-weight model with only in-model safeguards was, by Unit 42’s own account, the deciding factor in why this campaign ran on DeepSeek instead of a frontier lab’s model with server-side monitoring. For anyone building or deploying AI agents, that’s the operational lesson: guardrails that only live inside the model are a weaker line of defense than systems that can watch behavior over time and revoke access.

Up Next
EU, CA AI Transparency Rules Now Live

EU, CA AI Transparency Rules Now Live

Policy & Regulation

The EU AI Act's transparency rules and California's SB 942 both became enforceable on August 2, 2026 — deliberately aligned. Here's what's now required.

Two of the world’s most significant AI regulations became enforceable on the same day this week. On August 2, 2026, the European Commission began enforcing the EU AI Act’s transparency rules, and California’s AI Transparency Act (SB 942, as amended by AB 853) became operative for covered generative AI providers. The overlap isn’t a coincidence — California lawmakers deliberately timed it to align with Brussels.

Quick facts

  • Both the EU AI Act’s transparency rules and California’s SB 942 became enforceable on August 2, 2026.
  • Both require labeling AI-generated content and disclosing when someone is interacting with an AI system rather than a human.
  • California’s law applies to generative AI providers with over 1 million monthly users in the state; violations carry civil penalties of $5,000 per day.
  • The EU has already published a list of 180+ organizations that signed its Code of Practice on AI-generated content transparency.

What the EU AI Act now requires

Per the European Commission’s announcement, the AI Office and national authorities are now enforcing rules requiring chatbots and other interactive AI systems to disclose that users are dealing with AI, not a human. Deepfakes — AI-edited or generated images, video, or audio — must be labeled, and AI-generated content more broadly must carry machine-readable marks so it can be detected. The Commission frames the goal plainly: reduce deception and manipulation, and give people a practical way to tell what they’re looking at.

What California’s law now requires

California’s version, the California AI Transparency Act, takes a more prescriptive approach. Covered providers — generative AI systems with more than one million monthly California users — must now offer a free, publicly accessible tool that can detect whether content was generated or altered by their system. They must also support two kinds of disclosure: a “manifest” disclosure that’s easily visible to a person looking at the content, and a “latent” disclosure — invisible metadata embedded in the file identifying the provider, system version, and creation timestamp, designed to be difficult to strip out.

The law was signed back in September 2024 with an original effective date of January 1, 2026. AB 853, signed in October 2025, pushed that date to August 2, 2026 specifically so it would land alongside the EU’s enforcement timeline, and it also widened the law’s reach to cover large online platforms, AI model-hosting platforms, and manufacturers of cameras and recording devices, each on its own phased schedule running into 2027 and 2028.

Why the timing matters

For any AI company operating internationally, the alignment is the actual news. Instead of two separate compliance clocks running months apart, providers building for a global audience now have to solve deepfake labeling and AI-content disclosure once, for both regimes, at the same time. That’s a meaningfully different engineering and legal problem than staggered deadlines — it rewards teams who built provenance and disclosure infrastructure early, and penalizes anyone treating this as a US-only or EU-only compliance task.

It also raises the stakes for anyone still betting on regulatory fragmentation to slow this down. When California explicitly engineers its statute to land on the same day as an EU enforcement deadline, that’s a signal other jurisdictions are likely to read — and potentially copy.

What’s still ahead

Neither law is finished rolling out. Under AB 853, large online platforms and AI model-hosting platforms face their own obligations starting January 1, 2027, including building interfaces that let users inspect a piece of content’s provenance data directly. On the EU side, the AI Act’s broader risk-based obligations for high-risk AI systems continue phasing in on their own separate schedule through 2027. Both laws also explicitly prohibit stripping provenance data or building tools designed to remove it — a detail that puts a target on an entire category of “watermark remover” tools that already exist.

EU vs. California: how the two laws differ

  • Scope: the EU AI Act’s transparency rules apply broadly to providers and deployers of AI systems; California’s law applies specifically to “covered providers” over the 1-million-user threshold, plus platforms and device makers on later timelines.
  • Enforcement body: the EU AI Office and national authorities enforce the EU rules; California’s law is enforced through civil penalties rather than a dedicated regulator.
  • Mechanism: the EU requires machine-readable marks and clear AI disclosure; California specifically mandates both a visible “manifest” disclosure and invisible “latent” watermark metadata, plus a free public detection tool.
  • Penalty structure: California’s penalty is a flat $5,000 per violation per day; the EU AI Act’s broader penalty framework (outside today’s transparency rules) scales with global revenue for the most serious violations.

Common questions

Does this apply to my company? Under California’s law, only “covered providers” — generative AI systems with over one million monthly users in California — face the current obligations. The EU’s transparency rules apply more broadly to any provider or deployer of AI systems that interact with users or generate synthetic content, without the same user-count threshold.

What counts as AI-generated content under these rules? Both laws focus on synthetic or altered images, video, and audio — including deepfakes. Text generated by chatbots is covered differently: the disclosure requirement there is telling the user they’re talking to AI, not labeling the text itself.

What happens if a company doesn’t comply? California’s law sets civil penalties at $5,000 per day per violation. The EU AI Act’s enforcement mechanism runs through the AI Office and national authorities, with its own complaints and whistleblower channels now active.

Can companies just strip the watermarks instead? Both laws explicitly prohibit removing provenance data or distributing tools built to do that, so that’s treated as its own violation rather than a workaround.

Key takeaway

If your product generates images, video, or audio and touches either the EU or California, August 2, 2026 isn’t a future deadline anymore — it’s already live. For deeper context on how this fits the broader policy and regulation landscape shaping AI this year, we’ll be tracking enforcement actions under both laws as they happen.