Research
AI Security
AI creates new attack surfaces and gives attackers new tools. This area covers securing AI systems, the AI supply chain, deepfakes and AI-enabled fraud, and the use of AI in security operations.
Topics in AI Security
Securing AI Systems (prompt injection, data poisoning)
Defending models, prompts, data and agents from attack.
Deepfakes & AI-Enabled Fraud
Countering synthetic media and AI-assisted social engineering.
Overview
AI systems can be manipulated in ways traditional software cannot. Prompt injection can redirect a model through hidden instructions, poisoned data can corrupt what a model learns, and agents with broad permissions can be turned against the systems they serve. Resources such as the OWASP Top 10 for Large Language Model Applications and MITRE ATLAS catalog these threats.
At the same time, attackers use generative AI to produce convincing phishing, synthetic voices and deepfake video. Defenders are also adopting AI to triage alerts and investigate incidents faster.
What leaders need to get right
- Threat modeling. Include AI-specific attacks in security design reviews.
- Least privilege. Treat models and agents as identities with minimal access.
- Supply chain. Know where models, data sets and AI libraries come from.
- Verification. Update payment and approval processes so a convincing voice or video is never enough.
Research report
Agents are a new class of identity and attack surface
Governing Agentic AI 2026 covers agent identity, MCP and A2A connectivity, prompt injection, runtime limits, kill switches and incident response, with a tool and MCP server intake review.
Featured research report
Governing Agentic AI 2026
67-page playbook for governing enterprise AI agents: autonomy levels, risk tiers, agent identity, MCP controls and human oversight. Includes 10 ready-to-use templates.
Questions leaders should ask
- Have our AI applications been tested for prompt injection?
- Do we know the origin of every model and data set we use?
- Could a deepfake of an executive trigger a payment in our organization?
- Where is AI helping our security team, and how is it supervised?
Other research areas
Related research reports
In-depth reports with ready-to-use templates.
- Governing Agentic AI 2026$59.99 PDF report
- Third-Party AI Risk$59.99 PDF report
Related research reports
Reports connected to this topic.
Latest insights on AI Security
Agentic Intrusions: Five Detection Tests for Machine-Speed Attacks
New October 2026 intrusion evidence shows rapid cross-system abuse. Five tests for detection, identity containment and security response timing.
External AI Guardrails Can Become an Outage Dependency: A Six-Test Procurement Framework
External AI guardrails can inspect sensitive model and tool traffic, but add data egress, latency and fail-closed dependencies. Six tests for enterprise buyers.
The Retrieved Document Is Not a Command: Prompt-Injection Controls for Enterprise AI
A practical design for keeping retrieved documents and tool results from becoming unauthorized instructions or actions in enterprise AI systems.