Agentic-AI-Top10-Vulnerability - Top 10 for Agentic AI (AI Agent Security) serves a

项目说明

Top 10 threats and mitigation for AI Agents

O

This project documents the top 10 security risks specifically related to AI Agents, representing a comprehensi of unique to autonomous AI systems. The document provides detailed descriptions, examples, and mitigation strategies for each risk, helping organizations secure their AI agent deployments effectively.

Purpose

As AI agents become increasingly pre because GenAI models, understanding and mitigating their security risks becomes crucial. This guide aims to:

Identify and explain the most critical security risks in AI agent systems

Provide practical mitigation strategies for each identified risk

Help organizations implement secure AI agent architectures

Promote best practices in AI agent security

Project Structure

The documentation is organized into top ten main security risks, each co a specific risk category:
1. AAI001: Agent Authorization and Control Hijacking
2. AAI011: Agent Untraceability
3. AAI002: Agent Critical Systems Interaction
4. AAI014: Agent Alignment Faking
5. AAI003: Agent Goal and Instruction Manipulation
6. AAI005: Agent Impact Chain and Blast Radius
7. AAI006: Agent Memory and Context Manipulation
8. AAI007: Agent Orchestration and Multi-Agent Exploitation
9. AAI009: Agent Supply Chain and Dependency Attacks
10. AAI012: Agent Checker out of the loop

Future

1. AAI014: Agent Temporal Manipulation Time-based attacks
2. AAI015: Agent In and Extraction
3. AAI016: Agent Covert Channel Explotation

Deprecated

1. AAI004: Agent Hallucination Exploitation (partial o with LLM Top 10, so letting it stay in the LLM Top 10)
2. AAI010: Agent Knowledge Base Poisoning (will be merged with AAI006 - Memory and Context manipulation)
3. AAI008: Agent Resource and Service Exhaustion (will be merged with AAI005 - Imapct Chain and Blast Radius)

Roadmap

1.0 (Feb 2025)

1.5 (May 2025)

Contributors

Editors

Manral: Initial document, framework and early contributions

Ken Huang, CISSP: O editing and con of initial document to OWASP format

Akram Sheriff: Orchestration Loop, Planner Agentic security, Multi-modal agentic security

Authors

Manral: Initial document, framework and early contributions

Ken Huang, CISSP: O editing and con of initial document to OWASP format

Akram Sheriff: Orchestration Loop, Planner Agentic security, Multi-modal agentic security

Anton Chuvakin: DoS and Capitalize o sections

Aradhna Chetal: Agent Supply Chain

Raj B.: Capitalize Agentic O, Model extraction

Go Palanisamy: Alignment of sections to OWASP TOP 10 Mapping, Threat Mapping

Mateo Rojas-Carulla: Data poisoning at scale from untrusted sources, O and lack of o

Matthias Kraft: Data poisoning at scale from untrusted sources, O and lack of o

Royce Lu: Stealth Propagation Agent Threats, Agent Memory Exploitation

Rakshith Aralimatti: Agent Temporal Manipulation and Time-Based Attacks

Ste: Alignment with LLM work and broader inputs

Karthik Ramamoorthy: Agent In and extraction

Kanmani Rani Kumar Rajah: Agent Covert Channel Exploitation

Aruneesh Salhotra: OWASP organization ambassador

Contributors

Sunil Arora: Agent Hallucination Exploitation

Alex Shulman-Peleg, Ph.D: Security analysis

Anatoly Chikanov: Technical contributions

Alok Tongaonkar: Technical contribution

Sid Dadana: EDOS AI and Downstream

Shobhit Mehta: Technical contributions

Content Re

Sahana S

Sriram Gopalan

Parthasarathi Chakraborty

Shapiro

Vivek S. Menon

Jon Frampton

Moushmi Banerjee

Michael Machado

S M Zia Ur Rashid

Sangram Dash

Jeffrey LEE

This project has been made possible through the support and contributions of professionals from leading organizations including:

Cisco Systems

GSK

Palo Alto Networks

Precize

Lakera

EY

Google

Distributedappps.ai

Humana

GlobalPayments

TIAA

Meta

DigitalTurbine

HealthEquity

Jacobs

Sisense

Amazon

License

This project is part of AI & Cloud Go Council.

How to Contribute

We welcome contributions from the security community. Please see our contribution guidelines for more information on how to participate in this project.

Contact

For questions, suggestions, or concerns, please open an issue in this repository or contact the project maintainers.

Acknowledgments

Special thanks to all contributors who ha their time and expertise to make this project possible, and to the organizations that ha their participation in this important security initiative.

*This document will be maintained by the AI & Cloud Go Council community and represents a collaborati to impro in AI agent systems.*

项目信息

开发语言：未知

Star 数：202

技术要点

该项目属于红蓝攻防方向的开源资源，代码结构清晰，适合安全研究人员学习参考。项目围绕Top 10 for Agentic AI (AI Agent Security) serves as the core for OWASP and CSA Red teaming work展开，提供了可运行的实现，对理解相关安全机制、工具原理与攻防技术具有较高的研究价值。

从技术实现角度看，此类项目的核心在于对底层原理的深入理解与工程化落地。开发者在研究过程中可以结合官方文档与社区讨论，梳理项目的初始化流程、核心模块职责与数据流转，逐步掌握其中的技术细节与设计思路。

使用与学习建议

1. 下载源码压缩包，解压到本地环境。

2. 根据项目类型准备对应的运行环境与依赖。

3. 按照 README 中的步骤完成配置与部署。

4. 在隔离的测试环境中运行验证，避免影响生产系统。

免责声明

本资源来源于开源社区，仅供安全研究、技术学习与合法授权范围内的攻防演练使用，请勿用于任何非法或侵害他人权益的用途。使用本项目产生的一切后果由使用者自行承担。