Prompt-Hacking-Resources - A list of curated resources for people interested

项目说明

<h1 align="center">
<strong>Awesome prompt hacking – an awesome list of curated resources on prompt hacking and AI safety.</strong>
</h1>

<p align="center">
Topics include AI red teaming, jailbreaking, prompt injection, prompt hacking, AI/ML safety and security.
</p>

<p align="center">

![Awesome]() ![Made With Love]() ![Tweet]()
</p>

> This resource is provided by Learn Prompting, your go-to resource for mastering Generative AI.

<img src="astronaut-learn-prompting.png" alt="astronaut-learn-prompting">

<p align="center">
<a href=" • <a href=" (X)</a> • <a href=" • <a href=" • <a href=" Intro Prompt Hacking Course</a> • <a href=" Ad Prompt Hacking Course</a>

</p>

---

Table of Contents

Introduction

Resource Categories

- Blogs
- Communities
- Courses
- Events
- Jailbreaks
- YouTube

Contributing

---

Introduction

Prompt Hacking is an emerging field that covers the intersection between AI and Cybersecurity. It in exploring the outer edges of LLM behavior through ad prompts and prompt injection techniques.

Due to its novelty, online resources are few and far between.

This repository aims to provide a good o of materials and tutorials that help expose , document offensi, and promote a better understanding of model limitations.

---

Blogs

Stay informed with expert analyses, tutorials, and research articles on AI security.

LearnPrompting Prompt Hacking – A step-by-step guide on prompt injection and model exploitation.

What is AI Red Teaming? (Learn Prompting) – A primer on what AI red teaming is, why it matters, and how it's done.

EmbraceTheRed – Practical experiments and insights from active AI red teamers.

Joseph Thacker – First-person narratives on red teaming and LLM research.

Protect AI Blog – Enterprise insights on AI security along with open-source tooling.

AWS Generative AI Security – Guidance on secure AI architectures and compliance.

Lakera AI Blog – Interacti and red teaming experiments.

Securiti AI Security – Articles on go, risk, and compliance in the AI realm.

PurpleSec AI & ML Security – Application of broad cybersecurity principles to AI/ML threat models.

Wiz AI Security Articles – Curated executi on AI risk trends.

Lasso Security Blog – In-depth research on prompt injection and ad LLM behavior.

Cisco AI Safety – Strategic perspectives on embedding safety in AI inno.

Microsoft Security: AI & ML – Deep dives into threat modeling and responsible AI practices.

AI Cybersecurity Blog – How AI can be used to defend against emerging AI-dri.

Re AI Security Articles – Re research articles on LLM application security and prompt injection

Communities

Discord Communities

LearnPrompting’s Prompt Hacking Discord – A hub for focused discussions on prompt hacking and red teaming.

Pliny's BASI Discord – Co beha AI safety and integrati.

AI Safety & Security Discord – A space for general discussions on AI risk, safety, and ad testing.

AI Discord – Associated with DEFCON’s AI , emphasizing practical red teaming.

InfoSec Prep – For cybersecurity certifications with crossover AI security discussions.

Hack The Box Discord – Acti blending traditional hacking with GenAI discussions.

Laptop Hacking Coffee – Casual technical discussions on red teaming and ethical hacking.

WhiteHat Security – Sharing insights on hacking and AI-enabled attacks.

Reddit Communities

ChatGPT Jailbreak Reddit – Focus on testing limits of OpenAI’s models.

ClaudeAI Jailbreak Reddit – Specifically for Anthropic’s Claude model .

NetSec Reddit – Broader network security discussions that occasionally intersect with AI.

Cybersecurity Reddit – General cybersecurity topics, including AI/ML threats.

CybersecurityAI Reddit – Dedicated to AI-related cybersecurity challenges.

Artificial Reddit – Community discussions on AI safety, policy, and alignment.

Courses

Free Courses

Introduction to Prompt Engineering – Techniques for writing optimized prompts.

Introduction to Prompt Hacking – Beginner-focused course co prompt injection fundamentals.

Ad Prompt Hacking – Explores ad prompting and defense strategies in detail.

Ad Prompt Engineering – Ad techniques for building reliable, production-grade prompts.

AI Safety – Introduction to AI safety concepts, risks, and alignment fundamentals.

Intro to LLMs and Prompting (Google Cloud) – O of LLM concepts and practical prompting within a cloud framework.

Prompt Engineering on LearnAI – Community-dri engineering resources.

Generative AI Prompting Basics (Google) – Foundational course for generative AI prompting.

Prompt Engineering on Fast.ai – Integrated with broader practical machine learning applications.

Intro to AI Safety and Prompt Testing – Materials focused on the safety aspects of prompt exploitation.

Spikee Tutorial Series – Series of tutorials on how to use spikee, an open-source tool, to test LLMs and LLM application resiliance to different jailbreaking and prompt injection attacks

Paid Courses

AI Red-Teaming and Security Masterclass – Comprehensi on threat assessment, red teaming methodologies, and effecti.

Live AI Security Courses – Instructor-led, li of the AI red teaming and security curriculum.

Events

Keep updated with competitions, workshops, and summits that dri learning and networking:

HackAPrompt – Online competitions aimed at disco inno ways to jailbreak AI systems.

AI (DEF CON) – DEF CON's home for hands-on AI red teaming, CTFs, and security research community.

AI Security Summit 2024 – Executi summit addressing current AI security challenges.

AI Red-Teaming Workshop (SEI) – Workshops exploring ad red teaming techniques.

AISec Workshop – Academic insights held alongside major ML conferences.

AI Security Symposium 2024 – Sessions on risk mitigation and AI adoption strategies.

Black Hat USA 2026 AI Summit – Practical sessions on LLM integrated in the Black Hat conference.

AI Cybersecurity Summit 2025 (SANS) – Technical labs and sessions bridging AI and cybersecurity.

Generative AI Red Teaming Challenge 2024 (Clova) – Competiti to stress-test and enhance the resilience of LLMs.

Jailbreaks

A collection of repositories, tools, and research papers that document methods of bypassing LLM safeguards:

Ignore This Title and HackAPrompt (Learn Prompting / HackAPrompt) – EMNLP 2023 best-paper research exposing systemic LLM through a global-scale prompt hacking competition.

Jailbreaking in GenAI: Techniques and Ethical Implications – Guide discussing the practical methods and ethical considerations.

Prompt Injection : What’s the Difference? – Comparati on prompt injection and jailbreak strategies.

L1B3RT4S – Repository featuring jailbreak prompt sets and e tools.

Awesome GPT Super Prompting – Curated list of red teaming and jailbreak resources for GPT-based models.

Jailbreaking LLMs: A Comprehensi (With Examples) – Step-by-step guide showcasing real-world examples.

AI Jailbreak – IBM – O of jailbreak risks and mitigation strategies.

AI Jailbreaking Demo: How Prompt Engineering Bypasses LLM Security Measures – Video walkthrough highlighting bypass techniques.

GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts – Research outlining an automated framework for generating jailbreak prompts.

DiffusionAttacker: Diffusion-Dri Manipulation for LLM Jailbreak – No applying diffusion models in jailbreak generation.

SoP: Unlock the Power of Social Facilitation for Automatic Jailbreak Attack – Framework that le social engineering concepts for jailbreaks.

Deciphering the Chaos: Enhancing Jailbreak Attacks Prompt Translation – Technique to boost jailbreak effecti using ad translation.

AI Jailbreaks: What They Are and How They Can Be Mitigated – Additional insights into mitigating jailbreak .

YouTube

AI Red Teaming

Why Securing AI Is Harder Than Anyone Expected | HackAPrompt CEO – Sander Schulhoff (Learn Prompting / HackAPrompt) on why AI guardrails keep failing.

How Microsoft Approaches AI Red Teaming – Insight into Microsoft's methodologies.

AI Red Teaming in 2024 and Beyond – Discussion of emerging trends.

Red Teaming AI: What You Need To Know – Essential introduction to red teaming practices.

Building Trust in AI: Introduction to Red-Teaming – Fundamentals of effective AI red teaming.

What's Next for AI Red-Teaming? – Future directions and challenges.

LLM Security Chronicles – YouTube playlist on practical LLM application security and red teaming

Jailbreaking

How AI Jailbreaks Work and What Stops Them? – An o of the methods behind AI jailbreaks.

AI Jailbreaking Demo – Demonstration of bypass techniques in practice.

How Jailbreakers Try to “Free” AI – Examines the mindset behind prompt injection attacks.

Defending Against AI Jailbreaks – Strategies for protecting LLMs from ad prompts.

AI Jailbroken in 30 Seconds?! – A demonstration of rapid prompt injection.

Anthropic's Stunning New Jailbreak – Review of a breakthrough jailbreak technique.

New AI Jailbreak Method Shatters Models – Exploration of experimental bypass strategies.

Jailbreaking AI - Deepseek & Prompt Tricks – Ad prompt engineering in real-world scenarios.

First to Jailbreak Claude Wins $20,000 – Competiti highlighting effecti injection.

---

Contributing

If you ha, impro, or additional resources to include, please review our CONTRIBUTING.md guidelines and submit a pull request.

---

This repository aims to deli, reliable resources for ad prompt hacking research. We encourage rigorous testing, honest discussions, and the sharing of pro to foster safe and responsible exploration in this field.

项目信息

开发语言：未知

Star 数：737

技术要点

该项目属于红蓝攻防方向的开源资源，代码结构清晰，适合安全研究人员学习参考。项目围绕A list of curated resources for people interested in AI Red Teaming, Jailbreaking, and Prompt Injection展开，提供了可运行的实现，对理解相关安全机制、工具原理与攻防技术具有较高的研究价值。

从技术实现角度看，此类项目的核心在于对底层原理的深入理解与工程化落地。开发者在研究过程中可以结合官方文档与社区讨论，梳理项目的初始化流程、核心模块职责与数据流转，逐步掌握其中的技术细节与设计思路。

使用与学习建议

1. 下载源码压缩包，解压到本地环境。

2. 根据项目类型准备对应的运行环境与依赖。

3. 按照 README 中的步骤完成配置与部署。

4. 在隔离的测试环境中运行验证，避免影响生产系统。

免责声明

本资源来源于开源社区，仅供安全研究、技术学习与合法授权范围内的攻防演练使用，请勿用于任何非法或侵害他人权益的用途。使用本项目产生的一切后果由使用者自行承担。