Governance, compliance and security
Generative AI security course: OWASP, risks and practical mitigations
Protect your AI applications from attacks and information leaks.
Applications built on language models have a new attack surface: a document, a website or an email can contain hidden instructions the model follows, and an agent with too many permissions can do a lot of damage. Classic security controls are not enough.
This course goes through the threats in the OWASP Top 10 for LLM applications with real examples and an attack-and-defence lab: prompt injection, data leakage, RAG weaknesses, excessive agency, supply chain and unbounded consumption. We finish with red teaming and security governance.
What you will learn
- Understand the threats specific to LLM applications
- Apply the OWASP Top 10 for LLM applications
- Design layered defences against prompt injection
- Protect data, agents and the supply chain
- Red-team an AI application
Syllabus
8 modules, from the fundamentals to the final project.
-
The new perimeter
- Why generative AI opens up new risks
- Threat model of an LLM application
-
Prompt injection
- Direct and indirect (through documents and websites)
- System prompt leakage
- Layered defences
-
Data
- Sensitive information disclosure
- Embedding and vector database weaknesses in RAG
- Data and model poisoning
-
Outputs and actions
- Improper output handling
- Excessive agency of agents and tools
- Least privilege and approvals
-
Supply chain
- Third-party models, libraries and MCP servers
- Verification and provenance
-
Availability and misuse
- Unbounded consumption and costs
- Misinformation and harmful content
-
Red teaming
- Planning adversarial tests
- Automated testing tools
- Lab: attack and defend an application
-
Security governance
- Policies, logs and incident response
- AI Act cybersecurity requirements
Tools you will practise with
- OWASP Top 10 for LLM Applications
- MITRE ATLAS
- garak
- promptfoo (red teaming)
- Python
Hands-on project
In a lab, you attack a vulnerable AI application (a chat with RAG and tools), document the flaws you find against the OWASP Top 10 for LLMs and apply mitigations until it passes the tests.
Requirements
- Software development or IT security knowledge.
Other courses
-
AI ethics and decision-making course
A practical method for deciding when and how to use AI responsibly.
- Duration: 4–6 hours
- Level: Beginner
-
AI governance and compliance course
A practical framework for using AI in an orderly way and meeting the AI Act without stifling innovation.
- Duration: 8 hours
- Level: Intermediate
-
Data protection and AI course (GDPR)
Use AI with personal data while complying with the GDPR by design.
- Duration: 6–8 hours
- Level: Intermediate
Where it is applied
-
AI integration in apps and systems
We add AI to the tools your business already uses to automate tasks, search information and connect data without having to change everything.
Want this course for your team?
We adapt the content, length and format to your company.