Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions agentic-top10/Agentic_MITREATLAS.md
Original file line number Diff line number Diff line change
Expand Up @@ -145,6 +145,7 @@ agents before any human can intervene.
| Garak | Open-source | <https://github.com/leondz/garak> |
| Rebuff | Open-source | <https://github.com/protectai/rebuff> |
| Invariant Analyzer | Open-source | <https://github.com/invariantlabs-ai/invariant> |
| Guardana | Open-source | <https://github.com/guardana/guardana> |

#### Cross-references

Expand Down Expand Up @@ -787,6 +788,8 @@ to visualise agentic attack coverage across your threat model.
- [OWASP AIVSS](https://aivss.owasp.org)
- [OWASP AI Testing Guide](https://owasp.org/www-project-ai-testing-guide/)
- [MITRE ATLAS case studies](https://atlas.mitre.org/studies/)
- [Guardana rule catalog — ASI01:2026 indirect-injection and tool-result checks](https://github.com/guardana/guardana/blob/v1.0.0rc2/docs/generated/rule-catalog.md)
- [Guardana detection limits](https://github.com/guardana/guardana/blob/v1.0.0rc2/docs/generated/detection-limits.md)

---

Expand All @@ -796,6 +799,7 @@ to visualise agentic attack coverage across your threat model.
|---|---|---|---|
| 2026-03-24 | 2026-Q1 | Initial mapping — ASI01–ASI10 full entries | OWASP GenAI Data Security Initiative |
| 2026-09-14 | 2026-Q3 | Corrected three ATLAS technique citations against ATLAS 2026.07 | OWASP GenAI Data Security Initiative |
| 2026-10-12 | 2026-Q3 | Added Guardana to ASI01 tools, with rule mappings and detection limits | Konrad Karauda |

---

Expand Down
5 changes: 5 additions & 0 deletions data/entries/ASI01.json
Original file line number Diff line number Diff line change
Expand Up @@ -1062,6 +1062,11 @@
"type": "open-source",
"url": "https://github.com/invariantlabs-ai/invariant"
},
{
"name": "Guardana",
"type": "open-source",
"url": "https://github.com/guardana/guardana"
},
{
"name": "Claroty",
"type": "commercial",
Expand Down
5 changes: 5 additions & 0 deletions data/entries/LLM01.json
Original file line number Diff line number Diff line change
Expand Up @@ -1136,6 +1136,11 @@
"type": "open-source",
"url": "https://github.com/protectai/rebuff"
},
{
"name": "Guardana",
"type": "open-source",
"url": "https://github.com/guardana/guardana"
},
{
"name": "NIST AI RMF Playbook",
"type": "open-source",
Expand Down
10 changes: 10 additions & 0 deletions docs/data.js
Original file line number Diff line number Diff line change
Expand Up @@ -1140,6 +1140,11 @@ window.CROSSWALK_DATA = [
"type": "open-source",
"url": "https://github.com/protectai/rebuff"
},
{
"name": "Guardana",
"type": "open-source",
"url": "https://github.com/guardana/guardana"
},
{
"name": "NIST AI RMF Playbook",
"type": "open-source",
Expand Down Expand Up @@ -13981,6 +13986,11 @@ window.CROSSWALK_DATA = [
"type": "open-source",
"url": "https://github.com/invariantlabs-ai/invariant"
},
{
"name": "Guardana",
"type": "open-source",
"url": "https://github.com/guardana/guardana"
},
{
"name": "Claroty",
"type": "commercial",
Expand Down
4 changes: 4 additions & 0 deletions llm-top10/LLM_MITREATLAS.md
Original file line number Diff line number Diff line change
Expand Up @@ -174,6 +174,7 @@ invisible-Unicode carriers survive review of the rendered interface.
| PromptBench | Open-source | <https://github.com/microsoft/promptbench> |
| LLM Guard | Open-source | <https://github.com/protectai/llm-guard> |
| Rebuff | Open-source | <https://github.com/protectai/rebuff> |
| Guardana | Open-source | <https://github.com/guardana/guardana> |

#### Cross-references

Expand Down Expand Up @@ -835,6 +836,8 @@ to visualise coverage across the LLM Top 10.
- [OWASP AI Testing Guide](https://owasp.org/www-project-ai-testing-guide/)
- [OWASP AIVSS](https://aivss.owasp.org)
- [MITRE ATLAS case studies](https://atlas.mitre.org/studies/)
- [Guardana rule catalog — LLM01:2026 prompt-injection checks](https://github.com/guardana/guardana/blob/v1.0.0rc2/docs/generated/rule-catalog.md)
- [Guardana detection limits](https://github.com/guardana/guardana/blob/v1.0.0rc2/docs/generated/detection-limits.md)

---

Expand All @@ -845,6 +848,7 @@ to visualise coverage across the LLM Top 10.
| 2026-03-24 | 2026-Q1 | Initial mapping — LLM01–LLM10 full entries | OWASP GenAI Data Security Initiative |
| 2026-08-28 | 2026-Q3 | Migrated to OWASP Top 10 for LLM Applications 2026 — entries renumbered, LLM08 re-scoped from System Prompt Leakage to Hidden Context Exposure, LLM10 renamed to Improper Output Handling | OWASP GenAI Data Security Initiative |
| 2026-09-14 | 2026-Q3 | Corrected one ATLAS technique citation against ATLAS 2026.07 | OWASP GenAI Data Security Initiative |
| 2026-10-12 | 2026-Q3 | Added Guardana to LLM01 tools, with rule mappings and detection limits | Konrad Karauda |

---

Expand Down
13 changes: 11 additions & 2 deletions shared/TOOLS.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@

# Open-Source Security Tools for GenAI Systems

> **57+ tools** across 13 categories — covering adversarial testing, prompt injection detection, data
> **58+ tools** across 13 categories — covering adversarial testing, prompt injection detection, data
> validation, agent security, observability, guardrails, OT/ICS, and more.

A curated, practitioner-oriented catalogue of open-source and freely available tools for securing LLM
Expand All @@ -24,7 +24,7 @@ welcome via PR — see [CONTRIBUTING.md](../CONTRIBUTING.md) .

| Category | Tools | Primary risks addressed |
|----------|-------|------------------------|
| [Adversarial Testing & Red Teaming](#adversarial-testing-and-red-teaming) | 12 | LLM01, ASI01, LLM09 |
| [Adversarial Testing & Red Teaming](#adversarial-testing-and-red-teaming) | 13 | LLM01, ASI01, LLM09 |
| [Prompt Injection Detection](#prompt-injection-detection) | 4 | LLM01, LLM08, ASI01 |
| [Output Scanning & Redaction](#output-scanning-and-redaction) | 4 | LLM02, DSGAI01, DSGAI09 |
| [Data Validation & Ingestion](#data-validation-and-ingestion-security) | 6 | LLM05, DSGAI05, DSGAI17 |
Expand Down Expand Up @@ -59,6 +59,7 @@ patterns before production deployment.
| Agentic Security | Open-source scanner for agentic AI systems — tests for goal hijacking, tool abuse, lateral movement, and cascade failures in multi-agent deployments | ASI01, ASI02, ASI07, ASI08 | <https://github.com/msoedov/agentic_security> |
| OpenAI Evals | OpenAI evaluation framework — build and run custom eval suites for LLMs with structured datasets, completion functions, and metric reporting | LLM01, LLM07, LLM03 | <https://github.com/openai/evals> |
| PurpleLlama CyberSecEval | Meta benchmark suite for LLM cybersecurity evaluation — covers insecure code generation, prompt injection, and cyberattack assistance detection | LLM01, LLM10, LLM08 | <https://github.com/meta-llama/PurpleLlama> |
| Guardana | CLI for direct and indirect prompt-injection checks, agent probes and saved-run regression checks; beta | LLM01, ASI01 | <https://github.com/guardana/guardana> |

---

Expand Down Expand Up @@ -293,6 +294,14 @@ least one OWASP source list entry in this repo, not a duplicate.

---

## Changelog

| Date | Change | Author |
|---|---|---|
| 2026-10-12 | Added Guardana for LLM01 and ASI01 testing, with references in the MITRE ATLAS mappings | Konrad Karauda |

---

Maintained by the OWASP GenAI Data Security Initiative.
Part of the OWASP GenAI Crosswalk:
<https://github.com/GenAI-Security-Project/crosswalk>