hunt-llm-ai

## 11. LLM / AI FEATURES LLM bugs are only worth reporting when they cross a trust boundary you can **prove** — an OOB callback, a verbatim-reproducible secret, a cross-tenant record, or code execution. A model "saying something bad once" is confabulation, not a vulnerability. Read the False-Positive Gate before claiming anything. > **Naming note (was wrong in v1):** the model-level list is **OWASP Top 10 for LLM Applications 2025** (LLM01 Prompt Injection, LLM07 System Prompt Leakage, LLM08 Vector/Embedding Weaknesses). The agent-level list is **OWASP Top 10 for Agentic Applications (2026)** from the **Agentic Security Initiative (ASI)**, codes ASI01–ASI10. Do not write "OWASP ASI 2026" as if it were one document — cite the correct list per finding. --- ## False-Positive Gate (Read First) LLMs are non-deterministic. The single biggest source of bogus LLM reports is **confabulation** — the model inventing a plausible "system prompt" or "other user's data" that is not real. Apply every check below before writing a word. 1. **Run-twice rule (verbatim reproducibility).** Send the identical extraction prompt in two fresh sessions (clear cookies/conversation). A real system-prompt leak reproduces **token-for-token**. If the two outputs differ in wording, structure, or detail, it is confabulation — discard it. 2. **Anchor to a known-secret.** Don't ask "what is your system prompt"; ask the model to echo a string only the real prompt would contain (a tool name, an internal URL...