hunt-rag-vector

Solid

Hunt vector-store / embedding-layer weaknesses in RAG pipelines (OWASP LLM08 Vector and Embedding Weaknesses) — persistent corpus poisoning that survives across sessions and users (distinct from one-shot indirect prompt injection, which is owned by hunt-llm-ai), cross-tenant vector-database IDOR (unauthenticated or unscoped queries against Pinecone/Weaviate/Chroma/Milvus/Qdrant/pgvector), source-text/metadata leakage in similarity-search results, and retrieval-hijack via adversarial embedding proximity ('SEO poisoning' for RAG). Targets: any app with a shared knowledge base, document upload feeding a chatbot, or a directly reachable vector-DB port. Validate: a second, clean session/account must inherit a poisoned result, or a cross-tenant artifact must be independently verifiable — confabulation is not a finding, same bar as hunt-llm-ai. Use when target is RAG-backed, exposes a vector-DB port, or lets users upload documents that other users' queries later retrieve.

AI & Automation 3,176 stars 485 forks Updated 4 days ago NOASSERTION

Install

View on GitHub

Quality Score: 86/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

## LLM08 — Vector & Embedding Weaknesses (RAG Pipeline Attacks) `hunt-llm-ai` already owns *session-scoped* indirect injection — a hidden instruction in one document that fires when that specific document is summarized, and ASI06 memory poisoning (a RAG-indexed document that reaches later users). This skill goes one level deeper: it owns the vector **storage and retrieval layer itself** — attacks that don't need any prompt-injection payload at all, because the bug lives in how the embeddings are stored, scoped, and searched. Read `hunt-llm-ai`'s False-Positive Gate first — it applies here unchanged (run-twice rule, anchor to a known secret, cross-tenant proof not assertion, OOB-or-it-didn't-happen for exfil). This document adds gates specific to the vector layer. --- ## Attack Surface Signals - Directly reachable vector-DB ports: Chroma `:8000`, Weaviate `:8080`, Qdrant `:6333`, Milvus `:19530`, Elasticsearch/OpenSearch with `dense_vector`/kNN mappings, managed pgvector via an exposed Postgres port. - A "upload your documents, ask questions about them" feature shared across multiple users or tenants (support-ticket search, internal wiki chatbot, multi-tenant SaaS RAG product). - API responses that include a "similar documents" or "sources" block — check whether it leaks the **raw chunk text** and **document ID** of items outside the querying user's own tenant. - A debug/analytics/admin endpoint that returns raw embedding vectors (`[0.0123, -0.0456, ...]`) rathe...

Details

Author
elementalsouls
Repository
elementalsouls/Claude-BugHunter
Created
2 months ago
Last Updated
4 days ago
Language
Python
License
NOASSERTION

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

assessing-vector-and-embedding-weaknesses

Test vector stores for embedding inversion, cross-tenant leakage, and poisoning.

46 Updated 2 days ago
adriannoes
AI & Automation Solid

hunt-llm-ai

Hunt LLM/AI feature bugs — prompt injection, indirect injection, exfiltration via tool-use/markdown, ASCII smuggling, agentic AI security (OWASP Agentic Apps 2026, ASI01-ASI10). Patterns: direct injection ('ignore previous instructions'), indirect injection via documents/web pages/email the model reads, ASCII smuggling (Unicode Tags block U+E0000-U+E007F, invisible to humans, decoded by the model), tool-use exfiltration (model has fetch/browse tool, attacker injects OOB URL, model exfils chat history/secrets), markdown-image zero-click exfil, system-prompt extraction, IDOR-via-AI (cross-tenant data). Targets: chatbots, RAG, summarizers, agentic copilots, MCP tools. Detection: any LLM-backed endpoint, doc upload triggering AI processing, autonomous agent with tools. Validate: OOB/Collaborator callback for exfil, verbatim-reproducible system-prompt leak (run twice), verifiable cross-tenant leak or RCE. Confabulation is NOT a finding. Use when hunting AI features, chatbots, RAG, agentic systems, MCP.

3,176 Updated 4 days ago
elementalsouls
Web & Frontend Solid

hunt-html-injection

Hunt HTML Injection — user-supplied input is rendered as raw HTML in the response without sanitisation, allowing an attacker to inject arbitrary HTML tags (but not necessarily JavaScript). Lower severity than XSS but enables phishing, UI manipulation, and credential harvesting via injected forms. Use when testing text-display surfaces (search results, profile fields, comments, error messages, feedback forms). For markup that executes JavaScript, escalate to hunt-xss.

3,176 Updated 4 days ago
elementalsouls