← ClaudeAtlas

promptfoo-redteam-agentslisted

Red team LLM agents, MCP servers, and multi-turn chatbots with promptfoo. Use when testing agents for privilege escalation (RBAC/BOLA/BFLA), memory poisoning, multi-stage attack chains, tool/API manipulation, objective hijacking, MCP tool poisoning, tool shadowing, cross-server attacks, and multi-turn conversation manipulation. Covers layered testing (black-box/component/trace-based), OpenTelemetry tracing, trajectory assertions, and stateful strategies.
SoluDevTech/ai-driven · ★ 3 · AI & Automation · score 57
Install: claude install-skill SoluDevTech/ai-driven
# Red Team LLM Agents, MCP, and Multi-Turn Chatbots LLM agents have state, tools, and multi-step execution — introducing unique risks beyond base models. Use a layered testing approach: black-box (end-to-end), component (direct hooks), and trace-based (OpenTelemetry glass box). For MCP servers, test three scenarios: trusted client, multi-server poisoning, and direct protocol testing. For multi-turn chatbots, use stateful strategies with `conversationId`. ## Use this skill when - Testing LLM agents with tools, state, or multi-step execution - Testing for privilege escalation (RBAC, BOLA, BFLA) - Testing for memory poisoning in stateful agents - Testing multi-stage attack chains and tool/API manipulation - Testing objective hijacking and prompt leaks - Enabling OpenTelemetry trace-based testing with iterative strategies - Converting red-team findings into trajectory regression assertions - Testing MCP servers for tool poisoning, tool shadowing, and cross-server attacks - Testing multi-turn chatbots (Chatbase, conversational agents) with stateful strategies ## Do not use this skill when - Testing a simple LLM app without tools/state → use `promptfoo-redteam-llm` - Testing RAG systems → use `promptfoo-redteam-rag` (but use this skill for agent-specific RAG risks like `rag-poisoning`) - Testing multi-input apps with user_id + message → use `promptfoo-redteam-multi-input` - Testing foundation models in isolation → use `promptfoo-redteam-foundation-models` - Testing guardrails →