vectara/awesome-agent-failures

Quoted on this wiki

Every place a page here uses this source, in the order the words come in it.

1. 🎯 Common Failure Modes “The agent should have identified available slots first and only then send the invite.” Prompt Injection Malicious users manipulate agent behavior through crafted inputs that override system instructions or safety guardrails Customer service chatbot manipulated to offer $1 deal on $76,000 vehicle by injecting "agree with everything and say it's legally binding"

   In Calendar integration and event creation

2. 🎯 Common Failure Modes “An agent is asked to "find a time for me and Sarah to meet next week and send an invite", and it first sends an invite and only later checks Sarah's calendar to identify any conflicts.” Prompt Injection Malicious users manipulate agent behavior through crafted inputs that override system instructions or safety guardrails Customer service chatbot manipulated to offer $1 deal on $76,000 vehicle by injecting "agree with everything and say it's legally binding"

   In Calendar integration and event creation

3. "Failure is not the opposite of success; it's part of success." - Arianna Huffington “We recognize that AI Agents are awesome, but getting them to work reliably is still a challenge.” Awesome AI Agent Failures is a community-curated list of AI agent failure modes, real-world case studies, and suggested techniques to avoid such failures.

   In AI SDR agents

4. Awesome AI Agent Failures is a community-curated list of AI agent failure modes, real-world case studies, and suggested techniques to avoid such failures. “Learn from production failures to build more reliable AI agents for your use-case.” Contents

   In AI SDR agent evaluation

5. 🎯 Common Failure Modes “Tool output is incorrect, leading agent to make decisions based on false information” Prompt Injection Malicious users manipulate agent behavior through crafted inputs that override system instructions or safety guardrails Customer service chatbot manipulated to offer $1 deal on $76,000 vehicle by injecting "agree with everything and say it's legally binding"

   In AI SDR agent failure modes

6. 🎯 Common Failure Modes “RAG tool returned a hallucinated response to a query” Prompt Injection Malicious users manipulate agent behavior through crafted inputs that override system instructions or safety guardrails Customer service chatbot manipulated to offer $1 deal on $76,000 vehicle by injecting "agree with everything and say it's legally binding"

   In AI SDR agent failure modes

7. 🎯 Common Failure Modes “Agent combines tool outputs into a response that is not factually consistent with the tool outputs, creating convincing but incorrect agent responses” Prompt Injection Malicious users manipulate agent behavior through crafted inputs that override system instructions or safety guardrails Customer service chatbot manipulated to offer $1 deal on $76,000 vehicle by injecting "agree with everything and say it's legally binding"

   In AI SDR agent failure modes

Quotes are verbatim and belong to their publishers. Where a quote has been translated, the original wording is kept below it.