Tag: Reliability

Sep 20
τ-bench (Tau-bench): Evaluating Agent Reliability and Policy Adherence in Dynamic Customer Service Loops

For years, enterprise customer support automation relied on rigid decision trees, static rule engines, and superficial conversational retrieval bots. When large language models arrived, organizations moved to replace these brittle flows with generative customer-facing assistants. The initial prototypes appeared impressive in scripted demos: models could converse with empathy, handle varied phrasing, and summarize issue histories. […]