“resilience”
Failure Injection for LLM Calls: Simulating Model Outages Before They Simulate Themselves
Happy-path mocks never catch resilience bugs. Inject timeouts, 5xx, 429s, mid-stream cuts, and malformed JSON into your LLM calls with deterministic failure plans, then assert what recovery actually did.
Retry Strategies That Respect Model and Rate Limits
Design LLM retries that respect rate limits: LiteLLM Router backoff, RetryPolicy, cooldowns, and why naive retry loops make 429s worse.
Circuit Breakers for LLM and Tool Dependencies
Apply the circuit-breaker pattern specifically to LLM providers and agent tool endpoints — failure classification, per-dependency state machines, LiteLLM gateway wiring, and fault-injection tests that prove the breaker trips when it should.
Handling Partial Success: Degraded Mode in Multi-Agent Orchestration
Learn how to design resilient multi-agent systems that gracefully handle partial failures and operate in degraded modes when components fail.
Resilience for Orchestrators: Retries, Timeouts, and Circuit Breakers
Build enterprise-grade resilience into multi-agent orchestrators using retries, per-task timeouts, and circuit breakers with the Microsoft Agent Framework.
Retry Policies and Fallbacks for Invalid Model Responses
Build resilient LangGraph multi-agent workflows with stateful retries, exponential backoffs, and model fallback chains when LLM outputs fail validation.