Recent Blog Posts
Insights on AI Agents, Modern Web, and the Future of Engineering.
Reducing Redundant Calls: Guardrails for Recursive Agent Loops
Stop agents from re-calling the same tool and spinning on failed plans: call-signature detection, state-hash cycle checks, hard recursion caps, tool memoization, progress predicates, and a runnable LangGraph example.
Batching Agent Workloads to Maximize Throughput per Dollar
Trade latency for cost on offline agent work: when to batch vs self-coalesce, how to size batches against token limits, checkpointed queue workers, and a runnable Gemini Batch API pipeline.
Choosing the Right Model Size for Each Subtask
A routing strategy for agent pipelines: classify subtasks by reasoning depth, measure quality-per-dollar with per-tier evals, and cascade from small models to frontier models only when confidence is low.
Cost Attribution Across Agents: Chargeback by Team and Tenant
Stop shipping LLM spend through one shared key. Tag every request, run a LiteLLM gateway with per-key budgets, compute per-request cost, and build a real chargeback model.
Context Compaction and Eviction: Managing Long Agent Histories
Long-running agents blow past their context windows. Learn eviction policies, recursive summarization checkpoints, and token-budget math, with LangChain trimming utilities.
Testing Tools in Isolation: Unit Tests Before Agent Evals
Agent evals are slow and expensive. Cover the testing pyramid first: pytest for tool functions, contract tests for schemas, property tests for parsers, and fake models for loop tests.
Tool Discovery for Agent Fleets: Registries and MCP Catalogs
Hard-coded tool lists stop scaling at a handful of tools. Build a registry with ownership metadata, MCP-based discovery, and semantic tool selection that loads tools on demand.
Pagination and Timeouts in Long-Running Tool Responses
Huge or slow tool results break agent loops. Learn to return cursors as tool output, hand the model async job handles to poll, and truncate without losing structure.
Zero-Trust for Agents: Identity Federation and Short-Lived Credentials
Applying zero-trust principles to autonomous agents with workload identity, per-tool credential scoping, token exchange, and short-lived rotating secrets via Microsoft Agent Framework and Azure.
Securing the Agent Supply Chain: Lockfiles, Signatures, and Model Provenance
How to secure every link of the agent supply chain — dependencies, tools, prompts, datasets, and model weights — with lockfiles, hash pinning, revision pins, Sigstore signatures, SBOMs, and CI scanning.
Backpressure for Agent Ingress: Shaping Load at the LLM Gateway
How to apply real backpressure at the ingress of an agent system with LiteLLM: bounded queues, rpm/tpm limits, load shedding, budget-aware admission, and correct 429 handling.
Timeouts and Deadlines: Protecting Agents from Hanging Tool Calls
Why agent tool calls hang forever, and how to layer per-tool timeouts, deadline propagation, asyncio cancellation, and graceful degradation in the OpenAI Agents SDK.