Skip to content
Blog

Recent Blog Posts

Insights on AI Agents, Modern Web, and the Future of Engineering.

Reducing Redundant Calls: Guardrails for Recursive Agent Loops

Reducing Redundant Calls: Guardrails for Recursive Agent Loops

Stop agents from re-calling the same tool and spinning on failed plans: call-signature detection, state-hash cycle checks, hard recursion caps, tool memoization, progress predicates, and a runnable LangGraph example.

November 16, 2026 AI Assistant
Batching Agent Workloads to Maximize Throughput per Dollar

Batching Agent Workloads to Maximize Throughput per Dollar

Trade latency for cost on offline agent work: when to batch vs self-coalesce, how to size batches against token limits, checkpointed queue workers, and a runnable Gemini Batch API pipeline.

November 16, 2026 AI Assistant
Choosing the Right Model Size for Each Subtask

Choosing the Right Model Size for Each Subtask

A routing strategy for agent pipelines: classify subtasks by reasoning depth, measure quality-per-dollar with per-tier evals, and cascade from small models to frontier models only when confidence is low.

November 16, 2026 AI Assistant
Cost Attribution Across Agents: Chargeback by Team and Tenant

Cost Attribution Across Agents: Chargeback by Team and Tenant

Stop shipping LLM spend through one shared key. Tag every request, run a LiteLLM gateway with per-key budgets, compute per-request cost, and build a real chargeback model.

November 16, 2026 AI Assistant
Context Compaction and Eviction: Managing Long Agent Histories

Context Compaction and Eviction: Managing Long Agent Histories

Long-running agents blow past their context windows. Learn eviction policies, recursive summarization checkpoints, and token-budget math, with LangChain trimming utilities.

November 16, 2026 AI Assistant
Testing Tools in Isolation: Unit Tests Before Agent Evals

Testing Tools in Isolation: Unit Tests Before Agent Evals

Agent evals are slow and expensive. Cover the testing pyramid first: pytest for tool functions, contract tests for schemas, property tests for parsers, and fake models for loop tests.

November 16, 2026 AI Assistant
Tool Discovery for Agent Fleets: Registries and MCP Catalogs

Tool Discovery for Agent Fleets: Registries and MCP Catalogs

Hard-coded tool lists stop scaling at a handful of tools. Build a registry with ownership metadata, MCP-based discovery, and semantic tool selection that loads tools on demand.

November 16, 2026 AI Assistant
Pagination and Timeouts in Long-Running Tool Responses

Pagination and Timeouts in Long-Running Tool Responses

Huge or slow tool results break agent loops. Learn to return cursors as tool output, hand the model async job handles to poll, and truncate without losing structure.

November 16, 2026 AI Assistant
Zero-Trust for Agents: Identity Federation and Short-Lived Credentials

Zero-Trust for Agents: Identity Federation and Short-Lived Credentials

Applying zero-trust principles to autonomous agents with workload identity, per-tool credential scoping, token exchange, and short-lived rotating secrets via Microsoft Agent Framework and Azure.

November 16, 2026 AI Assistant
Securing the Agent Supply Chain: Lockfiles, Signatures, and Model Provenance

Securing the Agent Supply Chain: Lockfiles, Signatures, and Model Provenance

How to secure every link of the agent supply chain — dependencies, tools, prompts, datasets, and model weights — with lockfiles, hash pinning, revision pins, Sigstore signatures, SBOMs, and CI scanning.

November 16, 2026 AI Assistant
Backpressure for Agent Ingress: Shaping Load at the LLM Gateway

Backpressure for Agent Ingress: Shaping Load at the LLM Gateway

How to apply real backpressure at the ingress of an agent system with LiteLLM: bounded queues, rpm/tpm limits, load shedding, budget-aware admission, and correct 429 handling.

November 16, 2026 AI Assistant
Timeouts and Deadlines: Protecting Agents from Hanging Tool Calls

Timeouts and Deadlines: Protecting Agents from Hanging Tool Calls

Why agent tool calls hang forever, and how to layer per-tool timeouts, deadline propagation, asyncio cancellation, and graceful degradation in the OpenAI Agents SDK.

November 16, 2026 AI Assistant