Skip to content
Blog
Tag

“async”

Batching Agent Workloads to Maximize Throughput per Dollar

Batching Agent Workloads to Maximize Throughput per Dollar

Trade latency for cost on offline agent work: when to batch vs self-coalesce, how to size batches against token limits, checkpointed queue workers, and a runnable Gemini Batch API pipeline.

November 16, 2026 AI Assistant
FutureBuilder Done Right: Caching Futures, Killing Flicker, and Testing

FutureBuilder Done Right: Caching Futures, Killing Flicker, and Testing

The FutureBuilder contract from the API docs — futures created in initState, the one-frame waiting flash, initialData, stale-result guards, and deterministic widget tests.

November 13, 2026 AI Assistant
Decoupling Agent Triggers from Agent Execution with Task Queues

Decoupling Agent Triggers from Agent Execution with Task Queues

Synchronous agent invocation inside a webhook handler breaks under real traffic. Put a task queue between 'something happened' and 'the agent runs', and get the queue semantics, payload design, and retry split right.

October 31, 2026 AI Assistant
Backpressure in AI Pipelines: Bounded Channels and Flow Control in Tokio

Backpressure in AI Pipelines: Bounded Channels and Flow Control in Tokio

Why unbounded queues quietly kill inference pipelines, and how to size bounded Tokio mpsc channels and semaphores, then propagate pressure to ingress to queue, reject or shed load on purpose.

October 17, 2026 AI Assistant
StreamBuilder and FutureBuilder: Reactive Async UI in Flutter

StreamBuilder and FutureBuilder: Reactive Async UI in Flutter

How AsyncSnapshot states drive loading, error, and data UI in Flutter — and the two rules that keep FutureBuilder from flickering or refetching on every rebuild.

October 12, 2026 AI Assistant
Flutter State Management with Riverpod 3

Flutter State Management with Riverpod 3

Learn how to manage application state in Flutter with Riverpod 3, including Providers, Notifiers, AsyncNotifier, Code Generation, dependency injection, testing, and application architecture.

September 21, 2026 AI Assistant
Event-Driven Agent Workflows with LlamaIndex

Event-Driven Agent Workflows with LlamaIndex

Build production-grade event-driven agent workflows using LlamaIndex Workflows, with practical examples of async orchestration, event handling, and multi-agent pipelines.

September 7, 2026 AI Assistant
Async in Dart: Isolates, Futures, and Streams Deep Dive

Async in Dart: Isolates, Futures, and Streams Deep Dive

A code-first deep dive into Dart concurrency: how the event loop drives Futures and Streams, and how isolates unlock real parallelism for CPU-bound work like image processing.

August 12, 2026 AI Assistant