Recent Blog Posts
Insights on AI Agents, Modern Web, and the Future of Engineering.
Cloudflare OS: An AI Productivity Environment, Open Sourced
A deep dive into Cloudflare OS, the open-source AI productivity environment from the Workers team, covering Gadgets, Gatekeepers, Blueprints, and capability-based security.
Cloudflare OS: an Open Platform for Agents, Apps, and Work
Cloudflare OS is an open-source platform that lets everyone in your company build apps, automate work, and safely access internal systems, shaped around what your organization knows and how it operates.
A/B Testing Prompts in Live Applications
You would never ship a UI change without testing it. Learn how to A/B test prompts in production: bucketing, determinism, and evaluating quality without chasing noise.
Building an AI Research Assistant End-to-End
Go from a prompt to a working research assistant: ingest papers and sources, index them for retrieval, let an agent plan and answer, and surface citations you can trust.
Building a Production-Ready RAG Pipeline with LlamaIndex
Move beyond the demo RAG app. Learn how to structure a production RAG pipeline with LlamaIndex: ingestion, chunking, embedding, retrieval, evaluation, and observability.
Cost Monitoring for Production LLM Applications
Stop guessing what your LLM app costs. Learn how to capture token usage, attribute spend per user and feature, set budget alerts, and build a cost dashboard that scales.
Database Agents: Natural Language to SQL in Production
Let users ask your database questions in plain English — safely. A production guide to text-to-SQL agents: schema grounding, query validation, and read-only guardrails.
Evals for Agents: Unit Testing Multi-Step Reasoning
Agents are too expensive to test by eye. Learn how to write evals for multi-step reasoning: checkpoints, tool-call assertions, rubric scoring, and regression gates in CI.
Fine-Tuning Small Models for Edge Deployment
Big models don\u2019t fit on edge hardware, but small ones can learn your domain. A practical guide to fine-tuning Gemma-class small models and deploying them on-device.
Local-First AI: Ollama, llama.cpp, and On-Prem Inference
Keep your data in-house and your bills predictable. A practical guide to running open models locally with Ollama and llama.cpp, plus when on-prem inference beats the cloud APIs.
Optimizing Context Windows: Token Budgeting Best Practices
A 10M-token window is a trap, not a license. Learn to budget tokens like memory: account for every section, prioritize by recency and relevance, and cut cost and latency.
Synthetic Data Generation for Testing and Fine-Tuning
Real data is scarce, private, and expensive to label. Learn how to generate high-quality synthetic data with LLMs — for unit tests, evals, and fine-tuning datasets.