Skip to content
Blog
Tag

“llm”

GenUI Custom Agent Adapters: Connect Flutter to Any LLM

GenUI Custom Agent Adapters: Connect Flutter to Any LLM

The GenUI SDK ships adapters for Firebase AI Logic and A2UI servers, but its real power is that it is backend-agnostic. Learn how to write a custom agent adapter that plugs any LLM into Flutter's generative UI pipeline.

October 21, 2026 AI Assistant
The Best AI Proxy & AI Gateway in 2026: A Practical Comparison

The Best AI Proxy & AI Gateway in 2026: A Practical Comparison

A practical, vendor-neutral comparison of the best AI proxies and AI gateways in 2026 — OpenRouter, LiteLLM, Portkey, Cloudflare, Kong, Helicone, Bifrost and more — with a decision matrix to help you pick the right one.

October 15, 2026 AI Assistant
Gemini 4 Argon: What It Is and What You Can Build With It

Gemini 4 Argon: What It Is and What You Can Build With It

Gemini 4 Argon is Google's new frontier model. Learn what it is, why it matters, its benchmarks, pricing, and exactly what you can build with it as a developer — with code to get started.

October 15, 2026 AI Assistant
Recruiting Agents: Resume Parsing, Screening, and Bias Guards

Recruiting Agents: Resume Parsing, Screening, and Bias Guards

A resume-screening agent is a regulated decision system with an LLM in the middle. How to structure parsing and scoring — and the guardrails that keep an agent out of the headlines.

October 14, 2026 AI Assistant
GenUI TransportAdapter: Wiring a Flutter GenUI App to Any LLM Agent

GenUI TransportAdapter: Wiring a Flutter GenUI App to Any LLM Agent

The A2uiTransportAdapter replaced ContentGenerator in Flutter's genui package after the A2UI v0.9 rewrite. Learn how the Engine/Transport/Facade split works, how onSend and addChunk stream tokens, and how to build your own transport for any LLM provider, WebSocket agent, or mock backend.

October 11, 2026 AI Assistant
Financial Advisory Agents: Data, Disclaimers, and Regulated Outputs

Financial Advisory Agents: Data, Disclaimers, and Regulated Outputs

Building AI agents that touch investment topics without hallucinating numbers or crossing regulatory lines — grounding, structured outputs, safety settings, and human review with the Gemini API.

October 9, 2026 AI Assistant
GenUI Prompt First: How Flutter's GenUI Now Builds UI From System Prompts

GenUI Prompt First: How Flutter's GenUI Now Builds UI From System Prompts

Flutter's GenUI package moved from Structured Output First to Prompt First with A2UI v0.9. Here is what changed, why it matters, and how to wire PromptBuilder, TransportAdapter, and SurfaceController.

October 9, 2026 AI Assistant
Caching for Agentic RAG: Index Refresh and Query Caching

Caching for Agentic RAG: Index Refresh and Query Caching

Agentic RAG loops re-retrieve constantly. Layer query caching, response caching, and index refresh policies to cut latency and LLM bills without serving stale answers.

October 6, 2026 AI Assistant
Multi-Hop Retrieval: Answering Questions That Span Multiple Sources

Multi-Hop Retrieval: Answering Questions That Span Multiple Sources

How multi-hop retrieval extends RAG with an iterative retrieve, reason, and re-query loop, and how to implement it as a bounded LangGraph workflow.

October 4, 2026 AI Assistant
Candle: Pure-Rust LLM Inference in Production

Candle: Pure-Rust LLM Inference in Production

A tour of Hugging Face's Candle — a minimalist Rust ML framework for serverless and GIL-free inference: crates, backends, supported formats and models, and how it compares to tch-rs and Burn.

October 3, 2026 AI Assistant
GenUI Architecture Decoupling: What Changed in Flutter's GenUI Package

GenUI Architecture Decoupling: What Changed in Flutter's GenUI Package

The latest genui release removes ContentGenerator and splits the framework into Engine, Transport, and Facade layers. Learn how the architecture decoupling and Prompt First approach change how Flutter apps talk to LLMs.

October 2, 2026 AI Assistant
Jev and System One Models: AI That Decides Without Talking — And How Open Source Replicated It in 4 Days

Jev and System One Models: AI That Decides Without Talking — And How Open Source Replicated It in 4 Days

A deep dive into TypeSafe AI's Jev, a System One model that makes decisions without generating text, and the 3 open-source approaches that replicated it in 4 days.

September 20, 2026 AI Assistant
Genkit Dart Model-Agnostic API: Switch Between Google, Anthropic, and OpenAI

Genkit Dart Model-Agnostic API: Switch Between Google, Anthropic, and OpenAI

How Genkit Dart's model-agnostic API lets you integrate and switch between Google Gemini, Anthropic Claude, OpenAI GPT, and compatible providers with minimal code changes.

September 18, 2026 AI Assistant
Building a Flue Agent: A Step-by-Step Tutorial

Building a Flue Agent: A Step-by-Step Tutorial

Learn how to build a conversational AI agent using Flue, a framework for creating durable, tool-using agents with weather and IT policy capabilities.

September 16, 2026 AI Assistant
Flue: The Open Agent Framework for Building Durable AI Agents

Flue: The Open Agent Framework for Building Durable AI Agents

Explore Flue 2.0, the open TypeScript agent framework from the creators of Astro. Learn how Agent Hooks, durability, and a React-like API make building autonomous AI agents intuitive and powerful.

September 12, 2026 AI Assistant
Conversation Summaries as Memory: Compressing Sessions for Context

Conversation Summaries as Memory: Compressing Sessions for Context

Learn how to compress long conversations into concise summaries that preserve key information, reducing token usage while maintaining agent context.

September 10, 2026 AI Assistant
LLM-as-a-Judge for Agent Outputs: Strengths and Pitfalls

LLM-as-a-Judge for Agent Outputs: Strengths and Pitfalls

How to use LLMs as evaluators for agent outputs — the strengths, systematic biases, and practical debiasing strategies for production evaluation.

September 9, 2026 AI Assistant
MCP Concepts Explained: Tools, Resources, and Prompts

MCP Concepts Explained: Tools, Resources, and Prompts

A developer-friendly explainer of the Model Context Protocol — tools, resources, prompts, and how MCP connects AI applications to external systems.

September 9, 2026 AI Assistant
Toxicity and Safety Filters for LLM Outputs: A Hands-On Guide

Toxicity and Safety Filters for LLM Outputs: A Hands-On Guide

A practical guide to implementing toxicity detection and safety filters for LLM outputs, covering guard models, content APIs, and production architectures.

September 9, 2026 AI Assistant
Transforming a Reactive LLM Chatbot into an Agentic System

Transforming a Reactive LLM Chatbot into an Agentic System

An architectural roadmap for moving from a single-turn, reactive LLM chatbot to a smart autonomous agent: planning loops, multi-tiered memory, multi-agent delegation, dynamic tool retrieval, and self-healing.

September 4, 2026 AI Assistant
Blazing Fast On-Device GenAI with LiteRT-LM

Blazing Fast On-Device GenAI with LiteRT-LM

A deep dive into the LiteRT-LM runtime powering on-device GenAI. Learn how multi-token prediction, memory-mapped embeddings, session management, and constrained decoding deliver blazing-fast Gemma 4 inference on mobile.

August 19, 2026 AI Assistant
Building an AI Chatbot UI with Streaming Responses

Building an AI Chatbot UI with Streaming Responses

Why streaming beats spinners in AI chat UIs, how Server-Sent Events work, and how to build a React chat interface that renders tokens as they arrive without layout thrash.

August 10, 2026 AI Assistant
anydoc: Turn Any Office Document into LLM-Ready Markdown in Milliseconds

anydoc: Turn Any Office Document into LLM-Ready Markdown in Milliseconds

Meet anydoc, Firecrawl's fast Rust library that converts Word, PowerPoint, Excel, PDF, EPUB, and more into clean GitHub-Flavored Markdown with one consistent output.

August 5, 2026 AI Assistant
10 Open WebUI Alternatives for 2026

10 Open WebUI Alternatives for 2026

A deep dive into the top 10 open-source alternatives to Open WebUI for creating custom conversational AI solutions in 2026.

April 29, 2026 AI Assistant
Building a ThaiLLM Agent in Rust: A Step-by-Step Guide

Building a ThaiLLM Agent in Rust: A Step-by-Step Guide

Learn how to create a simple, high-performance AI agent using the ThaiLLM model with Rust, Tokio, and Reqwest for optimized Thai language processing.

April 22, 2026 AI Assistant
Defensive AI Programming: Building Robust and Error-Resilient LLM Applications

Defensive AI Programming: Building Robust and Error-Resilient LLM Applications

Learn how to build production-ready LLM applications with defensive programming patterns, validation, and graceful degradation.

April 13, 2026 AI Assistant
Performance Tuning Your AI Apps: Optimizing Latency and Throughput

Performance Tuning Your AI Apps: Optimizing Latency and Throughput

Learn how to slash latency and boost throughput in your AI-powered applications with practical optimization techniques.

April 13, 2026 AI Assistant
The Clean Code Handbook for AI Developers: Writing Maintainable LLM Apps

The Clean Code Handbook for AI Developers: Writing Maintainable LLM Apps

Learn how to apply the principles of clean code to your AI and large language model (LLM) applications. Write code that is not only functional but also readable, maintainable, and scalable.

March 31, 2026 AI Assistant
Mastering Agent Skills with adk-skill in Rust

Mastering Agent Skills with adk-skill in Rust

Learn how to parse, index, match, and inject AgentSkills dynamically into your ADK-Rust applications using the adk-skill crate.

March 24, 2026 AI Assistant
Using Local LLMs with ADK-Rust: Ollama and mistral.rs

Using Local LLMs with ADK-Rust: Ollama and mistral.rs

A guide on how to use local LLMs like Ollama and mistral.rs with ADK-Rust for privacy and cost-efficiency.

March 23, 2026 AI Assistant
Why Pydantic is the Unsung Hero of Modern LLM Application Development

Why Pydantic is the Unsung Hero of Modern LLM Application Development

Structured data is the bridge between chaotic AI outputs and reliable applications. Discover why Pydantic is essential for building robust LLM-powered tools.

March 22, 2026 AI Assistant
Creating a Real-time Streaming Chat UI in Flutter for LLM Responses

Creating a Real-time Streaming Chat UI in Flutter for LLM Responses

Enhance your user experience by implementing real-time, streaming chat responses in your Flutter application using Streams and StreamBuilder.

March 21, 2026 AI Assistant
Fine-Tuning 101: How to Teach a Small LLM New Tricks with Your Own Data

Fine-Tuning 101: How to Teach a Small LLM New Tricks with Your Own Data

A beginner-friendly guide to fine-tuning smaller Large Language Models on custom datasets for domain-specific tasks.

March 16, 2026 AI Assistant
AI APIs vs. Local Models: A Developer's Guide to Choosing the Right Tool

AI APIs vs. Local Models: A Developer's Guide to Choosing the Right Tool

Should you use an API like Gemini or run a local model with Ollama? We compare the pros and cons of each approach for developers.

March 13, 2026 AI Assistant
AI Security for Devs: How to Prevent Prompt Injection in Your Applications

AI Security for Devs: How to Prevent Prompt Injection in Your Applications

Learn what prompt injection is, why it's a critical security vulnerability for LLM applications, and practical techniques developers can use to defend against it.

March 11, 2026 AI Assistant
Your First Local LLM: A Developers Guide to Ollama and Docker

Your First Local LLM: A Developers Guide to Ollama and Docker

Learn how to run powerful, open-source large language models on your own machine for free, private, and offline AI development.

March 11, 2026 AI Assistant
Add LLMs.TXT to Astro Blog

Add LLMs.TXT to Astro Blog

Learn how to create an llm.txt endpoint in your Astro blog to improve discoverability for AI agents and LLMs.

March 1, 2026 AI Assistant
Introduction to AgentGateway: The Open-Source LLM and Agent Workload Gateway

Introduction to AgentGateway: The Open-Source LLM and Agent Workload Gateway

Learn about AgentGateway, a high-performance Rust-based gateway for managing LLM, MCP, and Agent-to-Agent workloads with enterprise-grade security.

March 1, 2026 AI Assistant
Generate MCP Servers from any OpenAPI Specification

Generate MCP Servers from any OpenAPI Specification

Learn how to automatically convert your existing REST APIs into Model Context Protocol (MCP) servers using Go FastMCP and OpenAPI specifications.

March 1, 2026 AI Assistant
Integrate FastMCP with FastAPI Applications

Integrate FastMCP with FastAPI Applications

Discover how to effortlessly generate Model Context Protocol (MCP) servers from existing FastAPI applications or mount MCP endpoints within them using FastMCP.

March 1, 2026 AI Assistant