“edge-ai”
Candle: Pure-Rust LLM Inference in Production
A tour of Hugging Face's Candle — a minimalist Rust ML framework for serverless and GIL-free inference: crates, backends, supported formats and models, and how it compares to tch-rs and Burn.
Gemma 4 on Arm: SME2 and the Optimized On-Device AI Stack
How Arm SME2 instructions and KleidiAI accelerate Gemma 4 on-device AI. Learn about the hardware-software stack delivering 5.5x prefill speedups and enabling privacy-first edge experiences on Android.
Mastering Edge AI on Raspberry Pi with LiteRT and Gemma
Deploy Gemma and LiteRT on Raspberry Pi 5 to build autonomous robots and local AI agents. Learn CPU and GPU inference, the Reachy Mini dual-processing pipeline, and the litert-lm CLI workflow.
Blazing Fast On-Device GenAI with LiteRT-LM
A deep dive into the LiteRT-LM runtime powering on-device GenAI. Learn how multi-token prediction, memory-mapped embeddings, session management, and constrained decoding deliver blazing-fast Gemma 4 inference on mobile.
Bringing Agentic Skills to the Edge with Gemma 4
Learn how to give on-device apps true agentic capabilities with Gemma 4, LiteRT-LM, and Agent Skills. Build multi-step autonomous workflows that plan, call tools, and act entirely on the device.
The Future of Mobile Dev: On-Device Agents and Edge AI
Explore how on-device agents and edge AI are reshaping mobile development with Gemma 4, LiteRT-LM, and Flutter. Learn the architecture, tradeoffs, and code patterns for building privacy-first agentic apps that run entirely on the device.