Tag
“autoscaling”
Green Computing and Container Efficiency: Carbon-Aware Clusters
Resource requests and limits are the foundation of Kubernetes efficiency — and of your power bill. A practical path from right-sizing and bin-packing to scale-to-zero and carbon-aware scheduling, with the trade-offs spelled out.
November 15, 2026 AI Assistant
Running LLM Inference Services in Containers
A practical guide to serving LLMs in containers: vLLM, Ollama, and llama.cpp images, continuous batching, KV-cache memory sizing, quantization trade-offs, model-aware health checks, and autoscaling on queue depth instead of CPU.
November 15, 2026 AI Assistant