Skip to content
Effloow
~/articles · 110 PIECES

Articles, one at a time.

Every piece cites primary sources and adds something you can act on: a worked example, a tested command, a documented limitation. Drafts that only summarize what already exists stay unpublished.
AI INFRASTRUCTURE 2026-08-28 ·Effloow Editorial

OpenAI Kills the Videos API With No Successor: A 4-Week Exit Plan

The Videos API and every sora-2 model shut down 2026-09-24 with an empty replacement column. The inventory scan and exit matrix to decide before the date.
Read →
DEVELOPER TOOLS 2026-08-27 ·Effloow Editorial

Your Coding Agent's Allowlist Is Not a Sandbox

An allowlist approves names, not behaviors. Why environment poisoning turns a trusted command into code execution, and a config auditor that finds it.
Read →
AI INFRASTRUCTURE 2026-08-26 ·Effloow Editorial

The Agent Spend Cap That Admits It Can Be Exceeded

Claude's Managed Agents budget documents that it can land past its own cap. The production architecture that actually bounds an autonomous agent's bill.
Read →
DEVELOPER TOOLS 2026-08-25 ·Effloow Editorial

Stop Parsing Raw JSON: Type-Safe LLM Output Pipelines with BAML

Why json.loads() on model output is a production liability, and how BAML's contract-first schemas and schema-aligned parsing remove a whole failure class.
Read →
AI INFRASTRUCTURE 2026-08-24 ·Effloow Editorial

Multi-Tenant LLM Gateway: Enforcing Virtual Key Budgets & Quotas

How to give every customer of your AI product a hard spend cap and rate limit with LiteLLM virtual keys, before one tenant's bug becomes your bill.
Read →
AI DEVELOPMENT 2026-08-23 ·Effloow Editorial

Beyond Naive Summarization: Context Compaction with Temporal Memory

Why long-running AI assistants bleed money on repeated history, and the memory architecture (compaction, caching, extraction) that stops it.
Read →
AUTOMATION 2026-08-22 ·Effloow Editorial

Why Agent While-Loops Fail in Production: Build Durable Workflows

Agent while-loops lose state on every crash, timeout, and rate limit. How durable execution with Inngest AgentKit or Temporal fixes it, with code blueprints.
Read →
AI INFRASTRUCTURE 2026-08-21 ·Effloow Editorial

RouteLLM in Production: Dynamic Cascades That Cut LLM Spend up to 85%

Why AI products bleed money on frontier models, and the three-layer architecture (pruning, caching, hybrid routing) that fixes cost without killing quality.
Read →
AI INFRASTRUCTURE 2026-08-19 ·Effloow Editorial

gpt-realtime Retires Jan 2027: One API Call Audits Your Stack

OpenAI retires nine voice model IDs on 2027-01-20. We probed the live API: no warning headers, but a shutdown_date field flags 52 of 126 models.
Read →
AI INFRASTRUCTURE 2026-08-17 ·Effloow Editorial

Adding One Tool to Your Agent Wiped the Whole Prompt Cache

Effloow Lab ran 17 OpenAI API calls. Appending, deleting, reordering or rewording a single tool zeroed the prompt cache every time. One setting avoided it.
Read →
AI INFRASTRUCTURE 2026-08-14 ·Effloow Editorial

The gpt-5 Alias Points at a Model OpenAI Deletes Dec 11

We asked the live OpenAI API which model answers when you write gpt-5. It is the exact snapshot being deleted on December 11, 2026.
Read →
AI DEVELOPMENT 2026-08-10 ·Effloow Editorial

Your Prompt Tooling Has a Deadline Your Monitoring Can't See

Two vendors are switching off prompt and eval tooling. We probed the live APIs, found no warning headers, and built a scanner that dates every hit.
Read →

Weekly field notes.

One short dispatch with new guides, tools, and what we tested that week.

Get weekly AI tool reviews & automation tips

Join our newsletter. No spam, unsubscribe anytime.