Production

Retry, backoff, and the ghosts in your latency graph

Retry logic for LLM calls is one of those things that feels obvious until it nearly takes down a ser ...

Tracing LLM apps: what to log when nothing crashes

A traditional application crashes when something goes wrong. An LLM application returns a confident ...

LLM security: the threats nobody warned you about

Security thinking for LLM apps got stuck on prompt injection because that's the dramatic one. The dr ...