Tool use patterns that survive context decay

Tool use looks easy in a one-shot example and hard once the conversation grows past a few thousand tokens. Lorem ipsum dolor sit amet consectetur adipisicing elit.

Anchoring tool decisions in system prompts

Aliquam erat volutpat. Integer eu ipsum sem. Ut bibendum lacus vestibulum maximus suscipit. Quisque vitae nibh iaculis neque blandit euismod.

Excepturi repellendus consequatur quibusdam optio expedita praesentium.

Nam ut rutrum ex, venenatis sollicitudin urna.

Related Posts

Self-consistency sampling: cheap reliability when you need the right answer

Self-consistency sampling sounds like the kind of thing a researcher proposes and a production engin ...

Forcing structured output without breaking the model

JSON mode and schema constraints look like a free win until they aren't. The first time the model pr ...

Function calling: when the schema is more important than the prompt

Function calling looks like a free win the first time it works. The model picks the right tool, fill ...