Discussion about this post

User's avatar
Matt Hixson's avatar

There are uses for long context windows, but for the most part, agents don't need more context. They need the right context in that moment. We are seeing research emerge showing that more context actually leads to worse outcomes. What we need is a localized context for that specific task. This also leads to fewer tokens, which brings token spend way down.

No posts

Ready for more?