Elektrine lite

← Feed

@melfie@lemmy.zip

2026-09-15 19:44 UTC

This might be the case for an absolutely massive codebase where code files are also huge. Even with Claude, though, you’re supposed to compact regularly well before you hit 1M, or you’re otherwise paying a higher price for the oversized context. That generally means breaking down the work into smaller tasks, which is a useful practice anyway. I also find it useful to have the agent write any detailed info that will help needed later to a markdown file that can be re-read after compaction and r in a new session when needed. I’m mostly working with smaller, personal codebases locally, though. With my 24GB GPU, I hit a hard wall with my configured 200k context and have to compact in OpenCode to continue, which I don’t mind. I do have to micromanage context to a higher degree than with Claude, though, since Anthropic will gladly charge a higher price when your context gets large instead of cutting you off.

Replies (1)

  • @undefinedTruth@lemmy.zip 2026-09-15 20:15

    I also find it useful to have the agent write any detailed info that will help needed later to a markdown file that can be re-read after compaction and r in a new session when needed. Yes, I do that a ton. And yes, I am aware of the additional cost for when the context exceeds 150K. Still though, I try to avoid compacting too much because I found that sometimes the agent starts chasing its own tail. Also, the more of the codebase you can fit in the context the more you benefit from the cache. If you are doing a large refactoring job on a legacy codebase it really helps.

    Open ##4710799