So I started looking at the token-savers. TokenShift is the one that keeps coming up, it claims it trims context and leaves the model alone, 10 to 20% off. Problem is I got burned by one of these before. Ran a token compressor on a big Terraform refactor
Detailed Analysis
Detailed analysis coming soon.
Read original article →