Sonnet 5 has a new tokenizer and the same content that generated X tokens on previous claude versions now generates 1.0 to 1.35x more tokens on sonnet 5 so if you are migrating workloads from older models or comparing costs, you are paying 50% more per token
Detailed Analysis
Detailed analysis coming soon.
Read original article →