Hi, as the title suggests, I was trying to use cache control when calling Claude via the LiteLLM and Bedrock route. I am creating the {cache_control : {type: ephemeral}} object in my first request and trying to see if it's getting utilized as cache I'm the
Detailed Analysis
Detailed analysis coming soon.
Read original article →