Hacker News

Favorites Setup
Comment by dakolli | original | Hy4 preview
[−]dakolli · 2026-08-30 Sun 12:34 UTC · link
Do you really think they're docking points because cache invalidation due to provider switching? Seriously llms are frying ya'lls brain.
[−]RussianCow · 2026-08-30 Sun 16:48 UTC · link
They're not "docking points", they're calculating it in the most straightforward way. If I start a session and the majority of requests are sent to Provider A, and my last request gets routed to Provider B, I have a 0% cache hit rate with Provider B. I'm very curious how else you expect this to be calculated? Do you think they're completely omitting requests that switch providers mid-session?

FWIW, I get significantly higher than listed cache hit rates when I pin my session to a specific provider, which is further evidence of the above.