Hacker News (curated)new | past | comments | ask | show | jobs| show hidden

How else would you expect them to calculate it?


Do you really think they're docking points because cache invalidation due to provider switching? Seriously llms are frying ya'lls brain.

They're not "docking points", they're calculating it in the most straightforward way. If I start a session and the majority of requests are sent to Provider A, and my last request gets routed to Provider B, I have a 0% cache hit rate with Provider B. I'm very curious how else you expect this to be calculated? Do you think they're completely omitting requests that switch providers mid-session?

FWIW, I get significantly higher than listed cache hit rates when I pin my session to a specific provider, which is further evidence of the above.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact | github