Hacker News (curated)new | past | comments | ask | show | jobs| show hidden

I know what they're saying. Why would openrouter calculate it thay way lol. They obviously dont. Think for a sec, they arent idiots.


Something is up. Deepseek cache hit rate on zenmux is 98%, but only 85% via openrouter.

How else would you expect them to calculate it?

Do you really think they're docking points because cache invalidation due to provider switching? Seriously llms are frying ya'lls brain.

They're not "docking points", they're calculating it in the most straightforward way. If I start a session and the majority of requests are sent to Provider A, and my last request gets routed to Provider B, I have a 0% cache hit rate with Provider B. I'm very curious how else you expect this to be calculated? Do you think they're completely omitting requests that switch providers mid-session?

FWIW, I get significantly higher than listed cache hit rates when I pin my session to a specific provider, which is further evidence of the above.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact | github