Item

znnajdla · 2026-08-30T15:44:33.000Z

Put a CDN in front and let them absorb the load? Seriously, this is static content, which is so cheap to serve it should be free.

ninglor · 2026-08-30T16:36:38.000Z

This is not meaningfully static content. Look at the charts in TFA. There is a combinatorial explosion of distinct URLs which the crawlers can and do request.

jopsen · 2026-08-30T16:56:05.000Z

They allow you to diff commits, which is an awesome feature.

But if bots a crawling diffs between all possible commits it's crazy.

CDN will do nothing, because it's new urls each time. You can maybe find a CDN provider that block bots.

inigyou · 2026-08-30T20:05:31.000Z

No CDN blocks bots. Some claim to. None do.

grep_it · 2026-08-30T16:46:59.000Z

Did you read the article?

“[…]because we can generate 1.2 METRIC BAJILLION valid URLs just for a single fork of linux.git.”

jwilk · 2026-08-30T18:59:14.000Z

From the HN guidelines <https://news.ycombinator.com/newsguidelines.html>:

> Please don't comment on whether someone read an article. "Did you even read the article? It mentions that" can be shortened to "The article mentions that".

inigyou · 2026-08-30T20:05:17.000Z

What if it's really obvious they didn't read the article?