Hacker News
Favorites
Setup
☰
Home
Favorites
Setup
Comment by ninglor |
original
|
Creepy Crawlies
[−]
ninglor
· 2026-08-30 Sun 16:36 UTC ·
link
fave
This is not meaningfully static content. Look at the charts in TFA. There is a combinatorial explosion of distinct URLs which the crawlers can and do request.