Hacker News
Favorites
Setup
☰
Home
Favorites
Setup
Comment by lkbm |
original
|
Creepy Crawlies
[−]
lkbm
· 2026-08-30 Sun 15:09 UTC ·
link
fave
Because they're crawling a billion webpages, only a tiny fraction of which can be git cloned, and configuring a special case just for that tiny fraction isn't worth the effort (of the crawlers).