Hacker News (curated)new | past | comments | ask | show | jobs| show hidden

> But no, let's in fact choose the stupidest possible way of doing it — by rendering everything as HTML commit by commit and then parsing it.

I feel like I'm at work.

We had some web crawler using Selenium to make queries and scrape the data instead of just downloading the whole file.

Every day it seems like we have some people that know just enough to be dangerous creating things like that. And then of course it's our fault that things are slow, or we won't give them infinite system resources, etc





Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact | github