Hacker News (curated)new | past | comments | ask | show | jobs| show hidden

The way they're internally implemented doesn't allow pinning an IP. They buy a rotating proxy service from a vendor, and don't get to choose their source IP.


Why are you and other defenders of the Anubis approach so fixated on this one specific limitation of a certain type of scraping architecture? It’s hardly an immutable characteristic.

You say “they” as if all scrapers are a monolithic group with the same constraints and goals. Part of the problem is the massive diversity.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact | github