Crawlee

Professional scraping framework (Node/TS first, with a younger Python port): rotating proxies, automatic retries, browser fingerprinting, and request-queue management to keep crawls from getting blocked. Apache-2.0.