SearchDistribute: webscraping search results on an academic budget
Published:
Abhishek Divekar
Description: retrieves upto 250,000 Search engine results per day. With a $5/month VPN subscription, can extract upto 10,000+ search results per query per hour (120x cheaper than Google Search API). Built using Python and Selenium, coordinates multiple PhantomJS browser instances, each connected to a SOCKS5 proxy.
My contribution: Sole contributor.
Resources: [Code]