I am trying to build out new infra for Open Source and Open Knowledge projects, and the biggest problem these projects are dealing with are scrapers coming through residential proxies. With the eMudhra event, I was considering getting a second residental connection (I live in an area where we have two, and I certainly don’t want to get my primary connections on a list), setting up a Linux based router with mitm proxy and other instrumentation, and then getting one (or more!) of these superbox type devices, load up apps, and see what happens. I’m very willing to run the hardware and manage remote access for team members, but I probably don’t have enough bandwidth to do all the data mining. My only request is that we make the dataset available for free to use via a streaming method (maybe BGP?) because that’s really what’s needed and I’m tired of depending on the usual suspects to “solve” this for a massive payday from both the victims and the attackers.
I look forward to any and all feedback, would love to know if something like this already exists (and I just don’t know) or if anyone else thinks this is a good idea.