The Twelfth Batch: Protecting Against AI Scrapers
As a visitor, you're seeing this message because the administrator of this website has taken measures to protect its server from an unwanted threat: AI-powered web scraping companies. These aggressive entities have been known to overwhelm websites with excessive requests, rendering them inaccessible to legitimate users. To combat this issue, Anubis has been set up to serve as a safeguard for our server.
But what exactly is Anubis? In simple terms, it's a Proof-of-Work scheme designed to make web scraping more expensive and time-consuming for malicious actors. The idea is that at an individual scale, the added load from Anubis may seem insignificant, but when applied to large-scale scrapers, it becomes a significant burden. This creates a delicate balance between providing a secure solution and allowing legitimate users to access our content.
While Anubis may seem like a hack, its true purpose is to provide a temporary placeholder solution that can be refined over time. The ultimate goal is to implement more advanced fingerprinting techniques that can identify headless browsers (like those used by AI-powered scrapers) and eliminate the need for this challenge page altogether.
However, Anubis comes with some caveats. To navigate this obstacle, you'll need to enable JavaScript on your device, as plugins like JShelter will disable it. We understand that this may be inconvenient, but we're working on a no-JS solution as a long-term fix. In the meantime, please make sure to disable any plugin that disables JavaScript for this domain.
It's worth noting that AI-powered web scraping companies have altered the social contract around how website hosting works. By implementing Anubis and requiring JavaScript to access our content, we're advocating for a new standard of security and respect for websites and their users.
We appreciate your understanding and cooperation in this matter. Together, we can create a safer and more secure online environment for everyone.