Merge branch 'ps/t1006-tap-fix': The Unseen Battle Against AI Scraping
As you read this article, you're likely wondering why your access to the website has been limited or unavailable at times. The reason lies in a complex web of security measures designed to protect websites from aggressive AI companies that have turned their attention to scraping content without permission.
The administrator of this website has set up Anubis, a server-side system that utilizes Proof-of-Work scheme, similar to Hashcash, a proposed solution for reducing email spam. This system is designed to ensure that the load on websites becomes overwhelming for AI companies and their tools, rendering scraping activities prohibitively expensive.
The core idea behind Anubis may seem counterintuitive at first. At an individual scale, the added load might be negligible, but when combined with the efforts of multiple AI-powered scrapers, it becomes a significant obstacle to overcome. The goal is not to block legitimate users entirely but to create a "good enough" placeholder solution that allows time to be devoted to more advanced techniques for identifying and mitigating headless browsers – a crucial step in preventing these malicious actors from accessing the website.
However, Anubis requires modern JavaScript features that certain plugins like JShelter might disable. To access this challenge, you need to enable your browser's JavaScript. This measure is necessary due to the evolving social contract between website hosts and users, particularly with regards to AI-powered scraping. A no-JS solution remains in development, but until then, it serves as a temporary, albeit imperfect, safeguard against these malicious activities.
It's worth noting that this website currently runs on Anubis version 1.20.0. While this measure may seem restrictive, its primary purpose is to ensure the security and integrity of your experience on our platform.
To fully enjoy the content without encountering any limitations due to Anubis or similar protection mechanisms, it's recommended that you disable JShelter or other plugins that interfere with modern JavaScript features. This minor adjustment will help you bypass the initial challenge posed by Anubis and access all website resources at your disposal.