Merge branch 'pb/perf-test-fixes': The Battle Against AI Scraping
As you're reading this, you're being protected by an innovative technology designed to shield websites from the relentless assault of AI companies seeking to scrape their content without permission.
The administrator of this website has set up Anubis, a cutting-edge system that employs a Proof-of-Work scheme similar to Hashcash, with the ultimate goal of deterring mass scraping. While individual users may not notice the additional load, the collective impact can be significant, making resources inaccessible to everyone.
Anubis is often viewed as a temporary solution – its true purpose lies in diverting attention from legitimate users and towards more sophisticated methods of fingerprinting and identifying headless browsers, such as those employing advanced font rendering techniques. By doing so, the challenge-proof-of-work page becomes less relevant to genuine visitors.
However, this clever hack comes with a catch: Anubis requires the use of modern JavaScript features, which plugins like JShelter are designed to disable. As a result, users will need to enable JavaScript in order to bypass the challenge. This is an unfortunate necessity due to the evolving social contract surrounding website hosting.
While a no-JS solution is still being developed, Anubis serves as a crucial interim measure in this cat-and-mouse game between website administrators and AI companies intent on exploiting their resources. By acknowledging this compromise, users can help safeguard the integrity of online content and ensure that those who would misuse it are held accountable.
For now, be sure to disable any plugins like JShelter to access this challenge-free experience. Remember, a little extra effort upfront is essential in preserving the web's trustworthiness – and your access to its valuable resources.