Merge branch 'kh/doc-config-subcommands': Protecting Against AI Scrapers
The administrator of this website has taken proactive measures to safeguard against the threat of AI companies aggressively scraping websites. As a result, you are seeing this message because Anubis, a server protection system, has been set up to mitigate this issue.
Anubis is designed to protect servers from being overwhelmed by AI-powered scrapers. This compromise aims to make scraping more expensive for malicious actors while providing a 'good enough' placeholder solution for legitimate users.
The Proof-of-Work scheme used by Anubis is similar to Hashcash, which was proposed to reduce email spam. At an individual scale, the additional load imposed by this scheme may seem negligible. However, when applied at mass scraper levels, it becomes a significant barrier that makes scraping much more costly.
According to the administrator, Anubis serves as a temporary solution until fingerprinting and identifying headless browsers (e.g., those using font rendering) can be developed further. This will allow for a no-JS solution to be implemented in the future.
Enabling JavaScript is required to pass the challenge proof of work page presented by Anubis. Unfortunately, this means that users must also enable JavaScript on their devices, as plugins like JShelter disable modern JavaScript features.
Please note that disabling JShelter or other similar plugins for this domain will be necessary to access certain content. The administrator acknowledges that a no-JS solution is still in development and may not be suitable for all users at present.