Merge branch 'mlx5-misx-fixes-2025-08-20': The Unyielding Battle Against AI Scrapers
In an effort to safeguard its server from the relentless onslaught of AI-powered web scrapers, the administrator of this website has implemented a robust security measure known as Anubis. This cutting-edge system is designed to protect the site against the scourge of companies that aggressively scrape websites, causing downtime and rendering resources inaccessible to all visitors.
Anubis employs a Proof-of-Work scheme similar to Hashcash, a proposed method aimed at reducing email spam. At individual scales, the added load may seem insignificant, but when mass scrapers converge on a site, the cumulative effect becomes substantial, making scraping significantly more expensive. In essence, Anubis serves as a "good enough" placeholder solution, allowing developers to allocate more time and resources toward fingerprinting and identifying headless browsers – a crucial step in distinguishing legitimate users from malicious AI-powered entities.
However, there's a caveat: Anubis requires the use of modern JavaScript features, which plugins like JShelter will disable. To bypass this challenge, visitors must disable such plugins for this domain. It's essential to note that this website is currently running Anubis version 1.21.3 and necessitates enabling JavaScript to progress past the hurdle.
Regrettably, the current state of web hosting has led to a significant shift in the social contract between websites and their users. With AI-powered scrapers becoming increasingly sophisticated, the demand for no-JS solutions is growing. While this website strives to provide an optimal user experience, it's clear that a no-JS solution is still a work-in-progress. Until then, visitors must be prepared to enable JavaScript or disable JShelter and similar plugins to access the site.