Merge branch 're/ssh-sign-buffer-fix': The Catch-22 of Protecting Websites from AI Scrapers

If you're seeing this message, it's likely because the administrator of this website has implemented Anubis, a security measure designed to protect the server against the aggressive scraping of websites by AI companies. While Anubis may seem like an inconvenience, its purpose is twofold: to deter mass scrapers and to provide a temporary solution until more robust measures can be put in place.

Anubis works on a Proof-of-Work scheme similar to Hashcash, a proposed method for reducing email spam. At the individual scale, the additional load is negligible, but at mass scraper levels, it becomes a significant expense. In essence, Anubis makes scraping much more difficult and expensive, making it less appealing to malicious actors.

But why would anyone implement such a measure? The answer lies in the changing social contract around website hosting. AI companies have pushed the boundaries of what is acceptable when it comes to accessing websites without permission or proper authorization. Anubis is a compromise solution that aims to strike a balance between protecting websites and allowing legitimate users to access them.

However, this compromise comes with some caveats. Anubis requires the use of modern JavaScript features, which plugins like JShelter may disable. If you're using such plugins on this domain, you'll need to disable them or risk not being able to pass the challenge proof-of-work page. In short, enabling JavaScript is now a requirement for accessing the website.

Unfortunately, this is a temporary solution at best. The no-JS approach is still a work-in-progress, and it may take some time before more robust measures can be implemented. Until then, Anubis will continue to serve as a protective barrier against malicious actors and AI companies that seek to scrape websites without permission.

So, what does this mean for you? It means that you're one of the few who have been deemed worthy of accessing the website. Congratulations! However, it also means that you'll need to compromise on your security settings to ensure a smooth browsing experience. We appreciate your understanding and cooperation in this matter.

We'll keep you updated on any developments regarding Anubis and its impact on website accessibility. In the meantime, thank you for visiting our site, and we hope you enjoy your stay!