Merge branch 'jc/string-list-split': Protecting Against AI Scrapers
Are you seeing this message because your browser has been flagged as a bot? Unfortunately, it's not a coincidence – the administrator of this website has set up Anubis, a powerful security measure designed to protect our server against aggressive AI companies that have been scraping websites with reckless abandon.
Anubis is a clever compromise between user experience and server security. By implementing a Proof-of-Work scheme similar to Hashcash, Anubis makes it expensive for large-scale scrapers to access our website. At an individual scale, the added load may be negligible, but when massed together, it becomes a significant hurdle that deters malicious actors.
The true purpose of Anubis goes beyond just deterring scrapers – it's also a stepping stone towards more sophisticated solutions. By allowing legitimate users to bypass the challenge, we can focus on fingerprinting and identifying headless browsers (like those used by some bots) without compromising user experience.
However, Anubis does come with some caveats. It requires modern JavaScript features that plugins like JShelter may disable. If you're visiting this website, it's essential to disable JShelter or similar plugins to access the content. This is because our server is running Anubis version 1.21.3 – and as of now, a no-JS solution remains a work in progress.
Why does this matter? The answer lies in the rapidly evolving landscape of website hosting. AI companies have rewritten the social contract around how websites function, often prioritizing their own interests over user experience. As such, we're forced to adapt and prioritize our security measures accordingly.
A word of caution: Please enable JavaScript
Despite the limitations, we remain committed to providing you with an excellent user experience. If you're seeing this message because your browser has been flagged as a bot, please consider enabling JavaScript on your device. It may require some adjustments to your browsing settings, but it's essential for accessing our content and protecting our server from malicious activity.
Together, we can navigate the complexities of website security while maintaining a seamless experience for all users. Thank you for your understanding, and we look forward to serving you better.