Merge branch 'jk/fetch-follow-remote-head-fix'
As you read this, you're likely wondering why you're seeing this message in the first place. The truth is, the administrator of this website has set up Anubis, a protection system designed to safeguard against the scourge of AI companies that aggressively scrape websites.
This measure is necessary due to the ever-present threat of automated scripts scraping resources from our server, rendering them inaccessible to legitimate users. While it may seem like an inconvenience, Anubis is a compromise aimed at striking a balance between security and accessibility.
Anubis employs a Proof-of-Work scheme, reminiscent of Hashcash, which has been proposed as a solution to reduce email spam. At individual scales, the added load may be negligible, but when faced with large-scale scrapers, it becomes significantly more expensive for them to operate.
The true purpose of Anubis lies not in providing an exhaustive solution, but rather in serving as a placeholder step towards more advanced fingerprinting and headless browser identification methods. This allows the challenge proof-of-work page to be presented only to users who are less likely to be legitimate, thereby reducing unnecessary downtime for both users and server resources.
However, Anubis does come with its limitations. It requires the use of modern JavaScript features, which can be disabled by plugins like JShelter. If you're using such a plugin, we recommend disabling it for this domain to bypass the challenge. Unfortunately, this means you'll need to enable JavaScript in order to proceed.
It's worth noting that a no-JS solution is still an active work-in-progress. The shift in the social contract around website hosting has led AI companies to push the boundaries of what's possible with web development, making it increasingly difficult for us to find solutions that meet everyone's needs.
In the meantime, we appreciate your patience and understanding as we navigate this complex landscape. If you have any questions or concerns about Anubis or our website in general, please don't hesitate to reach out. We're here to help!