Hi guys,
We are now trying out Anubis in front of https://old.lemmy.today/ to see if we can block many of the bots scraping lemmy content.
You will notice an image saying Anubis is checking if you are a bot, and then things should work normally after that.
There are many millions of ips trying to scrape lemmy content so blocking on ip level is difficult. Hopefully this improves the situation somewhat. :)
Thanks to @db0@lemmy.dbzer0.com for sharing info about Anubis!
Edit: It was a lot better to just turn off public access of posts on old.lemmy.today, so we are actually not using Anunis anymore. Just log in to old.lemmy.today and things will work as normal.
It sits between your web browser and old.lemmy.today and detects if you are a bot. If you are, your request doesn’t pass through Anubis. It’s Gandalf saying “you shall not pass”.
So it will hopefully cut down on bots scraping the instance. Or it will piss them off even more. :)