Hi guys,

Im doing some saturday testing for old.lemmy.today again.

Currently login is required for old.lemmy.today to read posts there. If you are already logged in, you wont notice any difference.

The reason im experimenting is because bots are hammering it, and I wanted to get some statistics of load if I simply dont allow anonymous scraping. Some bots are passing Anubis and scraping content.

So just log in if you havent and it will work just as before.

Thank you!

  • mrmanager@lemmy.todayOPM
    7·
    3 days ago

    I could but there are so many requests, like 30-50 per second, and even if I could cache the login page, I would still spend the bandwidth to send it back to each of those bots. So because of that, and because its not even the main lemmy.today site, I figured its OK to just return 403.

    Server load has decreased to almost nothing on old.lemmy.today. During the years we have been online, more and more bots are scraping and now its just ridicolous. :)