Since yesterday a lot of users in Europe found their workflows failing due to Github seemingly randomly throwing HTTP/401 on git clone/git pull when interacting with public repos without authentication.
It was now confirmed by staff member that this indeed is intentional and no further steps are planned at this point.
This seems reasonable. Cry all you want but if even smaller sites are getting overwhelmed with bots imagine what it’s like for GitHub.
I’m not sure scrappers are so kind to
git cloneinstead of rendering every single file in HTML 🤔I expect they are for GitHub. GitHub is really well known and huge so it makes sense to set up specific scrapers for it.
Fair enough, may as well be the case.
The web page is probably behind CloudFlare or something similar.
My obscure site for my small business is getting hundreds of thousands of hits a month and its practically all bots.
When Cloudflare says bots are most traffic nowadays, I believe it based off what I see.