Totally understandable.
If scanning to help send traffic to your website, that’s cool. If scanning to generate summaries that won’t send any traffic your way. No bueno.
Ultimately, it should be whatever most benefits users.
Why did they copy the soundcloud logo?
I mean, with a company as large as cloudflare. I think they could /easily/ strong-arm this move by making blocking google crawlers a default setting on websites. The amount of traffic drop alone from that would make google think twice about the whole ordeal. And people who care about the google search indexers can turn them on again which will allow indexing again. but a default block would cause a lot of disruption google side and many people I don’t think would go in and fix the setting till later on down the road.
Cloudflare’s customers probably wouldn’t be on board with that. Google’s properties provide a tonne of traffic to businesses. Doing anything to put that in jeopardy would probably have many of Cloudflare’s customers looking for a new provider.
If I had to choose my favourite corporation, it would be Cloudflare. They at least do something good.
You may want to read: https://robindev.substack.com/p/cloudflare-took-down-our-website
Additionally, Cloudflare’s initiative faces criticism from those who “worry that academic research, security scans, and other types of benign web crawling will get elbowed out of websites as barriers are built around more sites” through Cloudflare’s blocks and paywalls, the WSJ reported.
The fuck? Since when is a bot designed to enumerate your network weaknesses to sell to Russian/Chinese/US hacking groups a bad thing to block? Fuck the WSJ for even putting that dumb as fuck take on the internet for other idiots to think about.
NO , its not a good fucking idea to allow the equivalent of an incessant door-to-door salesman into your home to take notes of everything you own and sell to a random motherfucker somewhere else you don’t know.
That behavior is fucking weird and shouldn’t be tolerated. Cloudflare arbitrarily blocking that network traffic for you is a good thing.
