Just a thought - if you design a system to prevent AI crawlers, instead of booting them off, serve crypto-mining JavaScript instead. It would be very funny.
Just a thought - if you design a system to prevent AI crawlers, instead of booting them off, serve crypto-mining JavaScript instead. It would be very funny.
“would never allow an automated routine to download arbitraru code” javascript and wasm being the leading tech to do exactly this. Make those essential for loading content and bypassing it would have to be bespoke solutions depending on the framework and implementations.