AI crawlers are eating up web resources, and site administrators are looking for defence mechanisms to protect against big ...