OpenAI, Meta, Google, and others are positioning AI agents as personal assistants that can perform a range of tasks online. But the web is becoming increasingly unfriendly toward agents, undermining their usefulness.
OpenAI, Meta, Google, and others are positioning AI agents as personal assistants that can perform a range of tasks online. But the web is becoming increasingly unfriendly toward agents, undermining their usefulness.
As someone who hosts a few websites without ads, I still had to block them because of their aggressive crawling. Anthropic’s crawler has DOS’d my webservers and caused them to be overwhelmed.