Cloudflare is simultaneously blocking AI crawlers that harvest content without paying, while building the infrastructure for agents that do pay. That is the dual bet: charge the bots that take, and give the bots that work a cheaper, purpose-built tool to work with.
This is interesting. I’ve been thinking a lot about html as a window into content (that description courtesy of colleague and friend John Zoltner)and how browsers will change. I hadn’t thought of browsers for a gents, however.