Cloudflare’s latest push to give publishers more control over how their content is used by AI systems marks a significant turning point in the long-running tussle between website owners, search engines, and the new generation of AI crawlers. The company’s new Content Signals Policy — layered on top of robots.txt — plus related tools such as AI Crawl Control, pay‑per‑crawl, and tighter bot management options, are designed to let site operators declare, enforce, and even monetize how automated...