云更新了robots.txt,让网站可以阻止AI扫描,同时允许搜索索引和对爬虫进行收费. Cloudflare updates robots.txt to let sites block AI scraping while allowing search indexing and charging for crawls.

Cloudflare更新了机器人协议。 txt 使用新的AI控制, 允许网站所有者封锁AI的剪切培训, 同时仍允许搜索索引化, Cloudflare has updated the robots.txt protocol with new AI controls, allowing website owners to block AI scraping for training while still permitting search indexing and enabling pay-per-crawl fees. 《内容信号政策》引入了“noai”和货币化选项等指令,目的是使出版商对其内容的使用方式有更大的控制权。 The Content Signals Policy introduces directives like “noai” and monetization options, aiming to give publishers more control over how their content is used. 虽然Cloudflare用户可以免费使用工具, 包括加强监测, 但对于自愿遵守仍持怀疑态度, 因为许多AI机器人忽略机器人. txt。 While the tools are free for Cloudflare customers and include enhanced monitoring, skepticism remains over voluntary compliance, as many AI bots ignore robots.txt. 批评者强调,必须制定可执行的法律标准,警告说,仅靠自我监管并不能保护创作者不受未经授权的数据使用的影响。 Critics stress the need for enforceable legal standards, warning that self-regulation alone won’t protect creators from unauthorized data use.