Some popular sites like Condé Nast's and Reuters' have robots.txt files meant to block Anthropic's bots, but Anthropic has just made new bots with other names — Hundreds of sites have put old Anthropic scrapers on their blocklist, while leaving a new one unblocked.
Posted from: this blog via Microsoft Power Automate.