🤖 ai.robots.txt
by Cory Dransfeldt
This is an open list of web crawlers associated with AI companies and the training of LLMs to block.
Client Info
Server: https://mastodon.social
Version: 2025.07
Repository: https://github.com/cyevgeniy/lmst
🤖 ai.robots.txt
by Cory Dransfeldt
This is an open list of web crawlers associated with AI companies and the training of LLMs to block.
