# robotstxt.org — for agents

**The Web Robots Pages**

**Readable:** 188 words without JavaScript
**Agents:** none of the 18 known agents is blocked

## Sections
- [The /robots.txt](https://www.robotstxt.org/robotstxt.html)
- [<META> tags](https://www.robotstxt.org/meta.html)
- [Frequently Asked Questions](https://www.robotstxt.org/faq.html)
- [Mailing list](https://www.robotstxt.org/mailinglist.html)
- [Other Sites](https://www.robotstxt.org/other.html)
- [About robotstxt.org](https://www.robotstxt.org/about.html)
- [/robots.txt checker](https://www.robotstxt.org/checker.html)
- [Robots Database](https://www.robotstxt.org/db.html)
- [IP lookup](https://www.robotstxt.org/iplookup.html)
- [How do I stop robots visiting my site?](https://www.robotstxt.org/faq/prevent.html)
- [Privacy and cookies policy](https://www.robotstxt.org/privacy.html)
- [Contact us](https://www.robotstxt.org/contact.html)

## Ready paths
- contact: https://www.robotstxt.org/contact.html
- account: https://www.robotstxt.org/faq/prevent.html

Agent-readiness 50/100 (C). Mapped 2026-11-20 · rank 10606.

Read any page: https://mareliberum.dev/r/https://www.robotstxt.org/ · Full check: https://mareliberum.dev/check/robotstxt.org

_read from what the site publishes (robots.txt, the home page and the files it names) by MareLiberum-Atlas; open data, CC BY 4.0_