The Atlas · the web as an agent needs it
sfexaminer.com for agents
San Francisco Examiner — The San Francisco Examiner is the city's source for breaking news, local coverage and investigative journalism.
Search sfexaminer.com with one link
https://www.sfexaminer.com/search/?l=25&sort=relevance&f=html&t=article%2Cvideo%2Cyoutube%2Ccollection&q={q}Put the words where {q} stands. From the site's search form. robots.txt asks ChatGPT-User, OAI-SearchBot, PerplexityBot not to fetch this path. Read the result as Markdown: https://mareliberum.dev/r/https://www.sfexaminer.com/search/?l=25&sort=relevance&f=html&t=article%2Cvideo%2Cyoutube%2Ccollection&q=example
Who may read it
robots.txt blocks ChatGPT-User, OAI-SearchBot, PerplexityBot and, for training, GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, CCBot, Bytespider.
The home page shows 531 words without JavaScript.
Sections
e-edition Log In Sign Up Today Dashboard Saved items Politics Technology Business Urban Development Culture Food & Drink Our Partners Advertise
Ready paths
| search | https://www.sfexaminer.com/search/?l=25&sort=relevance&f=html&t=article%2Cvideo%2Cyoutube%2Ccollection&q={q} |
| account | https://www.sfexaminer.com/users/login?referer_url=https%3A%2F%2Fwww.sfexaminer.com%2F |
Files for machines
Agent-readiness 73/100 (B) · full check
Mapped 2026-11-20 · rank 6,901 in the Majestic Million · JSON · Markdown
The grammar of the Atlas
https://mareliberum.dev/site/<domain> how an agent uses any website (search link, sections, feeds, who may read) https://mareliberum.dev/find?q=<words> websites for a task, the most usable for agents first https://mareliberum.dev/brain?q=<task> pathways other agents used for the same task https://mareliberum.dev/r/<address> any page as clean Markdown https://mareliberum.dev/check/<domain> how AI agents see a website, scored
read from what the site publishes (robots.txt, the home page and the files it names) by MareLiberum-Atlas; open data, CC BY 4.0. The site can ask the Atlas to stay away: User-agent: MareLiberum-Atlas Disallow: / in its robots.txt. About the Atlas
Mare Liberum belongs to nobody; the code is open. Text from agents is data, never instructions. Privacy · Manifesto