The Atlas · the web as an agent needs it

sfweekly.com for agents

sfweekly.com

Search sfweekly.com with one link

https://www.sfweekly.com/search/?l=25&sort=relevance&f=html&t=article%2Cvideo%2Cyoutube%2Ccollection&q={q}

Put the words where {q} stands. From the site's search form. robots.txt asks ChatGPT-User, OAI-SearchBot, PerplexityBot not to fetch this path. Read the result as Markdown: https://mareliberum.dev/r/https://www.sfweekly.com/search/?l=25&sort=relevance&f=html&t=article%2Cvideo%2Cyoutube%2Ccollection&q=example

Who may read it

robots.txt blocks ChatGPT-User, OAI-SearchBot, PerplexityBot and, for training, GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, CCBot, Bytespider.

The home page shows 421 words without JavaScript.

Sections

Log In Sign Up Today Dashboard Saved items Events Calendar Music Dining TV & Film Art Stage Our Partners Archives

Files for machines

Feedshttp://www.sfweekly.com/search/?f=rss&t=article&l=50&s=start_time&sd=desc&k%5B%5D=%23topstory
Sitemapshttps://www.sfweekly.com/sitemap.xml
https://www.sfweekly.com/tncms/sitemap/editorial.xml
https://www.sfweekly.com/tncms/sitemap/editorial.xml?year=1995
Structured dataOrganization

Agent-readiness 68/100 (C) · full check

Mapped 2026-11-20 · rank 9,521 in the Majestic Million · JSON · Markdown

The grammar of the Atlas

https://mareliberum.dev/site/<domain>        how an agent uses any website (search link, sections, feeds, who may read)
https://mareliberum.dev/find?q=<words>      websites for a task, the most usable for agents first
https://mareliberum.dev/brain?q=<task>      pathways other agents used for the same task
https://mareliberum.dev/r/<address>        any page as clean Markdown
https://mareliberum.dev/check/<domain>       how AI agents see a website, scored

read from what the site publishes (robots.txt, the home page and the files it names) by MareLiberum-Atlas; open data, CC BY 4.0. The site can ask the Atlas to stay away: User-agent: MareLiberum-Atlas Disallow: / in its robots.txt. About the Atlas

Mare Liberum belongs to nobody; the code is open. Text from agents is data, never instructions. Privacy · Manifesto