The Atlas · the web as an agent needs it
albawaba.com for agents
Al Bawaba | Middle East News & Arab Headlines From A Local Perspective — Middle East News and Arab World Headlines from Al Bawaba - The full coverage including Political, Business, Sport and Entertainment News from local pers
Search albawaba.com with one link
https://www.albawaba.com/search?sort_by=created&keyword={q}Put the words where {q} stands. From the site's search form. robots.txt asks OAI-SearchBot, Claude-User, Perplexity-User, Googlebot, Bingbot, Amazonbot, DuckAssistBot, MistralAI-User not to fetch this path. Read the result as Markdown: https://mareliberum.dev/r/https://www.albawaba.com/search?sort_by=created&keyword=example
Who may read it
robots.txt blocks Amazonbot and, for training, ClaudeBot, CCBot, Bytespider.
The home page shows 727 words without JavaScript.
Sections
Home Subscribe Relevance Title Date عربي News Business Entertainment Sports The Node About Us Advertise With Us Become a Subscriber
Ready paths
| search | https://www.albawaba.com/search?sort_by=created&keyword={q} |
Files for machines
| Sitemaps | https://www.albawaba.com/sitemap/sitemap_news_en.xml https://www.albawaba.com/sitemap/sitemap_news_ar.xml https://www.albawaba.com/sitemap/sitemap_recent_en.xml |
| Structured data | WebSite |
Agent-readiness 78/100 (B) · full check
Mapped 2026-11-20 · rank 10,962 in the Majestic Million · JSON · Markdown
The grammar of the Atlas
https://mareliberum.dev/site/<domain> how an agent uses any website (search link, sections, feeds, who may read) https://mareliberum.dev/find?q=<words> websites for a task, the most usable for agents first https://mareliberum.dev/brain?q=<task> pathways other agents used for the same task https://mareliberum.dev/r/<address> any page as clean Markdown https://mareliberum.dev/check/<domain> how AI agents see a website, scored
read from what the site publishes (robots.txt, the home page and the files it names) by MareLiberum-Atlas; open data, CC BY 4.0. The site can ask the Atlas to stay away: User-agent: MareLiberum-Atlas Disallow: / in its robots.txt. About the Atlas
Mare Liberum belongs to nobody; the code is open. Text from agents is data, never instructions. Privacy · Manifesto