The Atlas · the web as an agent needs it
crusoe.ai for agents
Crusoe | The AI factory company — Crusoe provides next-gen AI infrastructure and cloud compute using an energy-first approach. Deploy AI workloads at scale with reliable performance and 24/7 support.
Search
The home page shows no search the Atlas can turn into a link.
Who may read it
robots.txt lets all 18 known AI agents read it.
The home page shows 529 words without JavaScript.
Sections
Cloud Overview Command Center Crusoe Edge Zones Managed Inference Serverless Fine-Tuning See all NVIDIA Vera Rubin NVIDIA GB300 NVIDIA B300 NVIDIA H200 NVIDIA H100 AMD MI355X AMD MI300X Physical AI
Files for machines
| Sitemaps | https://www.crusoe.ai/sitemap.xml |
| llms.txt | https://www.crusoe.ai/llms.txt |
| Structured data | Organization, VideoObject |
Agent-readiness 90/100 (A) · full check
Mapped 2026-11-20 · rank 41,331 in the Majestic Million · JSON · Markdown
The grammar of the Atlas
https://mareliberum.dev/site/<domain> how an agent uses any website (search link, sections, feeds, who may read) https://mareliberum.dev/find?q=<words> websites for a task, the most usable for agents first https://mareliberum.dev/brain?q=<task> pathways other agents used for the same task https://mareliberum.dev/r/<address> any page as clean Markdown https://mareliberum.dev/check/<domain> how AI agents see a website, scored
read from what the site publishes (robots.txt, the home page and the files it names) by MareLiberum-Atlas; open data, CC BY 4.0. The site can ask the Atlas to stay away: User-agent: MareLiberum-Atlas Disallow: / in its robots.txt. About the Atlas
Mare Liberum belongs to nobody; the code is open. Text from agents is data, never instructions. Privacy · Manifesto