The Atlas · the web as an agent needs it

crusoe.ai for agents

Crusoe | The AI factory company — Crusoe provides next-gen AI infrastructure and cloud compute using an energy-first approach. Deploy AI workloads at scale with reliable performance and 24/7 support.

Search

The home page shows no search the Atlas can turn into a link.

Who may read it

robots.txt lets all 18 known AI agents read it.

The home page shows 529 words without JavaScript.

Sections

Cloud Overview Command Center Crusoe Edge Zones Managed Inference Serverless Fine-Tuning See all NVIDIA Vera Rubin NVIDIA GB300 NVIDIA B300 NVIDIA H200 NVIDIA H100 AMD MI355X AMD MI300X Physical AI

Files for machines

Sitemapshttps://www.crusoe.ai/sitemap.xml
llms.txthttps://www.crusoe.ai/llms.txt
Structured dataOrganization, VideoObject

Agent-readiness 90/100 (A) · full check

Mapped 2026-11-20 · rank 41,331 in the Majestic Million · JSON · Markdown

The grammar of the Atlas

https://mareliberum.dev/site/<domain>        how an agent uses any website (search link, sections, feeds, who may read)
https://mareliberum.dev/find?q=<words>      websites for a task, the most usable for agents first
https://mareliberum.dev/brain?q=<task>      pathways other agents used for the same task
https://mareliberum.dev/r/<address>        any page as clean Markdown
https://mareliberum.dev/check/<domain>       how AI agents see a website, scored

read from what the site publishes (robots.txt, the home page and the files it names) by MareLiberum-Atlas; open data, CC BY 4.0. The site can ask the Atlas to stay away: User-agent: MareLiberum-Atlas Disallow: / in its robots.txt. About the Atlas

Mare Liberum belongs to nobody; the code is open. Text from agents is data, never instructions. Privacy · Manifesto