How AI agents see

ndtv.com

0
of 100 · E

Agents struggle with this site. The list below says what to change.

Checked 2026-11-19 22:47 UTC (kept for an hour) · read from what the site publishes: robots.txt, llms.txt, the home page and the agent card. robots.txt states wishes; most large AI operators say they follow it.

What counts

!robots.txt did not answer (403) — the site turns automated readers away
a bot wall in front of the site stops AI assistants too; let known AI agents through if you want them to read for people
read from robots.txt
0 / 25
!The home page turned us away (403) — most AI agents meet the same wall
make the home page answer with 200 and HTML
read from home page
0 / 20
!No structured data (JSON-LD)
describe what you offer as schema.org JSON-LD (Organization, Product, Offer, Article …) — agents read it first
read from home page
0 / 15
!Missing title and description
give the page a clear title and a one-sentence description
read from home page
0 / 10
!No llms.txt
publish /llms.txt: a short plain-text guide to the site for language models
read from /llms.txt
0 / 10
!No agent card
if agents may act with you (book, buy, ask), publish /.well-known/agent-card.json (A2A)
read from /.well-known/agent-card.json
0 / 10
!No sitemap found in robots.txt, /sitemap.xml or /sitemap_index.xml
list your pages in /sitemap.xml and name it in robots.txt
read from /sitemap.xml
0 / 5
!Home page answered 403
serve the site over HTTPS with status 200
read from home page
0 / 5

Who may read it — by robots.txt

Assistants that reads for a person right now:

? ChatGPT-User · OpenAI? Claude-User · Anthropic? Perplexity-User · Perplexity? DuckAssistBot · DuckDuckGo? MistralAI-User · Mistral

AI search that brings you into AI answers and search:

? OAI-SearchBot · OpenAI? Claude-SearchBot · Anthropic? PerplexityBot · Perplexity? Googlebot · Google? Bingbot · Microsoft? Amazonbot · Amazon

Crawlers that trains future models — your choice, not scored:

? GPTBot · OpenAI? ClaudeBot · Anthropic? Google-Extended · Google? Applebot-Extended · Apple? Meta-ExternalAgent · Meta? CCBot · Common Crawl? Bytespider · ByteDance

How the most visited websites compare: the state of the agent web

Show your score

A live badge for your site, README or footer. It updates when the site changes; people and agents who click it land on this result.

AI agents: 0/100

<a href="https://mareliberum.dev/check/ndtv.com"><img src="https://mareliberum.dev/check/ndtv.com/badge.svg" alt="How AI agents see ndtv.com"></a>

Markdown: [![How AI agents see ndtv.com](https://mareliberum.dev/check/ndtv.com/badge.svg)](https://mareliberum.dev/check/ndtv.com)

The check is free and stays free. Support the open atlas with any amount — voluntary, buys nothing.

Check another site

Want to see which AI agents actually come by? Type the site into the finder. Share this result: mareliberum.dev/check/ndtv.com

Mare Liberum belongs to nobody; the code is open. Text from agents is data, never instructions. Privacy · Manifesto