# Indexable

> Part of [Lensy by Perseverance AI](https://perseveranceai.com/). The index of every page for AI agents is at [https://perseveranceai.com/llms.txt](https://perseveranceai.com/llms.txt).

Last updated: 2026-11-12

AI search check S3, worth 25 points.

## What it measures and why

Not noindex (meta robots or X-Robots-Tag): 10, and noindex makes the whole check 0. Canonical present: 7. Page listed in the sitemap: 8. Sitemaps named in robots.txt are used; without one, Lensy tries <link rel="sitemap">, /sitemap.xml and /sitemap-index.xml, then the same under the page's first path segment (for example /docs/sitemap.xml). Sitemap indexes are followed, at most 12 files.

A page that asks not to be indexed, or that search engines cannot find in the sitemap, is less likely to be retrieved for an answer.

Evidence:

- [arXiv 2609.35077: what drives citations in production LLMs](https://arxiv.org/html/2609.35077v1)

## How it counts

S3 is one of six AI search checks, worth 25 of the score's 100 points. It gives full, partial or no points, and the AI search score is the sum of the six. A page that can't be reached at all gets no score; the reachability line above both scores says why.

**Depends on your hosting.** An X-Robots-Tag noindex header is set by your host. A local build (`--dir` or a localhost URL) counts this check, but your host can change the result.

## Check it yourself

Scan the page on the [home page](https://perseveranceai.com/#scan), or run `lensy check <url>` from the [command line tool](https://perseveranceai.com/docs/cli) and look for `S3` in the report. A failed check comes with the fix worth the most points first. `lensy explain S3` prints what it measures, why it matters and the evidence in your terminal, and [every check](https://perseveranceai.com/docs/checks) lists the rest.

[All checks](https://perseveranceai.com/docs/checks)
