Docs

Guides

A short, deliberately small set of guides — each grounded in code Metryn actually ships, not written to fill out a list.

• How AI crawlers interact with robots.txt

  What robots.txt actually controls, which tracked AI crawlers reliably honor it, and a minimal explicit-allow example.

• OAI-SearchBot and PerplexityBot: checking access

  The real HTTP identity of both search-discovery crawlers, how to check your own access policy, and what Metryn does and doesn't verify.

• Structured data and technical entity clarity

  What JSON-LD actually does, what Metryn publishes about itself, and what the structured-data check looks for on a scanned site.

See also the methodology page for how the score itself works.