Extract title, description, canonical URL, robots meta, Open Graph, H1 count and JSON-LD count from a public HTTPS page.
# 1. Ask the endpoint what it costs (no payment, no wallet needed): curl -i -X GET 'https://milliapi.com/api/page-metadata' # -> HTTP/1.1 402 Payment Required # the response carries the price, asset and pay-to address. # 2. Pay and retry with any x402 client: npx x402-fetch 'https://milliapi.com/api/page-metadata'
Endpoint: https://milliapi.com/api/page-metadata. Operated by milliapi.com, not by Animica. Price and availability were correct at the last probe on 2026-09-02 and are set by the operator, who may change them.
Check whether a public HTTPS page is ready for AI agents and answer engines. Returns AI-crawler access, robots.txt and llms.txt status, canonical and meta tags,…
Check robots.txt homepage permissions for major AI crawlers including GPTBot, OAI-SearchBot, ClaudeBot, Google-Extended, PerplexityBot and Applebot-Extended.
Check whether a website publishes llms.txt and return its status, byte size, and a bounded preview for agent discovery workflows.