Crawler

AnimicaDeployBot

AnimicaDeployBot is the web crawler behind Animica Deploy. It fetches a website's public pages — only when that site's owner has explicitly asked us to build an AI assistant for it — so the assistant can answer visitor questions from the site's own content.

User agent

AnimicaDeployBot/1.0 (+https://animica.org/deploy/bot.html)

How it crawls

  • Runs only on request of a site's owner — never speculatively, never site-to-site.
  • Honors robots.txt fail-closed: if a rule disallows us (or is ambiguous), we do not fetch.
  • Fetches at most 1 request per second, up to 200 pages per site, 4 links deep.
  • Stays on the site's own domain; only HTML pages are read (no media, no binaries).
  • Never submits forms, never logs in, never reads private areas.

How to opt out

Add this to your site's robots.txt and AnimicaDeployBot will not fetch any page:

User-agent: AnimicaDeployBot
Disallow: /

Opting out also blocks re-indexing of any existing assistant built from your site.

Data removal & contact

To have crawled content removed, or for any question about the crawler, email contact@animica.org with your domain — removal requests from site owners are honored promptly.