AISutraBot is the crawler AISutra uses to read a public website when its owner (or someone with the owner's permission) has ordered an audit. It is not a search engine crawler and does not collect pages in bulk.
How to recognize it
User-Agent: AISutraBot/0.1 (+https://aisutra.dev/bot)AISutraBot does not use a fixed IP address range. Identify it by this user-agent string.
What it does
- Reads only public pages of the site being audited: up to 15 HTML pages, plus
robots.txtandsitemap.xml. - Respects robots.txt. If your robots.txt disallows AISutraBot, AISutra will not audit the site.
- Crawls gently: it waits at least 0.4 seconds between requests and does not run in parallel against one site.
- Does not log in, submit forms, run JavaScript, solve CAPTCHAs, or bypass paywalls or access controls.
- Only audits a site when the owner, or someone authorized by the owner, has requested it.
What it keeps
Pages it reads are used to produce the audit report and to show the evidence behind each finding. See our Privacy Policy for how long audit data is kept.
Allow or block AISutraBot
To block it, add this to your robots.txt:
User-agent: AISutraBot
Disallow: /To allow it explicitly:
User-agent: AISutraBot
Allow: /Problems or questions
If AISutraBot has visited your site and you did not expect it, or you would like to report a problem, email hello@aisutra.dev with your site address and we will respond promptly.