Privacy policy
Last updated
Who runs this site
AI Crawlability Checker is operated by Mecverse Tech Solutions LLP (“Mecverse”), Lucknow, India. Questions about this policy can be sent through the Mecverse contact page.
The short version
We do not store the URLs you check, the reports we generate, or anything that identifies you. There are no accounts, no cookies, no analytics scripts and no advertising trackers on this site.
What happens when you run a check
When you submit a URL, your browser asks our server to download that page, its robots.txt, sitemap, llms.txt and llms-full.txt, and to request the page again with the user-agent of each AI crawler we test. Our server fetches them once, returns the raw response to your browser, and forgets it. The actual analysis and scoring run entirely in your browser. Exported PDF, CSV and JSON files are created on your device and never uploaded.
For safety, our server refuses to fetch private or local network addresses, limits each download to 3 MB and gives up after 10 seconds.
Rate limiting
To stop abuse, the server keeps a counter of requests per IP address in memory for one minute. The counter is never written to disk or logs and is discarded when the minute ends.
Sites you check
Our server fetches the page once with a standard browser user-agent and once with each AI crawler’s published user-agent, so the site’s logs will show those user-agents coming from our server. We fetch only the files listed above. We do not crawl beyond the page you entered.
Hosting
Our hosting provider may keep standard network logs (such as IP addresses and timestamps) for security and reliability, as every web host does. We do not use them to build profiles.
Changes
If this policy changes, the date at the top of this page will change with it.