Our crawler
FeedaraBot
FeedaraBot fetches public pages from online stores so their owners can see what an AI shopping assistant reads about them: the structured product data, the sitemap, the robots rules, and any published merchant feed.
How to recognise it
FeedaraBot/0.1 (+https://feedara.ai/bot)Every request also carries a Web Bot Auth signature, so it can be verified cryptographically rather than taken on trust. The public key is at /.well-known/http-message-signatures-directory.
What it does
- Reads robots.txt first and obeys it, including crawl-delay.
- Fetches at most 25 product pages per inspection, plus the homepage, sitemap and a short list of feed locations.
- Runs no JavaScript, submits no forms, follows no checkout, and stores no personal data.
- Requests one page at a time when a crawl-delay is declared, and a small number in parallel otherwise.
What it never does
FeedaraBot never sends another operator’s user-agent. We do not test a site’s access rules by pretending to be GPTBot, OAI-SearchBot, PerplexityBot or anything else. If a report says a crawler is blocked, that comes from reading the site’s own published robots.txt rules, never from impersonating one.
How to block it
Add this to your robots.txt and we will stop, from the next request onward:
User-agent: FeedaraBot Disallow: /
Something wrong?
If a report about your store is inaccurate, or you want it corrected or removed, write to hello@feedara.ai. We honour those quickly and without argument.