Veritaset / VeritasetBot

VeritasetBot

VeritasetBot reads the public plan and price pages of mobile operators so that Veritaset can publish dated, sourced plan data and rank plans for people and their AI assistants. It identifies itself as VeritasetBot/0.1 (+https://veritaset.com/bot/).

How it behaves

  • It reads robots.txt first and obeys it, including rules for AI crawlers (ClaudeBot, anthropic-ai, Claude-Web, Claude-User) and Content-Signal directives: ai-input=no means we do not read the site.
  • A refusal is final. If a site answers with 403, a bot check, a challenge or a waiting room, we stop and do not retry with another client or a browser. Such brands are listed as awaiting data.
  • It fetches only plan, price and contract-summary pages: a few requests per brand per week, one at a time per site. No logins, no forms, no checkout.
  • Its requests are signed with Web Bot Auth (HTTP message signatures, Ed25519). Our key directory: /.well-known/http-message-signatures-directory; signature agent https://veritaset.com.

What we do with the pages

We extract plan facts (price, data, minutes, contract, fees, roaming) with the source address and check date. Pages are not republished. Facts are published on veritaset.com and served to AI assistants through our connector; see method and independence.

Contact

To block, allow or ask about VeritasetBot: data@veritaset.com. To block it, add User-agent: VeritasetBot / Disallow: / to robots.txt.