robotsv2.org
robotsv2.org is a live English-language website hosted on Cloudflare, Inc. (AS13335) in the United States, served by Cloudflare. cl0q first saw it on 2026-10-01 and last crawled it on 2026-10-01. It resolves to 104.21.90.32.
How the site describes itself:
robots2.txt — AI Policy for the Open Web
robots2.txt extends robots.txt with AI-specific directives. Tell AI agents what they can and cannot do with your content.
| Status | 200 OK — live & indexed by cl0q |
|---|---|
| First seen | 2026-10-01 |
| Last crawled | 2026-10-01 |
| IPv4 | 104.21.90.32 |
| IPv6 | 2606:4700:3032::ac43:c1c7 |
| Network | AS13335 Cloudflare, Inc. · United States |
| Language | en-AU |
| Server | cloudflare |
Explore more like this
More sites on Cloudflare, Inc.
Get this data at scale
This dossier is one domain from cl0q's index. Query the same live index through the API, or download the censuses built from it.
- API credit pack — 100,000 lookups against the live index, no subscription, at 30 lookups a minute.
- Server Tech Census — one row per domain: server, language and CDN flag.