robotstxt.tech
robotstxt.tech is a live website hosted on Hetzner Online GmbH (AS24940) in Germany, served by Cloudflare. cl0q first saw it on 2026-09-08 and last crawled it on 2026-09-08. It resolves to 116.203.244.1.
How the site describes itself:
robots.txt Tools & Resources
Tools and guides to manage and optimize your robots.txt file. Created by ex-Google engineer Fili.
| Status | 200 OK — live & indexed by cl0q |
|---|---|
| First seen | 2026-09-08 |
| Last crawled | 2026-09-08 |
| IPv4 | 116.203.244.1 |
| Network | AS24940 Hetzner Online GmbH · Germany |
| Server | cloudflare |