Free data from cl0q's crawl
Rollups, not per-domain rows. These are the counts behind cl0q's headlines, published so anyone can cite or check them. If you need per-domain rows, those are the paid datasets on /datasets.
Hosting networks
Domains per ASN organisation, from the trigger-maintained cl0q_asn_rollup table. crawled is the status-200 subset; shares are of ASN-attributed domains only — domains with no ASN attribution are excluded, not counted as zero.
Licence: CC BY-SA 4.0. IP address data is powered by IPinfo.
Server software
Domains per server software, from the precomputed tech facet index that backs /api/facets — the top 60 values only, not all server software. Values are raw Server-header values and include noise (bare 'server', 'aaa'). Counts reflect the live index at the last facet warm-job run, not a real-time query.
Licence: CC BY 4.0 (cl0q's own crawl).
Countries
Domains per country, from the precomputed country facet index that backs /api/facets, same freshness caveat as server software.
Licence: CC BY-SA 4.0. IP address data is powered by IPinfo.
How we measure, and the limits
cl0q is a crawl-based, domain-level index, not a port scanner: we see what sites publish (headers, meta, content), not listening services. Server software is the Server header as sent; some hosts suppress it — suppressed hosts are absent, not estimated. A Cloudflare row means the edge answered, not what the origin runs. Counts cover only domains with network attribution: domains without it are excluded, not counted as zero. Snapshot date: rollups are generated live on download from the current rollup table and facet indexes, so the download date is the snapshot date; facet indexes reflect the last warm-job run, not a real-time query. Figures move between generations as the crawl and the warm jobs refresh; a rollup downloaded today will not match a rollup downloaded next month, and neither is wrong.
Licences
Each file carries its own licence, stated beside its download above: server software under CC BY 4.0; hosting networks and countries under CC BY-SA 4.0, with IP address data powered by IPinfo. Do not describe the whole set as CC BY.
Questions: cl0qsearch@gmail.com.