Explore the web
A live look at the open web as cl0q’s own crawler sees it — an independent index, no third-party search behind it. Updated 55 min ago.
Crawl momentum pages indexed per dayCSVJSON
How fast the index grows — new and refreshed pages the crawler network wrote each day, over the last 19 days.
Top hosting networks click to drill in →CSVJSON
View all 150 →
Top-level domains click to explore →CSVJSON
View all 150 →
What powers the web server software — click to drill in →CSVJSON
Languages page language — click to drill in →CSVJSON
View all 150 →
Response mix live vs redirect vs deadCSVJSON
Biggest subdomain hubs platforms — click for the crawl profile →CSVJSON
View all 15 →
Content types what the web actually servesCSVJSON
Most-shared favicons icons served by the most sites — click to pivot →
cl0q fingerprints every site’s favicon by SHA‑256. These are the icons served by the most domains — CMS defaults, hosting & parking kits, and shared‑infrastructure clusters. Click any icon to find every site serving it — the favicon: pivot behind the API.
826k
338.3k
318.7k
306.3k
267.3k
212.3k
174.4k
161.1k
123.3k
112.3k
100.8k
98.5k
74.6k
74.1k
71.7k
57.8k
45.2k
43.6k
42.8k
40.9k
30.2k
28.1k
25.8k
24.9k
24.1k
24k
23.2k
22.9k
22.5k
22.1k
19.6k
18.4k
17.6k
16.6k
15.6k
15.6k
12.7k
12.1k
11.7k
11.2k
Counts are exact, across all crawled favicons. Click any icon for the full site list, or query favicon:<sha256> via the API.
Pull the full data every matching domain, as CSV or JSON
The buttons above export what a graph shows. To pull every domain behind it — a whole TLD, network, language, server, country, or the entire index — build a full report. Large ones generate in the background; a download link appears when it’s ready. Free with a cl0q account — you’ll be asked to sign in when you generate one.
Columns: domain, status, title, description, server, language, network. Reports expire after 3 days. One report generates at a time (paced) so pulls never slow the crawler.
State of the web what a typical indexed page looks like
Measured across cl0q’s own crawl — not a survey, not a top-1M list. Medians and adoption rates over a live sample of the whole index.
* measured over pages crawled in the last 24h. Everything else is a sample of the full index. Page size is deliberately omitted — the crawler isn’t recording it reliably yet.
Where the web is hosted by server location — click a country to drill in →CSVJSON
Browse by top-level domain โ 623 profiled
Take the data — all of it open index, open API, no key
cl0q is an independent, open-source search engine: our own crawler, our own index, nobody else’s results behind it. Every number on this page is a JSON endpoint — no API key, no sign-up, CORS open, so you can chart it, cite it, or fork it.
GET /api/stats— everything in the tiles + all distributionsGET /api/facets— every drill-down key you can queryGET /api/tld/<tld>— per-TLD profileGET /api/country/<cc>— per-country profileGET /api/tech/<server>— per-server profileGET /api/lang/<code>— per-language profile
Full reference in the developer docs. Counts are exact; distributions are sampled and labelled as such. If you publish something with it, we’d love to see it.