Domain Weight

Domain report

robotstxt.org

57 OF 100
Substantial

Widely referenced across many independent sites.

How the weight is calculated

1,740Referring domainsdistinct domains linking in
#2,614Centrality ranktop 0.0025% of the web
#2,131PageRank rankof 102,661,340
0Links out todistinct domains
5Hosts crawledsubdomains seen
0 moReal Chrome trafficnever measured

Where it sits among 103M domains

#2,614
#1#1K#1M#103M

Log scale. Position by harmonic centrality in the Common Crawl host graph (cc-main-2026-may-jun-jul).

Domains of the same weight

DomainRankReferring
nsf.gov#2,61023,556
yotpo.com#2,61121,779
netflixtechblog.com#2,6122,998
tagesspiegel.de#2,61327,506
xe.com#2,61516,735
temple.edu#2,61611,757
chicagotribune.com#2,61748,726
socialpilot.co#2,6184,837

JSON: /api/v1/domain/robotstxt.org