💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2022-01-08 at 13:39:39. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2022-01-08 13:04:02Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 410,212 URIs, 326,612 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 231,508 URIs serve a Gemini content.

Resources

The average size of the resources is 30,788 bytes.

Quantiles

10% of the resources are 210 bytes or less,
20% of the resources are 393 bytes or less,
30% of the resources are 685 bytes or less,
40% of the resources are 1,017 bytes or less,
50% of the resources are 1,761 bytes or less, MEDIAN
60% of the resources are 2,819 bytes or less,
70% of the resources are 5,109 bytes or less,
80% of the resources are 10,300 bytes or less,
90% of the resources are 38,454 bytes or less,
100% of the resources are 7,143,369 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 155 bytes or less,
20% of the resources are 319 bytes or less,
30% of the resources are 488 bytes or less,
40% of the resources are 710 bytes or less,
50% of the resources are 963 bytes or less, MEDIAN
60% of the resources are 1,515 bytes or less,
70% of the resources are 2,435 bytes or less,
80% of the resources are 3,993 bytes or less,
90% of the resources are 7,378 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 1333 URLs (0.41 %)
10 to 100 bytes: 9079 URLs (2.8 %)
100 to 1000 bytes: 119177 URLs (36.5 %)
1 to 10 kbytes: 130657 URLs (40.0 %)
10 to 100 kbytes: 50185 URLs (15.4 %)
100 to 1000 kbytes: 12041 URLs (3.7 %)
More than 1000 kbytes: 4140 URLs (1.27 %)

Most common media (MIME) types

text/gemini: 231,508 URLs
text/plain: 48,133 URLs
image/jpeg: 15,537 URLs
image/png: 8,030 URLs
application/octet-stream: 3,592 URLs
application/pdf: 3,182 URLs
octet/stream: 2,201 URLs
image/gif: 2,011 URLs
text/x-patch: 1,984 URLs
text/html: 1,876 URLs
application/x-mscardfile: 1,198 URLs
audio/mpeg: 1,131 URLs
text/x-python: 950 URLs
application/zip: 568 URLs
text/x-diff: 446 URLs
image/svg+xml: 370 URLs
text/x-csrc: 315 URLs
image/webp: 288 URLs
text/markdown: 220 URLs
application/x-gzip: 208 URLs

Most common languages

Unspecified: 257,786 URLs
en: 50,871 URLs
ru: 10,087 URLs
fr: 5,831 URLs
ga: 637 URLs
de: 273 URLs
es: 245 URLs
it: 139 URLs
ko: 110 URLs
gl: 89 URLs
ca: 77 URLs
pl: 75 URLs
en,zh: 73 URLs
en_us: 57 URLs
es_ar: 40 URLs
sco,gd,it,en: 39 URLs
sv: 37 URLs
fi: 22 URLs
hu: 22 URLs
zh: 18 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 293,373 URLs
utf-8: 23,756 URLs
us-ascii: 9,456 URLs
binary: 18 URLs
gzip: 3 URLs
bzip2: 2 URLs
windows-1252: 1 URLs
cp437: 1 URLs
u: 1 URLs
utf-16: 1 URLs

Most common encodings for gemtext files only

Unspecified: 216,517 URLs
utf-8: 14,988 URLs
cp437: 1 URLs
utf-16: 1 URLs
windows-1252: 1 URLs

By the way, 1,794 of recently tested URLs (0.446 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 326,612 occurrences (87.06 %)
51 (Not found): 19,722 occurrences (5.26 %)
50 (Permanent failure): 8,505 occurrences (2.27 %)
40 (Temporary failure): 5,752 occurrences (1.53 %)
44 (Slow down): 4,850 occurrences (1.29 %)
42 (CGI error): 3,990 occurrences (1.06 %)
60 (Client certificate request): 2,135 occurrences (0.57 %)
10 (Input request): 1,946 occurrences (0.52 %)
31 (Permanent redirect): 627 occurrences (0.17 %)
30 (Temporary redirect): 545 occurrences (0.15 %)
43 (Proxy error): 405 occurrences (0.11 %)
53 (Proxy request refused): 35 occurrences (0.01 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 204

Average number of incoming links: 0.13

Capsules

There are 1935 capsules. We successfully connected recently to 1569 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

blitter.com: 10000 URLs
ake.crabdance.com:1966: 10000 URLs
gemini.techrights.org: 10000 URLs
gemini.rob-bolton.co.uk: 9999 URLs
git.skyjake.fi:1968: 9998 URLs
git.sysrq.in: 9994 URLs
gemini.conman.org: 9986 URLs
gemini.susa.net: 9980 URLs
gemini.spam.works: 9976 URLs
gem.benscraft.info: 9966 URLs
gemini.theuse.net: 9962 URLs
jpfox.fr: 9809 URLs
geminispace.info: 9570 URLs
vps01.rdelaage.ovh: 9180 URLs
mastogem.picasoft.net: 9014 URLs
gemini.omarpolo.com: 8785 URLs
midnight.pub: 8016 URLs
tilde.team: 7745 URLs
ecs.d2evs.net: 7087 URLs
gemini.autonomy.earth: 6787 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

jpfox.fr: 965.3 megabytes
blitter.com: 824.1 megabytes
yam655.com: 595.8 megabytes
gem.billsmugs.com: 344.5 megabytes
snowcode.ovh: 317.5 megabytes
nytpu.com: 301.3 megabytes
ecs.d2evs.net: 289.8 megabytes
kamalatta.ddnss.de: 270.7 megabytes
multiverse.thruhere.net: 233.6 megabytes
gemini.spam.works: 226.8 megabytes
mikelynch.org: 202.6 megabytes
gemini.theuse.net: 198.2 megabytes
shit.cx: 181.0 megabytes
gemini.techrights.org: 174.4 megabytes
si3t.ch: 170.8 megabytes
tweek.zyxxyz.eu: 162.2 megabytes
gemini.conman.org: 150.9 megabytes
gemini.circumlunar.space: 112.9 megabytes
clemat.is: 111.0 megabytes
tilde.team: 109.2 megabytes
pgorl32jhgkgald7tcsp6k7zpujvd763kywenr72yr76fqjaomxf7kid.onion: 107.9 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

1361 (86.7 %) capsules are self-signed, 168 (10.7 %) use the Certificate Authority Let's Encrypt, 40 (2.5 %) are signed by another CA (may be not a trusted one).

53 capsules (3.44 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1029 capsules
sha256WithRSAEncryption: 514 capsules
ED25519: 9 capsules
ecdsa-with-SHA512: 3 capsules
sha512WithRSAEncryption: 3 capsules
ecdsa-with-SHA384: 2 capsules
ecdsa-with-SHA1: 1 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1052 capsules
RSA: 501 capsules
ED25519: 9 capsules

Key sizes for RSA:

4096: 283 capsules
2048: 209 capsules
3072: 5 capsules
1024: 2 capsules
4098: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 973 capsules
384: 77 capsules
521: 2 capsules

TLS

88 % of the capsules use TLS 1.3, 12 % use TLS 1.2.

Ports

10 working capsules (0.6 %) use an alternative port

Addresses

1015 IP addresses used. 14 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 490 vhosts
213.219.38.200: 98 vhosts
173.195.146.139: 72 vhosts
90.39.173.134: 23 vhosts
68.133.4.32: 18 vhosts
109.237.26.252: 16 vhosts
45.56.93.217: 15 vhosts
52.51.189.88: 8 vhosts
144.91.116.244: 7 vhosts
2a00:5881:4008:d00::: 6 vhosts
2a00:5881:4008:d00::42: 6 vhosts
89.234.140.141: 6 vhosts
174.138.124.169: 6 vhosts
188.68.55.245: 6 vhosts
2001:19f0:6001:4f71:5400:3ff:fea8:7c5e: 5 vhosts
2001:19f0:5c01:83b:5400:2ff:fe02:94cf: 5 vhosts
149.28.115.162: 5 vhosts
37.79.202.136: 5 vhosts
104.207.153.51: 5 vhosts
91.45.233.113: 4 vhosts

TLDs

There are 195 TLDs in the capsule's names, and 1123 registered domains.

Most common TLDs

By number of registered domains

com: 169 domains
org: 96 domains
net: 96 domains
xyz: 82 domains
space: 56 domains
de: 36 domains
me: 29 domains
site: 28 domains
eu: 26 domains
dev: 24 domains
info: 19 domains
uk: 19 domains
io: 18 domains
club: 17 domains
fr: 16 domains
ca: 13 domains
online: 10 domains
ch: 10 domains
us: 8 domains
pl: 8 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)

online: 495 capsules
com: 198 capsules
org: 139 capsules
net: 114 capsules
pub: 103 capsules
xyz: 88 capsules
space: 67 capsules
de: 42 capsules
club: 35 capsules
eu: 33 capsules
me: 29 capsules
site: 28 capsules
info: 25 capsules
dev: 24 capsules
uk: 22 capsules
casa: 21 capsules
io: 21 capsules
fr: 16 capsules
us: 16 capsules
ca: 16 capsules

Other statistics on the geminispace

At the search engine geminispace.info

By Nervuri (specially for certificates)

Contact

Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.

Home page of the crawler

Source code of the crawler

My capsule