💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2021-09-01.gmi captured on 2024-05-26 at 14:52:43. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2021-09-01 00:04:01Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 362,895 URIs, 272,415 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 196,731 URIs serve a Gemini content.

Resources

The average size of the resources is 24,818 bytes.

Quantiles

10% of the resources are 249 bytes or less,
20% of the resources are 374 bytes or less,
30% of the resources are 607 bytes or less,
40% of the resources are 891 bytes or less,
50% of the resources are 1,525 bytes or less, MEDIAN
60% of the resources are 2,585 bytes or less,
70% of the resources are 4,523 bytes or less,
80% of the resources are 8,685 bytes or less,
90% of the resources are 30,263 bytes or less,
100% of the resources are 24,550,785 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 224 bytes or less,
20% of the resources are 317 bytes or less,
30% of the resources are 450 bytes or less,
40% of the resources are 653 bytes or less,
50% of the resources are 876 bytes or less, MEDIAN
60% of the resources are 1,365 bytes or less,
70% of the resources are 2,376 bytes or less,
80% of the resources are 3,626 bytes or less,
90% of the resources are 6,887 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 850 URLs (0.31 %)
10 to 100 bytes: 7908 URLs (2.9 %)
100 to 1000 bytes: 106905 URLs (39.2 %)
1 to 10 kbytes: 106797 URLs (39.2 %)
10 to 100 kbytes: 38868 URLs (14.3 %)
100 to 1000 kbytes: 8463 URLs (3.1 %)
More than 1000 kbytes: 2624 URLs (0.96 %)

Most common media (MIME) types

text/gemini: 196,731 URLs
text/plain: 42,972 URLs
image/jpeg: 11,122 URLs
image/png: 6,679 URLs
application/octet-stream: 3,621 URLs
text/html: 1,782 URLs
image/gif: 1,696 URLs
text/x-patch: 1,183 URLs
application/pdf: 1,090 URLs
text/x-python: 882 URLs
octet/stream: 710 URLs
audio/mpeg: 430 URLs
application/zip: 390 URLs
text/markdown: 287 URLs
audio/ogg: 240 URLs
image/webp: 240 URLs
application/postscript: 221 URLs
text/x-diff: 217 URLs
image/svg+xml: 195 URLs
application/json: 167 URLs

Most common languages

Unspecified: 219,594 URLs
en: 35,286 URLs
ru: 10,088 URLs
fr: 6,223 URLs
de: 258 URLs
es: 224 URLs
ko: 113 URLs
it: 113 URLs
ca: 58 URLs
en_us: 54 URLs
gl: 49 URLs
pl: 49 URLs
es,en: 46 URLs
es_ar: 40 URLs
sv: 37 URLs
sco,gd,it,en: 34 URLs
en,zh: 33 URLs
en,fr: 31 URLs
en,he: 26 URLs
pl,en: 16 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 243,162 URLs
utf-8: 19,663 URLs
us-ascii: 9,525 URLs
binary: 59 URLs
iso-8859-1: 1 URLs
utf-16: 1 URLs
windows-1252: 1 URLs
bzip2: 1 URLs
cp437: 1 URLs
gzip: 1 URLs

Most common encodings for gemtext files only

Unspecified: 189,363 URLs
utf-8: 7,361 URLs
us-ascii: 3 URLs
iso-8859-1: 1 URLs
utf-16: 1 URLs
cp437: 1 URLs
windows-1252: 1 URLs

By the way, 1,943 of recently tested URLs (0.540 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 272,415 occurrences (87.79 %)
51 (Not found): 15,427 occurrences (4.97 %)
44 (Slow down): 12,038 occurrences (3.88 %)
42 (CGI error): 3,149 occurrences (1.01 %)
50 (Permanent failure): 2,436 occurrences (0.79 %)
10 (Input request): 2,071 occurrences (0.67 %)
40 (Temporary failure): 1,138 occurrences (0.37 %)
60 (Client certificate request): 654 occurrences (0.21 %)
30 (Temporary redirect): 484 occurrences (0.16 %)
43 (Proxy error): 404 occurrences (0.13 %)
31 (Permanent redirect): 51 occurrences (0.02 %)
53 (Proxy request refused): 16 occurrences (0.01 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 191

Average number of incoming links: 0.08

Capsules

There are 1538 capsules. We successfully connected recently to 1289 of them.

Most common capsules by number of working URLs

ake.crabdance.com:1966: 10000 URLs
gemini.cabestan.tk: 10000 URLs
gemini.techrights.org: 9999 URLs
git.sysrq.in: 9996 URLs
gemini.conman.org: 9991 URLs
gemini.spam.works: 9966 URLs
jpfox.fr: 9890 URLs
gem.benscraft.info: 9845 URLs
kamalatta.ddnss.de: 9793 URLs
gemini.theuse.net: 9596 URLs
geminispace.info: 9566 URLs
gemini.omarpolo.com: 8843 URLs
mastogem.picasoft.net: 8614 URLs
thegonz.net:3965: 8296 URLs
vps01.rdelaage.ovh: 8276 URLs
midnight.pub: 7573 URLs
ecs.d2evs.net: 6935 URLs
simplynews.metalune.xyz: 6490 URLs
caolan.uk: 6260 URLs
tilde.team: 5738 URLs

Most common capsules by number of bytes in working URLs

jpfox.fr: 814.6 megabytes
ecs.d2evs.net: 338.1 megabytes
blitter.com: 290.4 megabytes
gemini.spam.works: 226.7 megabytes
kamalatta.ddnss.de: 206.2 megabytes
mikelynch.org: 202.6 megabytes
gemini.techrights.org: 174.4 megabytes
ybad.name: 173.1 megabytes
si3t.ch: 172.6 megabytes
gemini.theuse.net: 142.0 megabytes
gemini.conman.org: 136.0 megabytes
nytpu.com: 133.5 megabytes
clemat.is: 111.1 megabytes
oppen.digital: 107.9 megabytes
gemini.circumlunar.space: 99.9 megabytes
kota.nz: 92.1 megabytes
ser1.net: 90.2 megabytes
tilde.team: 87.7 megabytes
tweek.zyxxyz.eu: 87.0 megabytes
vanwa.ch: 83.5 megabytes
runjimmyrunrunyoufuckerrun.com: 83.4 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

1114 (86.4 %) capsules are self-signed, 135 (10.5 %) use the Certificate Authority Let's Encrypt, 40 (3.1 %) are signed by another CA (may be not a trusted one).

42 capsules (3.33 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 773 capsules
sha256WithRSAEncryption: 481 capsules
ED25519: 14 capsules
ecdsa-with-SHA512: 3 capsules
sha512WithRSAEncryption: 2 capsules
ecdsa-with-SHA1: 1 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 790 capsules
RSA: 471 capsules
ED25519: 14 capsules

Key sizes for RSA:

4096: 281 capsules
2048: 183 capsules
1024: 3 capsules
3072: 2 capsules
4098: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 732 capsules
384: 56 capsules
521: 2 capsules

TLS

84 % of the capsules use TLS 1.3, 16 % use TLS 1.2.

44.1 % of URLs do NOT send a proper TLS shutdown (application

close). Even 33.9 % of those who return status 20 are in that case.

A proposal to make this shutdown mandatory.

Ports

9 working capsules (0.7 %) use an alternative port

Addresses

889 IP addresses used. 14 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 392 vhosts
213.219.38.200: 55 vhosts
173.195.146.139: 52 vhosts
86.248.169.233: 22 vhosts
109.237.26.252: 15 vhosts
45.56.93.217: 14 vhosts
52.51.189.88: 8 vhosts
144.91.116.244: 7 vhosts
2a00:5881:4008:d00::: 6 vhosts
174.138.124.169: 6 vhosts
89.234.140.141: 6 vhosts
91.45.232.50: 5 vhosts
82.64.229.81: 5 vhosts
91.45.234.73: 5 vhosts
193.70.85.11: 4 vhosts
211.207.184.198: 4 vhosts
185.73.232.189: 4 vhosts
94.130.177.83: 4 vhosts
78.47.168.92: 4 vhosts
95.217.134.139: 4 vhosts

TLDs

There are 178 TLDs in the capsule's names, and 914 registered domains.

Most common TLDs

By number of registered domains

com: 129 domains
net: 84 domains
org: 83 domains
xyz: 64 domains
space: 47 domains
de: 30 domains
me: 22 domains
eu: 22 domains
site: 21 domains
dev: 18 domains
info: 17 domains
uk: 16 domains
io: 15 domains
club: 15 domains
fr: 13 domains
us: 8 domains
ca: 8 domains
online: 8 domains
tk: 8 domains
ch: 8 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)

online: 396 capsules
com: 151 capsules
org: 103 capsules
net: 101 capsules
xyz: 68 capsules
pub: 68 capsules
space: 56 capsules
de: 31 capsules
club: 31 capsules
eu: 28 capsules
me: 23 capsules
info: 23 capsules
site: 21 capsules
casa: 20 capsules
uk: 19 capsules
dev: 19 capsules
io: 19 capsules
us: 16 capsules
fr: 14 capsules
ch: 11 capsules

Other statistics on the geminispace

At the search engine geminispace.info

By Nervuri (specially for certificates)

Contact

Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.

Home page of the crawler

Source code of the crawler

My capsule