💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2023-01-01.gmi captured on 2023-12-28 at 20:06:55. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2022-12-31 19:04:02Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 499,366 URIs, 366,271 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 282,013 URIs serve a Gemini content.

Resources

The average size of the resources is 37,415 bytes.

Quantiles

10% of the resources are 195 bytes or less,
20% of the resources are 545 bytes or less,
30% of the resources are 850 bytes or less,
40% of the resources are 1,407 bytes or less,
50% of the resources are 2,509 bytes or less, MEDIAN
60% of the resources are 4,303 bytes or less,
70% of the resources are 6,456 bytes or less,
80% of the resources are 12,964 bytes or less,
90% of the resources are 50,073 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 123 bytes or less,
20% of the resources are 409 bytes or less,
30% of the resources are 690 bytes or less,
40% of the resources are 959 bytes or less,
50% of the resources are 1,527 bytes or less, MEDIAN
60% of the resources are 2,542 bytes or less,
70% of the resources are 4,169 bytes or less,
80% of the resources are 5,771 bytes or less,
90% of the resources are 10,470 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Ranges

Less than 10 bytes: 1119 URLs (0.31 %)
10 to 100 bytes: 10187 URLs (2.8 %)
100 to 1000 bytes: 112113 URLs (30.6 %)
1 to 10 kbytes: 158025 URLs (43.1 %)
10 to 100 kbytes: 62355 URLs (17.0 %)
100 to 1000 kbytes: 16710 URLs (4.6 %)
More than 1000 kbytes: 5762 URLs (1.57 %)

Most common media (MIME) types

text/gemini: 282,012 URLs
text/plain: 28,180 URLs
image/jpeg: 16,847 URLs
image/png: 15,010 URLs
application/octet-stream: 5,276 URLs
application/pdf: 3,537 URLs
image/gif: 3,275 URLs
octet/stream: 2,213 URLs
text/html: 1,937 URLs
application/zip: 1,281 URLs
application/x-mscardfile: 1,198 URLs
audio/mpeg: 776 URLs
text/x-diff: 764 URLs
application/json: 612 URLs
image/webp: 298 URLs
application/atom+xml: 209 URLs
application/lagrange-fontpack+zip: 200 URLs
audio/midi: 184 URLs
audio/ogg: 182 URLs
text/xml: 179 URLs

Most common languages

Unspecified: 292,130 URLs
en: 53,655 URLs
de: 11,012 URLs
fr: 5,693 URLs
fi: 1,115 URLs
ja: 526 URLs
es_ar: 514 URLs
es: 311 URLs
ru: 309 URLs
en_us: 152 URLs
it: 131 URLs
ko: 127 URLs
pl: 101 URLs
ca: 86 URLs
sv: 58 URLs
gl: 54 URLs
sco,gd,it,en: 38 URLs
eo: 28 URLs
no: 26 URLs
pl,en: 26 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 327,896 URLs
utf-8: 28,851 URLs
us-ascii: 9,478 URLs
binary: 21 URLs
gzip: 13 URLs
windows-1252: 2 URLs
cp437: 2 URLs
u: 2 URLs
utf-16: 2 URLs
iso-8859-1: 1 URLs
bzip2: 1 URLs

Most common encodings for gemtext files only

Unspecified: 261,054 URLs
utf-8: 20,951 URLs
cp437: 2 URLs
utf-16: 2 URLs
windows-1252: 2 URLs
iso-8859-1: 1 URLs

By the way, 2,417 of recently tested URLs (0.499 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 366,268 occurrences (85.92 %)
51 (Not found): 25,878 occurrences (6.07 %)
40 (Temporary failure): 6,343 occurrences (1.49 %)
60 (Client certificate request): 5,470 occurrences (1.28 %)
50 (Permanent failure): 4,960 occurrences (1.16 %)
30 (Temporary redirect): 4,677 occurrences (1.10 %)
44 (Slow down): 4,642 occurrences (1.09 %)
42 (CGI error): 3,986 occurrences (0.94 %)
10 (Input request): 2,062 occurrences (0.48 %)
31 (Permanent redirect): 1,561 occurrences (0.37 %)
59 (Bad request): 294 occurrences (0.07 %)
43 (Proxy error): 54 occurrences (0.01 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 241

Average number of incoming links: 0.19

Capsules

There are 2988 capsules. We successfully connected recently to 2251 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

midnight.pub: 10000 URLs
gemini.conman.org: 9997 URLs
blitter.com: 9995 URLs
gemini.techrights.org: 9994 URLs
jpfox.fr: 9994 URLs
hoagie.space: 9990 URLs
jsreed5.org: 9989 URLs
gemini.spam.works: 9983 URLs
gemini.thebackupbox.net: 9981 URLs
taz.de: 9935 URLs
library.inu.red: 9435 URLs
gemini.omarpolo.com: 9109 URLs
gemini.autonomy.earth: 8453 URLs
gemini.knusbaum.com: 8413 URLs
mastogem.picasoft.net: 8375 URLs
ecs.d2evs.net: 8316 URLs
rawtext.club: 7571 URLs
circumlunar.thebackupbox.net: 6365 URLs
caolan.uk: 6053 URLs
godocs.io: 5652 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

si3t.ch: 1087.2 megabytes
jpfox.fr: 1069.7 megabytes
uscoffings.net: 895.1 megabytes
blitter.com: 824.1 megabytes
nytpu.com: 735.4 megabytes
gael.mooo.com: 616.0 megabytes
hoagie.space: 515.2 megabytes
snowcode.ovh: 300.7 megabytes
ecs.d2evs.net: 283.0 megabytes
skyjake.fi: 273.2 megabytes
multiverse.thruhere.net: 234.7 megabytes
gemini.spam.works: 197.3 megabytes
shit.cx: 182.3 megabytes
library.inu.red: 180.5 megabytes
gemini.techrights.org: 174.2 megabytes
gem.girlmeow.autos: 161.7 megabytes
gemini.conman.org: 151.5 megabytes
rawtext.club: 127.0 megabytes
gemini.autonomy.earth: 121.3 megabytes
gemini.circumlunar.space: 120.2 megabytes
kota.nz: 120.1 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

1981 (88.0 %) capsules are self-signed, 200 (8.9 %) use the Certificate Authority Let's Encrypt, 70 (3.1 %) are signed by another CA (may be not a trusted one).

57 capsules (2.56 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1455 capsules
sha256WithRSAEncryption: 772 capsules
ED25519: 13 capsules
ecdsa-with-SHA512: 5 capsules
sha512WithRSAEncryption: 3 capsules
ecdsa-with-SHA384: 2 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1480 capsules
RSA: 758 capsules
ED25519: 13 capsules

Key sizes for RSA:

2048: 475 capsules
4096: 271 capsules
3072: 7 capsules
512: 3 capsules
1024: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1394 capsules
384: 84 capsules
521: 2 capsules

TLS

97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.

5.6 % of capsules do NOT send a proper close.

The full list

robots.txt

223 (10 %) the capsules have a robots.txt exclusion file.

Ports

13 working capsules (0.6 %) use an alternative port

Addresses

1165 IP addresses used. 16 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 714 vhosts
68.133.1.71: 219 vhosts
213.219.38.200: 191 vhosts
173.195.146.139: 98 vhosts
90.65.170.44: 25 vhosts
109.237.26.252: 19 vhosts
45.56.93.217: 17 vhosts
216.238.66.109: 14 vhosts
104.245.33.223: 8 vhosts
52.51.189.88: 8 vhosts
135.181.153.189: 7 vhosts
174.138.124.169: 7 vhosts
85.208.51.149: 7 vhosts
139.162.187.208: 6 vhosts
89.234.140.141: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
51.222.161.16: 6 vhosts
2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
64.226.23.78: 6 vhosts
89.253.220.199: 5 vhosts

TLDs

There are 232 TLDs in the capsule's names, and 1519 registered domains.

Most common TLDs

By number of registered domains

com: 244 domains
net: 136 domains
org: 126 domains
xyz: 109 domains
space: 67 domains
de: 43 domains
me: 38 domains
dev: 38 domains
site: 37 domains
eu: 31 domains
fr: 27 domains
io: 25 domains
info: 25 domains
uk: 23 domains
club: 19 domains
ch: 14 domains
ca: 13 domains
se: 12 domains
online: 12 domains
us: 11 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)