💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2023-11-01.gmi captured on 2024-07-08 at 23:48:21. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-10-19 03:04:01Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 592,396 URIs, 473,220 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 362,334 URIs serve a Gemini content.

Resources

The average size of the resources is 41,381 bytes.

Quantiles

10% of the resources are 277 bytes or less,
20% of the resources are 605 bytes or less,
30% of the resources are 959 bytes or less,
40% of the resources are 1,626 bytes or less,
50% of the resources are 2,941 bytes or less, MEDIAN
60% of the resources are 5,385 bytes or less,
70% of the resources are 7,890 bytes or less,
80% of the resources are 17,443 bytes or less,
90% of the resources are 66,479 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 245 bytes or less,
20% of the resources are 481 bytes or less,
30% of the resources are 790 bytes or less,
40% of the resources are 1,139 bytes or less,
50% of the resources are 1,888 bytes or less, MEDIAN
60% of the resources are 3,321 bytes or less,
70% of the resources are 5,463 bytes or less,
80% of the resources are 7,532 bytes or less,
90% of the resources are 16,594 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Ranges

Less than 10 bytes: 3217 URLs (0.68 %)
10 to 100 bytes: 11836 URLs (2.5 %)
100 to 1000 bytes: 131043 URLs (27.7 %)
1 to 10 kbytes: 199818 URLs (42.2 %)
10 to 100 kbytes: 92062 URLs (19.5 %)
100 to 1000 kbytes: 27316 URLs (5.8 %)
More than 1000 kbytes: 7928 URLs (1.68 %)

Most common media (MIME) types

text/gemini: 362,334 URLs
text/plain: 29,663 URLs
image/jpeg: 20,137 URLs
image/png: 19,279 URLs
application/octet-stream: 16,359 URLs
application/pdf: 4,794 URLs
application/zip: 3,155 URLs
octet/stream: 2,215 URLs
image/gif: 2,020 URLs
text/html: 2,001 URLs
audio/mpeg: 1,293 URLs
application/x-mscardfile: 1,199 URLs
MIME: 1,063 URLs
text/x-diff: 977 URLs
text/markdown: 713 URLs
application/json: 697 URLs
application/atom+xml: 579 URLs
text/xml: 571 URLs
audio/ogg: 406 URLs
image/webp: 302 URLs

Most common languages

Unspecified: 363,045 URLs
en: 81,826 URLs
de: 11,071 URLs
it: 7,125 URLs
fr: 4,370 URLs
es: 1,506 URLs
es_ar: 1,189 URLs
ja: 1,126 URLs
ru: 505 URLs
en_gb: 373 URLs
en_us: 223 URLs
pl: 157 URLs
ko: 97 URLs
ca: 86 URLs
sv: 69 URLs
eo: 68 URLs
en,he: 56 URLs
gl: 54 URLs
sco,gd,it,en: 38 URLs
pl,en: 31 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 398,241 URLs
utf-8: 65,419 URLs
us-ascii: 9,497 URLs
binary: 35 URLs
gzip: 23 URLs
xz: 2 URLs
bzip2: 2 URLs
iso-8859-1: 1 URLs

Most common encodings for gemtext files only

Unspecified: 306,807 URLs
utf-8: 55,526 URLs
iso-8859-1: 1 URLs

By the way, 1,260 of recently tested URLs (0.223 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 473,220 occurrences (86.19 %)
51 (Not found): 22,510 occurrences (4.10 %)
50 (Permanent failure): 17,965 occurrences (3.27 %)
40 (Temporary failure): 12,629 occurrences (2.30 %)
53 (Proxy request refused): 9,829 occurrences (1.79 %)
60 (Client certificate request): 5,649 occurrences (1.03 %)
10 (Input request): 3,863 occurrences (0.70 %)
42 (CGI error): 1,315 occurrences (0.24 %)
30 (Temporary redirect): 1,218 occurrences (0.22 %)
59 (Bad request): 325 occurrences (0.06 %)
31 (Permanent redirect): 253 occurrences (0.05 %)
44 (Slow down): 169 occurrences (0.03 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 283

Average number of incoming links: 0.18

Capsules

There are 3606 capsules. We successfully connected recently to 2574 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

gemlog.stargrave.org: 10000 URLs
blitter.com: 10000 URLs
midnight.pub: 10000 URLs
mirrors.apple2.org.za: 10000 URLs
gemini.conman.org: 9999 URLs
jsreed5.org: 9995 URLs
rwv.io: 9994 URLs
hoagie.space: 9993 URLs
spam.works: 9984 URLs
caiofior.pollux.casa: 9981 URLs
taz.de: 9977 URLs
library.inu.red: 9966 URLs
gemini.unlimited.pizza: 9784 URLs
gemini.knusbaum.com: 9752 URLs
gemini.tuxmachines.org: 9745 URLs
mastogem.remorse.us: 9733 URLs
gemini.techrights.org: 9728 URLs
tjp.lol: 9662 URLs
gemini.omarpolo.com: 9571 URLs
gemini.autonomy.earth: 9426 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

mirrors.apple2.org.za: 2803.0 megabytes
nytpu.com: 1100.9 megabytes
uscoffings.net: 927.0 megabytes
blitter.com: 824.2 megabytes
gael.mooo.com: 752.4 megabytes
gem.librehacker.com: 746.6 megabytes
yam655.com: 597.2 megabytes
hoagie.space: 498.6 megabytes
skyjake.fi: 444.6 megabytes
gemini.omarpolo.com: 374.0 megabytes
gemini.zachdecook.com: 340.3 megabytes
mikelynch.org: 336.5 megabytes
library.inu.red: 324.0 megabytes
ecs.d2evs.net: 296.6 megabytes
tweek.zyxxyz.eu: 258.7 megabytes
multiverse.thruhere.net: 234.7 megabytes
shit.cx: 182.3 megabytes
phreedom.club: 178.1 megabytes
higeki.jp: 176.4 megabytes
gemini.techrights.org: 170.3 megabytes
rwv.io: 168.5 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

2308 (89.7 %) capsules are self-signed, 208 (8.1 %) use the Certificate Authority Let's Encrypt, 58 (2.3 %) are signed by another CA (may be not a trusted one).

59 capsules (2.30 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1651 capsules
sha256WithRSAEncryption: 902 capsules
ED25519: 18 capsules
ecdsa-with-SHA512: 3 capsules
sha512WithRSAEncryption: 3 capsules
ecdsa-with-SHA384: 1 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1687 capsules
RSA: 874 capsules
ED25519: 18 capsules

Key sizes for RSA:

2048: 596 capsules
4096: 262 capsules
3072: 12 capsules
1024: 3 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1621 capsules
384: 65 capsules
521: 1 capsules

TLS

98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.

robots.txt

256 (10 %) the capsules have a robots.txt exclusion file.

Ports

11 working capsules (0.4 %) use an alternative port

Addresses

1178 IP addresses used. 18 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 817 vhosts
68.133.1.71: 346 vhosts
213.219.38.200: 226 vhosts
173.195.146.139: 103 vhosts
90.65.170.44: 29 vhosts
109.237.26.252: 24 vhosts
45.56.93.217: 17 vhosts
216.238.66.109: 13 vhosts
128.140.115.191: 11 vhosts
81.187.234.86: 8 vhosts
51.222.161.16: 8 vhosts
85.208.51.149: 7 vhosts
174.138.124.169: 7 vhosts
86.147.131.225: 7 vhosts
89.234.140.141: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
66.175.211.51: 6 vhosts
139.162.187.208: 6 vhosts
46.23.94.99: 5 vhosts

TLDs

There are 268 TLDs in the capsule's names, and 1806 registered domains.

Most common TLDs

By number of registered domains

com: 288 domains
net: 154 domains
org: 151 domains
xyz: 125 domains
space: 82 domains
de: 55 domains
dev: 52 domains
me: 47 domains
site: 47 domains
eu: 34 domains
fr: 32 domains
uk: 30 domains
io: 25 domains
info: 24 domains
club: 24 domains
online: 16 domains
se: 15 domains
ch: 15 domains
ca: 14 domains
ru: 13 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)