💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2023-04-01.gmi captured on 2024-05-26 at 14:44:49. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-03-27 18:04:01Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 532,208 URIs, 407,544 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 319,352 URIs serve a Gemini content.

Resources

The average size of the resources is 42,951 bytes.

Quantiles

10% of the resources are 263 bytes or less,
20% of the resources are 578 bytes or less,
30% of the resources are 867 bytes or less,
40% of the resources are 1,372 bytes or less,
50% of the resources are 2,462 bytes or less, MEDIAN
60% of the resources are 4,407 bytes or less,
70% of the resources are 7,206 bytes or less,
80% of the resources are 15,800 bytes or less,
90% of the resources are 76,897 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 235 bytes or less,
20% of the resources are 457 bytes or less,
30% of the resources are 728 bytes or less,
40% of the resources are 1,007 bytes or less,
50% of the resources are 1,575 bytes or less, MEDIAN
60% of the resources are 2,602 bytes or less,
70% of the resources are 4,445 bytes or less,
80% of the resources are 6,667 bytes or less,
90% of the resources are 13,268 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 3362 URLs (0.82 %)
10 to 100 bytes: 10572 URLs (2.6 %)
100 to 1000 bytes: 122724 URLs (30.1 %)
1 to 10 kbytes: 169670 URLs (41.6 %)
10 to 100 kbytes: 68006 URLs (16.7 %)
100 to 1000 kbytes: 26013 URLs (6.4 %)
More than 1000 kbytes: 7197 URLs (1.77 %)

Most common media (MIME) types

text/gemini: 319,352 URLs
image/jpeg: 18,355 URLs
image/png: 18,126 URLs
text/plain: 15,905 URLs
application/octet-stream: 12,693 URLs
application/pdf: 4,368 URLs
application/zip: 3,065 URLs
image/gif: 3,034 URLs
octet/stream: 2,217 URLs
text/html: 1,976 URLs
application/x-mscardfile: 1,198 URLs
MIME: 997 URLs
audio/mpeg: 878 URLs
text/x-diff: 762 URLs
application/json: 594 URLs
audio/ogg: 326 URLs
text/xml: 239 URLs
application/atom+xml: 233 URLs
image/webp: 231 URLs
application/xml: 219 URLs

Most common languages

Unspecified: 320,988 URLs
en: 60,465 URLs
de: 11,086 URLs
it: 6,964 URLs
fr: 3,291 URLs
fi: 1,131 URLs
ja: 1,110 URLs
es_ar: 861 URLs
ru: 441 URLs
es: 316 URLs
en_us: 209 URLs
ko: 127 URLs
gl: 120 URLs
ca: 86 URLs
sv: 59 URLs
sco,gd,it,en: 38 URLs
pl,en: 29 URLs
eo: 28 URLs
hu: 22 URLs
tok: 21 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 368,152 URLs
utf-8: 39,284 URLs
us-ascii: 59 URLs
gzip: 22 URLs
binary: 16 URLs
windows-1252: 2 URLs
bzip2: 2 URLs
cp437: 2 URLs
u: 2 URLs
utf-16: 2 URLs
iso-8859-1: 1 URLs

Most common encodings for gemtext files only

Unspecified: 288,869 URLs
utf-8: 30,476 URLs
cp437: 2 URLs
utf-16: 2 URLs
windows-1252: 2 URLs
iso-8859-1: 1 URLs

By the way, 1,291 of recently tested URLs (0.250 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 407,544 occurrences (84.95 %)
51 (Not found): 32,701 occurrences (6.82 %)
40 (Temporary failure): 6,374 occurrences (1.33 %)
60 (Client certificate request): 5,663 occurrences (1.18 %)
44 (Slow down): 5,523 occurrences (1.15 %)
30 (Temporary redirect): 5,177 occurrences (1.08 %)
10 (Input request): 4,943 occurrences (1.03 %)
42 (CGI error): 4,383 occurrences (0.91 %)
53 (Proxy request refused): 4,122 occurrences (0.86 %)
31 (Permanent redirect): 2,923 occurrences (0.61 %)
50 (Permanent failure): 124 occurrences (0.03 %)
59 (Bad request): 96 occurrences (0.02 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 259

Average number of incoming links: 0.20

Capsules

There are 3127 capsules. We successfully connected recently to 2349 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

blitter.com: 10000 URLs
gemini.conman.org: 10000 URLs
midnight.pub: 9999 URLs
rwv.io: 9996 URLs
gemini.techrights.org: 9996 URLs
hoagie.space: 9993 URLs
gemlog.stargrave.org: 9990 URLs
taz.de: 9985 URLs
mirrors.apple2.org.za: 9958 URLs
caiofior.pollux.casa: 9766 URLs
gemini.knusbaum.com: 9758 URLs
mastogem.remorse.us: 9332 URLs
gemini.omarpolo.com: 9112 URLs
gemini.autonomy.earth: 8708 URLs
news.tuxmachines.org: 8487 URLs
ecs.d2evs.net: 8431 URLs
gemini.tuxmachines.org: 8080 URLs
mastogem.picasoft.net: 7886 URLs
library.inu.red: 7835 URLs
rawtext.club: 7734 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

mirrors.apple2.org.za: 2771.8 megabytes
uscoffings.net: 915.7 megabytes
si3t.ch: 914.8 megabytes
nytpu.com: 842.1 megabytes
blitter.com: 824.1 megabytes
gael.mooo.com: 666.5 megabytes
yam655.com: 581.4 megabytes
hoagie.space: 495.4 megabytes
skyjake.fi: 396.6 megabytes
jpfox.fr: 394.6 megabytes
mikelynch.org: 315.2 megabytes
ecs.d2evs.net: 286.7 megabytes
multiverse.thruhere.net: 234.7 megabytes
tweek.zyxxyz.eu: 229.4 megabytes
library.inu.red: 228.9 megabytes
gem.librehacker.com: 191.1 megabytes
shit.cx: 182.3 megabytes
gemini.techrights.org: 174.4 megabytes
phreedom.club: 174.2 megabytes
rwv.io: 168.5 megabytes
gem.girlmeow.autos: 165.5 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

2079 (88.5 %) capsules are self-signed, 206 (8.8 %) use the Certificate Authority Let's Encrypt, 64 (2.7 %) are signed by another CA (may be not a trusted one).

68 capsules (2.91 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1518 capsules
sha256WithRSAEncryption: 818 capsules
ED25519: 14 capsules
ecdsa-with-SHA512: 5 capsules
ecdsa-with-SHA384: 2 capsules
sha512WithRSAEncryption: 2 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1549 capsules
RSA: 797 capsules
ED25519: 14 capsules

Key sizes for RSA:

2048: 524 capsules
4096: 259 capsules
3072: 9 capsules
512: 3 capsules
1024: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1467 capsules
384: 80 capsules
521: 2 capsules

TLS

97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.

10.6 % of capsules do NOT send a proper close.

The full list

robots.txt

221 (9 %) the capsules have a robots.txt exclusion file.

Ports

13 working capsules (0.6 %) use an alternative port

Addresses

1185 IP addresses used. 17 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 752 vhosts
68.133.1.71: 262 vhosts
213.219.38.200: 200 vhosts
173.195.146.139: 98 vhosts
90.65.170.44: 28 vhosts
109.237.26.252: 19 vhosts
45.56.93.217: 17 vhosts
216.238.66.109: 13 vhosts
104.245.33.223: 9 vhosts
52.51.189.88: 8 vhosts
174.138.124.169: 7 vhosts
85.208.51.149: 7 vhosts
139.162.187.208: 6 vhosts
51.222.161.16: 6 vhosts
2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
178.209.50.237: 5 vhosts
89.253.220.199: 5 vhosts
64.226.23.78: 5 vhosts
37.79.202.136: 5 vhosts
46.23.94.99: 5 vhosts

TLDs

There are 244 TLDs in the capsule's names, and 1565 registered domains.

Most common TLDs

By number of registered domains

com: 254 domains
net: 136 domains
org: 131 domains
xyz: 103 domains
space: 74 domains
de: 44 domains
dev: 41 domains
site: 40 domains
me: 40 domains
eu: 27 domains
fr: 24 domains
io: 24 domains
uk: 23 domains
info: 22 domains
club: 21 domains
online: 16 domains
ca: 14 domains
ch: 14 domains
se: 12 domains
us: 11 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)