💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2023-06-01.gmi captured on 2024-08-18 at 17:13:37. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-05-31 00:04:02Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 516,960 URIs, 404,243 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 309,520 URIs serve a Gemini content.

Resources

The average size of the resources is 44,095 bytes.

Quantiles

10% of the resources are 279 bytes or less,
20% of the resources are 646 bytes or less,
30% of the resources are 974 bytes or less,
40% of the resources are 1,636 bytes or less,
50% of the resources are 2,736 bytes or less, MEDIAN
60% of the resources are 4,955 bytes or less,
70% of the resources are 7,275 bytes or less,
80% of the resources are 16,476 bytes or less,
90% of the resources are 82,896 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 236 bytes or less,
20% of the resources are 496 bytes or less,
30% of the resources are 773 bytes or less,
40% of the resources are 1,094 bytes or less,
50% of the resources are 1,730 bytes or less, MEDIAN
60% of the resources are 2,690 bytes or less,
70% of the resources are 4,567 bytes or less,
80% of the resources are 6,576 bytes or less,
90% of the resources are 11,779 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 3214 URLs (0.80 %)
10 to 100 bytes: 9456 URLs (2.3 %)
100 to 1000 bytes: 110843 URLs (27.4 %)
1 to 10 kbytes: 177554 URLs (43.9 %)
10 to 100 kbytes: 70165 URLs (17.4 %)
100 to 1000 kbytes: 25484 URLs (6.3 %)
More than 1000 kbytes: 7526 URLs (1.86 %)

Most common media (MIME) types

text/gemini: 309,519 URLs
text/plain: 23,796 URLs
image/jpeg: 20,155 URLs
image/png: 18,714 URLs
application/octet-stream: 9,143 URLs
application/pdf: 4,535 URLs
application/zip: 3,100 URLs
octet/stream: 2,211 URLs
image/gif: 2,166 URLs
text/html: 1,890 URLs
audio/mpeg: 1,240 URLs
application/x-mscardfile: 1,198 URLs
MIME: 998 URLs
text/x-diff: 785 URLs
application/json: 600 URLs
audio/ogg: 386 URLs
image/webp: 321 URLs
text/xml: 267 URLs
application/atom+xml: 247 URLs
application/lagrange-fontpack+zip: 200 URLs

Most common languages

Unspecified: 315,129 URLs
en: 61,607 URLs
de: 11,085 URLs
it: 7,119 URLs
fr: 3,748 URLs
ja: 1,112 URLs
fi: 1,106 URLs
es_ar: 908 URLs
ru: 853 URLs
es: 335 URLs
en_gb: 252 URLs
en_us: 216 URLs
gl: 124 URLs
pl: 104 URLs
ko: 97 URLs
ca: 84 URLs
sv: 63 URLs
sco,gd,it,en: 38 URLs
pl,en: 29 URLs
eo: 28 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 362,520 URLs
utf-8: 33,273 URLs
us-ascii: 8,389 URLs
binary: 26 URLs
gzip: 23 URLs
windows-1252: 2 URLs
bzip2: 2 URLs
cp437: 2 URLs
u: 2 URLs
utf-16: 2 URLs
iso-8859-1: 1 URLs

Most common encodings for gemtext files only

Unspecified: 284,523 URLs
utf-8: 24,989 URLs
cp437: 2 URLs
utf-16: 2 URLs
windows-1252: 2 URLs
iso-8859-1: 1 URLs

By the way, 2,230 of recently tested URLs (0.454 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 404,242 occurrences (85.71 %)
51 (Not found): 19,859 occurrences (4.21 %)
40 (Temporary failure): 12,451 occurrences (2.64 %)
50 (Permanent failure): 6,099 occurrences (1.29 %)
60 (Client certificate request): 5,672 occurrences (1.20 %)
30 (Temporary redirect): 5,263 occurrences (1.12 %)
44 (Slow down): 5,041 occurrences (1.07 %)
42 (CGI error): 4,379 occurrences (0.93 %)
10 (Input request): 3,990 occurrences (0.85 %)
53 (Proxy request refused): 2,990 occurrences (0.63 %)
31 (Permanent redirect): 1,364 occurrences (0.29 %)
59 (Bad request): 145 occurrences (0.03 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 271

Average number of incoming links: 0.23

Capsules

There are 3249 capsules. We successfully connected recently to 2415 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

gemini.techrights.org: 10000 URLs
gemini.conman.org: 10000 URLs
midnight.pub: 10000 URLs
rwv.io: 9996 URLs
blitter.com: 9996 URLs
jsreed5.org: 9995 URLs
hoagie.space: 9994 URLs
news.tuxmachines.org: 9992 URLs
gemini.tuxmachines.org: 9990 URLs
gemlog.stargrave.org: 9989 URLs
caiofior.pollux.casa: 9988 URLs
taz.de: 9986 URLs
mirrors.apple2.org.za: 9980 URLs
gemini.knusbaum.com: 9751 URLs
library.inu.red: 9441 URLs
gemini.omarpolo.com: 9048 URLs
gemini.autonomy.earth: 8953 URLs
spam.works: 8891 URLs
ecs.d2evs.net: 8507 URLs
rawtext.club: 7908 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

mirrors.apple2.org.za: 2791.5 megabytes
nytpu.com: 931.8 megabytes
uscoffings.net: 915.7 megabytes
blitter.com: 824.1 megabytes
gael.mooo.com: 747.9 megabytes
yam655.com: 596.2 megabytes
skyjake.fi: 502.0 megabytes
hoagie.space: 495.8 megabytes
gem.librehacker.com: 407.4 megabytes
gemini.zachdecook.com: 322.8 megabytes
mikelynch.org: 315.7 megabytes
ecs.d2evs.net: 289.2 megabytes
jpfox.fr: 281.4 megabytes
library.inu.red: 273.3 megabytes
tweek.zyxxyz.eu: 238.8 megabytes
multiverse.thruhere.net: 234.7 megabytes
shit.cx: 182.3 megabytes
phreedom.club: 176.0 megabytes
gemini.techrights.org: 174.4 megabytes
rwv.io: 168.5 megabytes
gem.girlmeow.autos: 165.5 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

2147 (88.9 %) capsules are self-signed, 211 (8.7 %) use the Certificate Authority Let's Encrypt, 57 (2.4 %) are signed by another CA (may be not a trusted one).

62 capsules (2.58 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1560 capsules
sha256WithRSAEncryption: 833 capsules
ED25519: 13 capsules
ecdsa-with-SHA512: 4 capsules
ecdsa-with-SHA384: 2 capsules
sha512WithRSAEncryption: 2 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1588 capsules
RSA: 814 capsules
ED25519: 13 capsules

Key sizes for RSA:

2048: 554 capsules
4096: 248 capsules
3072: 9 capsules
1024: 2 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1514 capsules
384: 73 capsules
521: 1 capsules

TLS

98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.

4.9 % of capsules do NOT send a proper close.

The full list

robots.txt

236 (10 %) the capsules have a robots.txt exclusion file.

Ports

11 working capsules (0.5 %) use an alternative port

Addresses

1152 IP addresses used. 17 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 786 vhosts
68.133.1.71: 287 vhosts
213.219.38.200: 204 vhosts
173.195.146.139: 100 vhosts
90.65.170.44: 28 vhosts
109.237.26.252: 20 vhosts
45.56.93.217: 17 vhosts
216.238.66.109: 13 vhosts
52.51.189.88: 8 vhosts
104.245.33.223: 8 vhosts
174.138.124.169: 7 vhosts
85.208.51.149: 7 vhosts
89.234.140.141: 6 vhosts
51.222.161.16: 6 vhosts
139.162.187.208: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
89.253.220.199: 5 vhosts
178.209.50.237: 5 vhosts
37.79.202.136: 5 vhosts

TLDs

There are 264 TLDs in the capsule's names, and 1629 registered domains.

Most common TLDs

By number of registered domains

com: 249 domains
net: 142 domains
org: 139 domains
xyz: 108 domains
space: 74 domains
de: 49 domains
site: 44 domains
dev: 42 domains
me: 42 domains
eu: 31 domains
fr: 29 domains
uk: 28 domains
info: 23 domains
io: 21 domains
club: 20 domains
online: 17 domains
ca: 14 domains
ch: 14 domains
se: 13 domains
us: 12 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)