💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2023-07-01.gmi captured on 2023-09-28 at 23:31:27. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-07-01 03:04:01Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 543,963 URIs, 427,575 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 327,836 URIs serve a Gemini content.

Resources

The average size of the resources is 44,000 bytes.

Quantiles

10% of the resources are 299 bytes or less,
20% of the resources are 661 bytes or less,
30% of the resources are 997 bytes or less,
40% of the resources are 1,709 bytes or less,
50% of the resources are 2,861 bytes or less, MEDIAN
60% of the resources are 5,091 bytes or less,
70% of the resources are 7,644 bytes or less,
80% of the resources are 16,975 bytes or less,
90% of the resources are 81,517 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 245 bytes or less,
20% of the resources are 530 bytes or less,
30% of the resources are 786 bytes or less,
40% of the resources are 1,123 bytes or less,
50% of the resources are 1,816 bytes or less, MEDIAN
60% of the resources are 2,812 bytes or less,
70% of the resources are 4,660 bytes or less,
80% of the resources are 6,616 bytes or less,
90% of the resources are 12,751 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Ranges

Less than 10 bytes: 3172 URLs (0.74 %)
10 to 100 bytes: 9650 URLs (2.3 %)
100 to 1000 bytes: 115720 URLs (27.1 %)
1 to 10 kbytes: 186581 URLs (43.6 %)
10 to 100 kbytes: 77960 URLs (18.2 %)
100 to 1000 kbytes: 26582 URLs (6.2 %)
More than 1000 kbytes: 7910 URLs (1.85 %)

Most common media (MIME) types

text/gemini: 327,836 URLs
text/plain: 24,745 URLs
image/jpeg: 23,581 URLs
image/png: 19,280 URLs
application/octet-stream: 9,169 URLs
application/pdf: 4,497 URLs
application/zip: 3,082 URLs
octet/stream: 2,214 URLs
image/gif: 1,976 URLs
text/html: 1,889 URLs
audio/mpeg: 1,249 URLs
application/x-mscardfile: 1,199 URLs
MIME: 1,038 URLs
text/x-diff: 870 URLs
application/json: 598 URLs
image/webp: 401 URLs
audio/ogg: 393 URLs
application/xml: 300 URLs
text/xml: 260 URLs
application/atom+xml: 254 URLs

Most common languages

Unspecified: 333,969 URLs
en: 62,722 URLs
de: 11,081 URLs
it: 7,125 URLs
fr: 6,911 URLs
es: 1,333 URLs
es_ar: 1,123 URLs
ja: 1,111 URLs
ru: 882 URLs
en_gb: 296 URLs
en_us: 216 URLs
gl: 124 URLs
pl: 104 URLs
ko: 97 URLs
ca: 86 URLs
sv: 63 URLs
en,he: 39 URLs
sco,gd,it,en: 38 URLs
pl,en: 29 URLs
eo: 28 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 386,134 URLs
utf-8: 32,950 URLs
us-ascii: 8,439 URLs
gzip: 24 URLs
binary: 20 URLs
utf8: 2 URLs
bzip2: 2 URLs
windows-1252: 1 URLs
cp437: 1 URLs
iso-8859-1: 1 URLs
utf-16: 1 URLs

Most common encodings for gemtext files only

Unspecified: 303,466 URLs
utf-8: 24,366 URLs
cp437: 1 URLs
iso-8859-1: 1 URLs
utf-16: 1 URLs
windows-1252: 1 URLs

By the way, 1,286 of recently tested URLs (0.248 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 427,575 occurrences (87.61 %)
51 (Not found): 13,857 occurrences (2.84 %)
40 (Temporary failure): 12,446 occurrences (2.55 %)
30 (Temporary redirect): 6,364 occurrences (1.30 %)
60 (Client certificate request): 5,637 occurrences (1.16 %)
42 (CGI error): 5,295 occurrences (1.08 %)
50 (Permanent failure): 5,193 occurrences (1.06 %)
44 (Slow down): 3,798 occurrences (0.78 %)
53 (Proxy request refused): 2,997 occurrences (0.61 %)
10 (Input request): 2,593 occurrences (0.53 %)
31 (Permanent redirect): 1,824 occurrences (0.37 %)
59 (Bad request): 339 occurrences (0.07 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 275

Average number of incoming links: 0.20

Capsules

There are 3417 capsules. We successfully connected recently to 2493 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

gemini.conman.org: 10000 URLs
gemlog.stargrave.org: 10000 URLs
gemini.techrights.org: 10000 URLs
midnight.pub: 10000 URLs
blitter.com: 9999 URLs
rwv.io: 9996 URLs
gemini.tuxmachines.org: 9996 URLs
jsreed5.org: 9996 URLs
news.tuxmachines.org: 9995 URLs
mirrors.apple2.org.za: 9994 URLs
hoagie.space: 9993 URLs
caiofior.pollux.casa: 9978 URLs
taz.de: 9970 URLs
gemini.knusbaum.com: 9742 URLs
mastogem.remorse.us: 9477 URLs
jpfox.fr: 9220 URLs
gemini.autonomy.earth: 9099 URLs
gemini.omarpolo.com: 9052 URLs
spam.works: 8931 URLs
ecs.d2evs.net: 8559 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

mirrors.apple2.org.za: 2799.1 megabytes
nytpu.com: 973.2 megabytes
uscoffings.net: 914.7 megabytes
blitter.com: 824.2 megabytes
gael.mooo.com: 752.1 megabytes
yam655.com: 598.3 megabytes
jpfox.fr: 580.1 megabytes
gem.librehacker.com: 518.5 megabytes
skyjake.fi: 502.2 megabytes
hoagie.space: 498.2 megabytes
finn.lesueur.nz: 357.0 megabytes
mikelynch.org: 336.5 megabytes
gemini.zachdecook.com: 334.0 megabytes
ecs.d2evs.net: 288.8 megabytes
tweek.zyxxyz.eu: 243.0 megabytes
shit.cx: 182.3 megabytes
phreedom.club: 177.1 megabytes
higeki.jp: 177.0 megabytes
gemini.techrights.org: 174.4 megabytes
rwv.io: 168.4 megabytes
gem.girlmeow.autos: 164.8 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

2216 (88.9 %) capsules are self-signed, 219 (8.8 %) use the Certificate Authority Let's Encrypt, 58 (2.3 %) are signed by another CA (may be not a trusted one).

62 capsules (2.50 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1594 capsules
sha256WithRSAEncryption: 878 capsules
ED25519: 17 capsules
ecdsa-with-SHA512: 4 capsules
ecdsa-with-SHA384: 2 capsules
sha512WithRSAEncryption: 2 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1627 capsules
RSA: 854 capsules
ED25519: 17 capsules

Key sizes for RSA:

2048: 583 capsules
4096: 257 capsules
3072: 11 capsules
1024: 2 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1550 capsules
384: 75 capsules
521: 2 capsules

TLS

98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.

robots.txt

232 (9 %) the capsules have a robots.txt exclusion file.

Ports

13 working capsules (0.5 %) use an alternative port

Addresses

1213 IP addresses used. 17 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 794 vhosts
68.133.1.71: 308 vhosts
213.219.38.200: 211 vhosts
173.195.146.139: 98 vhosts
90.65.170.44: 29 vhosts
109.237.26.252: 22 vhosts
45.56.93.217: 17 vhosts
216.238.66.109: 14 vhosts
104.245.33.223: 8 vhosts
52.51.189.88: 8 vhosts
174.138.124.169: 7 vhosts
85.208.51.149: 7 vhosts
89.234.140.141: 6 vhosts
139.162.187.208: 6 vhosts
51.222.161.16: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
89.253.220.199: 5 vhosts
178.209.50.237: 5 vhosts
37.79.202.136: 5 vhosts

TLDs

There are 270 TLDs in the capsule's names, and 1702 registered domains.

Most common TLDs

By number of registered domains

com: 273 domains
net: 145 domains
org: 135 domains
xyz: 112 domains
space: 77 domains
de: 51 domains
site: 45 domains
me: 44 domains
dev: 43 domains
eu: 32 domains
uk: 31 domains
fr: 30 domains
io: 25 domains
info: 24 domains
club: 20 domains
online: 16 domains
ch: 14 domains
ca: 14 domains
se: 13 domains
ru: 12 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)