💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2023-01-29 at 02:51:48. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-01-29 01:04:01Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 494,965 URIs, 376,395 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 292,042 URIs serve a Gemini content.

Resources

The average size of the resources is 40,217 bytes.

Quantiles

10% of the resources are 258 bytes or less,
20% of the resources are 603 bytes or less,
30% of the resources are 889 bytes or less,
40% of the resources are 1,479 bytes or less,
50% of the resources are 2,585 bytes or less, MEDIAN
60% of the resources are 4,454 bytes or less,
70% of the resources are 6,689 bytes or less,
80% of the resources are 13,465 bytes or less,
90% of the resources are 57,331 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 210 bytes or less,
20% of the resources are 468 bytes or less,
30% of the resources are 731 bytes or less,
40% of the resources are 1,013 bytes or less,
50% of the resources are 1,637 bytes or less, MEDIAN
60% of the resources are 2,644 bytes or less,
70% of the resources are 4,350 bytes or less,
80% of the resources are 6,030 bytes or less,
90% of the resources are 10,629 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Ranges

Less than 10 bytes: 1243 URLs (0.33 %)
10 to 100 bytes: 10128 URLs (2.7 %)
100 to 1000 bytes: 111672 URLs (29.7 %)
1 to 10 kbytes: 165000 URLs (43.8 %)
10 to 100 kbytes: 62869 URLs (16.7 %)
100 to 1000 kbytes: 18868 URLs (5.0 %)
More than 1000 kbytes: 6615 URLs (1.76 %)

Most common media (MIME) types

text/gemini: 292,042 URLs
text/plain: 24,467 URLs
image/jpeg: 19,847 URLs
image/png: 15,374 URLs
application/octet-stream: 4,791 URLs
application/pdf: 3,641 URLs
image/gif: 3,247 URLs
octet/stream: 2,217 URLs
text/html: 1,889 URLs
application/zip: 1,261 URLs
audio/mpeg: 1,222 URLs
application/x-mscardfile: 1,198 URLs
text/x-diff: 773 URLs
application/json: 595 URLs
image/webp: 316 URLs
audio/ogg: 260 URLs
application/xml: 216 URLs
application/atom+xml: 215 URLs
application/lagrange-fontpack+zip: 200 URLs
audio/midi: 184 URLs

Most common languages

Unspecified: 298,487 URLs
en: 56,318 URLs
de: 11,083 URLs
fr: 6,016 URLs
fi: 1,125 URLs
ja: 894 URLs
es_ar: 630 URLs
es: 461 URLs
ru: 292 URLs
en_us: 196 URLs
it: 134 URLs
ko: 127 URLs
pl: 102 URLs
ca: 86 URLs
sv: 58 URLs
no: 56 URLs
gl: 54 URLs
sco,gd,it,en: 38 URLs
eo: 28 URLs
pl,en: 26 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 336,339 URLs
utf-8: 30,513 URLs
us-ascii: 9,484 URLs
binary: 24 URLs
gzip: 24 URLs
windows-1252: 2 URLs
bzip2: 2 URLs
cp437: 2 URLs
u: 2 URLs
utf-16: 2 URLs
iso-8859-1: 1 URLs

Most common encodings for gemtext files only

Unspecified: 269,690 URLs
utf-8: 22,345 URLs
cp437: 2 URLs
utf-16: 2 URLs
windows-1252: 2 URLs
iso-8859-1: 1 URLs

By the way, 1,256 of recently tested URLs (0.262 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 376,395 occurrences (84.18 %)
51 (Not found): 31,360 occurrences (7.01 %)
50 (Permanent failure): 9,142 occurrences (2.04 %)
40 (Temporary failure): 6,319 occurrences (1.41 %)
60 (Client certificate request): 5,514 occurrences (1.23 %)
30 (Temporary redirect): 4,762 occurrences (1.07 %)
44 (Slow down): 4,689 occurrences (1.05 %)
42 (CGI error): 3,923 occurrences (0.88 %)
10 (Input request): 3,103 occurrences (0.69 %)
31 (Permanent redirect): 1,436 occurrences (0.32 %)
59 (Bad request): 321 occurrences (0.07 %)
43 (Proxy error): 54 occurrences (0.01 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 249

Average number of incoming links: 0.20

Capsules

There are 3022 capsules. We successfully connected recently to 2291 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

blitter.com: 10000 URLs
gemini.conman.org: 10000 URLs
midnight.pub: 9999 URLs
jpfox.fr: 9998 URLs
taz.de: 9998 URLs
gemini.techrights.org: 9994 URLs
hoagie.space: 9992 URLs
jsreed5.org: 9991 URLs
gemini.spam.works: 9986 URLs
library.inu.red: 9560 URLs
gemini.knusbaum.com: 9266 URLs
gemini.omarpolo.com: 9111 URLs
gemini.autonomy.earth: 8559 URLs
mastogem.picasoft.net: 8398 URLs
ecs.d2evs.net: 8368 URLs
rawtext.club: 7594 URLs
news.tuxmachines.org: 6869 URLs
gemlog.stargrave.org: 6594 URLs
gemini.tuxmachines.org: 6577 URLs
caolan.uk: 6066 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

jpfox.fr: 1069.9 megabytes
si3t.ch: 1068.5 megabytes
uscoffings.net: 911.4 megabytes
blitter.com: 824.2 megabytes
nytpu.com: 770.0 megabytes
gael.mooo.com: 636.0 megabytes
yam655.com: 592.7 megabytes
hoagie.space: 512.0 megabytes
skyjake.fi: 320.5 megabytes
mikelynch.org: 315.1 megabytes
snowcode.ovh: 286.0 megabytes
ecs.d2evs.net: 284.6 megabytes
multiverse.thruhere.net: 232.6 megabytes
tweek.zyxxyz.eu: 219.9 megabytes
gemini.spam.works: 197.3 megabytes
library.inu.red: 182.9 megabytes
shit.cx: 182.3 megabytes
gemini.techrights.org: 174.3 megabytes
phreedom.club: 167.9 megabytes
gem.girlmeow.autos: 164.4 megabytes
gemini.conman.org: 151.4 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

2022 (88.3 %) capsules are self-signed, 201 (8.8 %) use the Certificate Authority Let's Encrypt, 68 (3.0 %) are signed by another CA (may be not a trusted one).

63 capsules (2.77 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1487 capsules
sha256WithRSAEncryption: 785 capsules
ED25519: 14 capsules
ecdsa-with-SHA512: 5 capsules
sha512WithRSAEncryption: 3 capsules
ecdsa-with-SHA384: 2 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1514 capsules
RSA: 769 capsules
ED25519: 14 capsules

Key sizes for RSA:

2048: 494 capsules
4096: 261 capsules
3072: 9 capsules
512: 3 capsules
1024: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1434 capsules
384: 78 capsules
521: 2 capsules

TLS

97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.

11.2 % of capsules do NOT send a proper close.

The full list

robots.txt

231 (10 %) the capsules have a robots.txt exclusion file.

Ports

13 working capsules (0.6 %) use an alternative port

Addresses

1176 IP addresses used. 16 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 733 vhosts
68.133.1.71: 238 vhosts
213.219.38.200: 194 vhosts
173.195.146.139: 102 vhosts
90.65.170.44: 26 vhosts
109.237.26.252: 19 vhosts
45.56.93.217: 17 vhosts
216.238.66.109: 14 vhosts
52.51.189.88: 8 vhosts
104.245.33.223: 8 vhosts
174.138.124.169: 7 vhosts
85.208.51.149: 7 vhosts
64.226.23.78: 6 vhosts
89.234.140.141: 6 vhosts
139.162.187.208: 6 vhosts
51.222.161.16: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
178.209.50.237: 5 vhosts
37.79.202.136: 5 vhosts

TLDs

There are 241 TLDs in the capsule's names, and 1572 registered domains.

Most common TLDs

By number of registered domains

com: 253 domains
net: 138 domains
org: 129 domains
xyz: 111 domains
space: 71 domains
de: 45 domains
me: 45 domains
dev: 40 domains
site: 39 domains
eu: 30 domains
uk: 26 domains
io: 26 domains
info: 25 domains
fr: 24 domains
club: 21 domains
online: 15 domains
ch: 14 domains
ca: 14 domains
se: 12 domains
one: 11 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)