💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2023-03-01.gmi captured on 2024-07-08 at 23:46:15. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-03-01 01:04:02Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 509,801 URIs, 391,236 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 311,201 URIs serve a Gemini content.

Resources

The average size of the resources is 38,487 bytes.

Quantiles

10% of the resources are 270 bytes or less,
20% of the resources are 584 bytes or less,
30% of the resources are 878 bytes or less,
40% of the resources are 1,425 bytes or less,
50% of the resources are 2,509 bytes or less, MEDIAN
60% of the resources are 4,370 bytes or less,
70% of the resources are 6,671 bytes or less,
80% of the resources are 12,002 bytes or less,
90% of the resources are 53,383 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 238 bytes or less,
20% of the resources are 467 bytes or less,
30% of the resources are 731 bytes or less,
40% of the resources are 1,029 bytes or less,
50% of the resources are 1,646 bytes or less, MEDIAN
60% of the resources are 2,654 bytes or less,
70% of the resources are 4,462 bytes or less,
80% of the resources are 6,307 bytes or less,
90% of the resources are 10,384 bytes or less,
100% of the resources are 4,156,230 bytes or less.

Ranges

Less than 10 bytes: 3540 URLs (0.90 %)
10 to 100 bytes: 9915 URLs (2.5 %)
100 to 1000 bytes: 115800 URLs (29.6 %)
1 to 10 kbytes: 174613 URLs (44.6 %)
10 to 100 kbytes: 61605 URLs (15.7 %)
100 to 1000 kbytes: 19301 URLs (4.9 %)
More than 1000 kbytes: 6462 URLs (1.65 %)

Most common media (MIME) types

text/gemini: 311,201 URLs
image/jpeg: 21,964 URLs
image/png: 18,392 URLs
text/plain: 15,037 URLs
application/octet-stream: 4,796 URLs
application/pdf: 3,646 URLs
image/gif: 3,270 URLs
octet/stream: 2,215 URLs
text/html: 1,888 URLs
application/zip: 1,266 URLs
application/x-mscardfile: 1,198 URLs
audio/mpeg: 960 URLs
text/x-diff: 771 URLs
application/json: 589 URLs
image/webp: 352 URLs
audio/ogg: 307 URLs
application/xml: 274 URLs
text/xml: 223 URLs
application/atom+xml: 222 URLs
application/lagrange-fontpack+zip: 200 URLs

Most common languages

Unspecified: 307,225 URLs
en: 55,458 URLs
de: 11,083 URLs
it: 6,958 URLs
fr: 6,076 URLs
fi: 1,129 URLs
ja: 817 URLs
es_ar: 718 URLs
es: 575 URLs
ru: 330 URLs
en_us: 154 URLs
ko: 127 URLs
gl: 120 URLs
ca: 86 URLs
no: 59 URLs
sv: 58 URLs
eo: 26 URLs
pl,en: 26 URLs
sco,gd,it,en: 23 URLs
hu: 23 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 357,630 URLs
utf-8: 33,494 URLs
us-ascii: 60 URLs
gzip: 24 URLs
binary: 16 URLs
windows-1252: 2 URLs
bzip2: 2 URLs
cp437: 2 URLs
u: 2 URLs
utf-16: 2 URLs
iso-8859-1: 1 URLs

Most common encodings for gemtext files only

Unspecified: 287,648 URLs
utf-8: 23,546 URLs
cp437: 2 URLs
utf-16: 2 URLs
windows-1252: 2 URLs
iso-8859-1: 1 URLs

By the way, 1,187 of recently tested URLs (0.239 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 391,235 occurrences (85.10 %)
51 (Not found): 19,018 occurrences (4.14 %)
44 (Slow down): 10,167 occurrences (2.21 %)
53 (Proxy request refused): 10,026 occurrences (2.18 %)
40 (Temporary failure): 6,660 occurrences (1.45 %)
60 (Client certificate request): 5,405 occurrences (1.18 %)
30 (Temporary redirect): 4,831 occurrences (1.05 %)
10 (Input request): 4,690 occurrences (1.02 %)
42 (CGI error): 4,237 occurrences (0.92 %)
31 (Permanent redirect): 1,888 occurrences (0.41 %)
50 (Permanent failure): 1,291 occurrences (0.28 %)
59 (Bad request): 138 occurrences (0.03 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 255

Average number of incoming links: 0.19

Capsules

There are 3142 capsules. We successfully connected recently to 2327 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

gemini.techrights.org: 10000 URLs
jpfox.fr: 10000 URLs
blitter.com: 10000 URLs
gemini.conman.org: 10000 URLs
midnight.pub: 10000 URLs
taz.de: 9996 URLs
hoagie.space: 9992 URLs
jsreed5.org: 9992 URLs
gemlog.stargrave.org: 9977 URLs
caiofior.pollux.casa: 9772 URLs
gemini.knusbaum.com: 9757 URLs
library.inu.red: 9547 URLs
dw.schettler.net: 8800 URLs
gemini.autonomy.earth: 8665 URLs
ecs.d2evs.net: 8403 URLs
mastogem.picasoft.net: 8083 URLs
gemini.omarpolo.com: 7839 URLs
rawtext.club: 7694 URLs
gemini.tuxmachines.org: 7628 URLs
news.tuxmachines.org: 7574 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

si3t.ch: 1099.1 megabytes
jpfox.fr: 1069.9 megabytes
uscoffings.net: 915.7 megabytes
blitter.com: 824.2 megabytes
nytpu.com: 812.4 megabytes
gael.mooo.com: 663.4 megabytes
yam655.com: 589.9 megabytes
hoagie.space: 496.2 megabytes
skyjake.fi: 357.0 megabytes
mikelynch.org: 315.4 megabytes
ecs.d2evs.net: 285.5 megabytes
multiverse.thruhere.net: 233.5 megabytes
tweek.zyxxyz.eu: 225.2 megabytes
shit.cx: 182.3 megabytes
library.inu.red: 181.7 megabytes
phreedom.club: 175.3 megabytes
gemini.techrights.org: 174.4 megabytes
gem.girlmeow.autos: 165.5 megabytes
gemini.conman.org: 151.6 megabytes
gem.librehacker.com: 151.2 megabytes
going-flying.com: 133.4 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

2068 (88.9 %) capsules are self-signed, 193 (8.3 %) use the Certificate Authority Let's Encrypt, 66 (2.8 %) are signed by another CA (may be not a trusted one).

69 capsules (2.99 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1503 capsules
sha256WithRSAEncryption: 809 capsules
ED25519: 13 capsules
ecdsa-with-SHA512: 5 capsules
sha512WithRSAEncryption: 3 capsules
ecdsa-with-SHA384: 2 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1531 capsules
RSA: 792 capsules
ED25519: 13 capsules

Key sizes for RSA:

2048: 517 capsules
4096: 261 capsules
3072: 9 capsules
512: 3 capsules
1024: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1448 capsules
384: 81 capsules
521: 2 capsules

TLS

97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.

11.1 % of capsules do NOT send a proper close.

The full list

robots.txt

218 (9 %) the capsules have a robots.txt exclusion file.

Ports

13 working capsules (0.6 %) use an alternative port

Addresses

1206 IP addresses used. 16 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 743 vhosts
68.133.1.71: 257 vhosts
213.219.38.200: 196 vhosts
173.195.146.139: 99 vhosts
90.65.170.44: 28 vhosts
109.237.26.252: 19 vhosts
45.56.93.217: 17 vhosts
216.238.66.109: 13 vhosts
104.245.33.223: 9 vhosts
52.51.189.88: 8 vhosts
174.138.124.169: 7 vhosts
85.208.51.149: 7 vhosts
51.222.161.16: 6 vhosts
139.162.187.208: 6 vhosts
89.234.140.141: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
178.209.50.237: 5 vhosts
89.253.220.199: 5 vhosts
37.79.202.136: 5 vhosts

TLDs

There are 236 TLDs in the capsule's names, and 1582 registered domains.

Most common TLDs

By number of registered domains

com: 258 domains
net: 135 domains
org: 130 domains
xyz: 109 domains
space: 70 domains
de: 45 domains
me: 42 domains
site: 40 domains
dev: 40 domains
eu: 32 domains
io: 26 domains
fr: 26 domains
uk: 25 domains
info: 25 domains
club: 21 domains
online: 15 domains
ch: 14 domains
ca: 13 domains
se: 12 domains
us: 11 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)