💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2022-03-01.gmi captured on 2023-11-14 at 08:26:11. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2022-03-01 01:04:01Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 439,029 URIs, 337,614 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 244,142 URIs serve a Gemini content.

Resources

The average size of the resources is 29,347 bytes.

Quantiles

10% of the resources are 217 bytes or less,
20% of the resources are 374 bytes or less,
30% of the resources are 636 bytes or less,
40% of the resources are 945 bytes or less,
50% of the resources are 1,690 bytes or less, MEDIAN
60% of the resources are 2,941 bytes or less,
70% of the resources are 5,280 bytes or less,
80% of the resources are 9,981 bytes or less,
90% of the resources are 34,526 bytes or less,
100% of the resources are 7,143,369 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 183 bytes or less,
20% of the resources are 291 bytes or less,
30% of the resources are 449 bytes or less,
40% of the resources are 681 bytes or less,
50% of the resources are 927 bytes or less, MEDIAN
60% of the resources are 1,501 bytes or less,
70% of the resources are 2,580 bytes or less,
80% of the resources are 4,401 bytes or less,
90% of the resources are 7,850 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 1349 URLs (0.40 %)
10 to 100 bytes: 8908 URLs (2.6 %)
100 to 1000 bytes: 128973 URLs (38.2 %)
1 to 10 kbytes: 130967 URLs (38.8 %)
10 to 100 kbytes: 51734 URLs (15.3 %)
100 to 1000 kbytes: 11577 URLs (3.4 %)
More than 1000 kbytes: 4106 URLs (1.22 %)

Most common media (MIME) types

text/gemini: 244,142 URLs
text/plain: 48,132 URLs
image/jpeg: 17,301 URLs
image/png: 7,988 URLs
application/octet-stream: 3,298 URLs
text/x-patch: 2,656 URLs
application/pdf: 2,016 URLs
image/gif: 1,904 URLs
audio/mpeg: 1,151 URLs
text/html: 1,106 URLs
text/x-diff: 901 URLs
octet/stream: 824 URLs
application/json: 691 URLs
text/x-python: 556 URLs
application/x-mscardfile: 441 URLs
application/zip: 346 URLs
image/svg+xml: 330 URLs
text/x-csrc: 286 URLs
text/markdown: 249 URLs
image/webp: 246 URLs

Most common languages

Unspecified: 266,429 URLs
en: 40,544 URLs
de: 10,311 URLs
ru: 10,123 URLs
fr: 6,061 URLs
fi: 1,453 URLs
enus: 1,296 URLs
es: 375 URLs
it: 172 URLs
en,zh: 141 URLs
ko: 106 URLs
gl: 96 URLs
en_us: 93 URLs
pl: 90 URLs
ca: 77 URLs
es_ar: 40 URLs
sco,gd,it,en: 39 URLs
sv: 38 URLs
eo: 24 URLs
hu: 22 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 301,500 URLs
utf-8: 26,614 URLs
us-ascii: 9,468 URLs
binary: 23 URLs
gzip: 3 URLs
bzip2: 2 URLs
windows-1252: 1 URLs
cp437: 1 URLs
u: 1 URLs
utf-16: 1 URLs

Most common encodings for gemtext files only

Unspecified: 227,073 URLs
utf-8: 17,066 URLs
cp437: 1 URLs
utf-16: 1 URLs
windows-1252: 1 URLs

By the way, 3,043 of recently tested URLs (0.700 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 337,614 occurrences (87.90 %)
51 (Not found): 23,794 occurrences (6.20 %)
40 (Temporary failure): 6,197 occurrences (1.61 %)
44 (Slow down): 4,453 occurrences (1.16 %)
10 (Input request): 4,056 occurrences (1.06 %)
60 (Client certificate request): 3,012 occurrences (0.78 %)
50 (Permanent failure): 2,551 occurrences (0.66 %)
30 (Temporary redirect): 728 occurrences (0.19 %)
42 (CGI error): 601 occurrences (0.16 %)
43 (Proxy error): 404 occurrences (0.11 %)
31 (Permanent redirect): 374 occurrences (0.10 %)
53 (Proxy request refused): 264 occurrences (0.07 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 226

Average number of incoming links: 0.15

Capsules

There are 2151 capsules. We successfully connected recently to 1759 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

gemini.techrights.org: 10000 URLs
ake.crabdance.com:1966: 9999 URLs
gemini.conman.org: 9997 URLs
git.skyjake.fi: 9997 URLs
jpfox.fr: 9987 URLs
gemini.spam.works: 9977 URLs
dw.schettler.net: 9974 URLs
taz.de: 9973 URLs
gem.benscraft.info: 9965 URLs
gemini.theuse.net: 9954 URLs
midnight.pub: 9547 URLs
vps01.rdelaage.ovh: 9247 URLs
mastogem.picasoft.net: 9001 URLs
gemini.omarpolo.com: 8897 URLs
thegonz.net:3965: 8134 URLs
tilde.team: 7944 URLs
gemini.susa.net: 7807 URLs
mysidard.com: 7562 URLs
gemini.autonomy.earth: 7284 URLs
ecs.d2evs.net: 7145 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

jpfox.fr: 967.6 megabytes
yam655.com: 598.3 megabytes
nytpu.com: 363.8 megabytes
gem.billsmugs.com: 351.6 megabytes
blitter.com: 336.4 megabytes
snowcode.ovh: 301.8 megabytes
ecs.d2evs.net: 292.6 megabytes
kamalatta.ddnss.de: 270.0 megabytes
multiverse.thruhere.net: 233.6 megabytes
gemini.spam.works: 226.8 megabytes
mikelynch.org: 202.6 megabytes
gemini.theuse.net: 186.7 megabytes
shit.cx: 181.1 megabytes
gemini.techrights.org: 174.4 megabytes
tweek.zyxxyz.eu: 170.6 megabytes
tilde.team: 161.2 megabytes
si3t.ch: 152.2 megabytes
gemini.conman.org: 151.4 megabytes
pgorl32jhgkgald7tcsp6k7zpujvd763kywenr72yr76fqjaomxf7kid.onion: 107.2 megabytes
clemat.is: 107.2 megabytes
kota.nz: 106.1 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

1493 (84.9 %) capsules are self-signed, 221 (12.6 %) use the Certificate Authority Let's Encrypt, 45 (2.6 %) are signed by another CA (may be not a trusted one).

54 capsules (3.12 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1151 capsules
sha256WithRSAEncryption: 592 capsules
ED25519: 11 capsules
ecdsa-with-SHA512: 3 capsules
ecdsa-with-SHA384: 2 capsules
sha512WithRSAEncryption: 2 capsules
ecdsa-with-SHA1: 1 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1178 capsules
RSA: 574 capsules
ED25519: 11 capsules

Key sizes for RSA:

4096: 287 capsules
2048: 278 capsules
3072: 6 capsules
1024: 2 capsules
4098: 1 capsules

Key sizes for ECDSA:

256: 1089 capsules
384: 87 capsules
521: 2 capsules

TLS

91 % of the capsules use TLS 1.3, 9 % use TLS 1.2.

robots.txt

188 (11 %) the capsules have a robots.txt exclusion file.

Ports

11 working capsules (0.6 %) use an alternative port

Addresses

1111 IP addresses used. 16 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 539 vhosts
213.219.38.200: 118 vhosts
173.195.146.139: 77 vhosts
68.133.4.32: 67 vhosts
86.207.45.97: 25 vhosts
109.237.26.252: 17 vhosts
45.56.93.217: 15 vhosts
216.238.66.109: 8 vhosts
52.51.189.88: 8 vhosts
144.91.116.244: 7 vhosts
188.68.55.245: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
89.234.140.141: 6 vhosts
174.138.124.169: 6 vhosts
85.156.142.127: 5 vhosts
178.209.50.237: 5 vhosts
149.28.115.162: 5 vhosts
37.79.202.136: 5 vhosts
104.207.153.51: 5 vhosts
46.23.89.93: 4 vhosts

TLDs

There are 202 TLDs in the capsule's names, and 1206 registered domains.

Most common TLDs

By number of registered domains

com: 182 domains
net: 100 domains
org: 98 domains
xyz: 90 domains
space: 59 domains
de: 40 domains
dev: 30 domains
site: 30 domains
eu: 29 domains
me: 29 domains
info: 21 domains
uk: 20 domains
fr: 19 domains
io: 18 domains
club: 18 domains
ca: 14 domains
online: 11 domains
onion: 10 domains
ch: 10 domains
us: 9 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)

online: 544 capsules
com: 212 capsules
org: 191 capsules
pub: 121 capsules
net: 118 capsules
xyz: 95 capsules
space: 73 capsules
de: 47 capsules
eu: 37 capsules
club: 36 capsules
site: 32 capsules
dev: 32 capsules
me: 30 capsules
info: 25 capsules
uk: 23 capsules
casa: 23 capsules
io: 21 capsules
fr: 20 capsules
ca: 17 capsules
us: 17 capsules

Other statistics on the geminispace

At the search engine geminispace.info

By Nervuri (specially for certificates)

Contact

Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.

Home page of the crawler

Source code of the crawler

My capsule