💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2022-02-01.gmi captured on 2023-01-29 at 07:57:37. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2022-02-01 01:04:02Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 438,622 URIs, 340,569 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 242,103 URIs serve a Gemini content.

Resources

The average size of the resources is 30,552 bytes.

Quantiles

10% of the resources are 210 bytes or less,
20% of the resources are 384 bytes or less,
30% of the resources are 679 bytes or less,
40% of the resources are 1,047 bytes or less,
50% of the resources are 1,936 bytes or less, MEDIAN
60% of the resources are 3,197 bytes or less,
70% of the resources are 5,502 bytes or less,
80% of the resources are 10,384 bytes or less,
90% of the resources are 37,250 bytes or less,
100% of the resources are 7,143,369 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 163 bytes or less,
20% of the resources are 304 bytes or less,
30% of the resources are 472 bytes or less,
40% of the resources are 710 bytes or less,
50% of the resources are 995 bytes or less, MEDIAN
60% of the resources are 1,702 bytes or less,
70% of the resources are 2,696 bytes or less,
80% of the resources are 4,572 bytes or less,
90% of the resources are 7,919 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 1358 URLs (0.40 %)
10 to 100 bytes: 9092 URLs (2.7 %)
100 to 1000 bytes: 123040 URLs (36.1 %)
1 to 10 kbytes: 137454 URLs (40.4 %)
10 to 100 kbytes: 53047 URLs (15.6 %)
100 to 1000 kbytes: 12337 URLs (3.6 %)
More than 1000 kbytes: 4241 URLs (1.25 %)

Most common media (MIME) types

text/gemini: 242,103 URLs
text/plain: 48,478 URLs
image/jpeg: 17,078 URLs
image/png: 8,094 URLs
application/octet-stream: 3,747 URLs
application/pdf: 3,194 URLs
text/x-patch: 2,390 URLs
octet/stream: 2,202 URLs
image/gif: 2,051 URLs
text/html: 1,878 URLs
application/x-mscardfile: 1,198 URLs
audio/mpeg: 1,147 URLs
text/x-python: 941 URLs
text/x-diff: 843 URLs
application/zip: 573 URLs
image/svg+xml: 378 URLs
text/markdown: 345 URLs
text/x-csrc: 318 URLs
image/webp: 292 URLs
application/x-gzip: 199 URLs

Most common languages

Unspecified: 270,933 URLs
en: 42,103 URLs
de: 10,249 URLs
ru: 9,310 URLs
fr: 5,864 URLs
ga: 881 URLs
es: 270 URLs
it: 145 URLs
en,zh: 139 URLs
ko: 110 URLs
gl: 94 URLs
pl: 88 URLs
ca: 77 URLs
es_ar: 40 URLs
sco,gd,it,en: 39 URLs
sv: 38 URLs
enus: 24 URLs
fi: 24 URLs
hu: 22 URLs
pl,en: 19 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 304,949 URLs
utf-8: 26,136 URLs
us-ascii: 9,455 URLs
binary: 20 URLs
gzip: 3 URLs
bzip2: 2 URLs
windows-1252: 1 URLs
cp437: 1 URLs
u: 1 URLs
utf-16: 1 URLs

Most common encodings for gemtext files only

Unspecified: 226,337 URLs
utf-8: 15,763 URLs
cp437: 1 URLs
utf-16: 1 URLs
windows-1252: 1 URLs

By the way, 3,266 of recently tested URLs (0.750 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 340,569 occurrences (88.87 %)
51 (Not found): 19,958 occurrences (5.21 %)
40 (Temporary failure): 5,792 occurrences (1.51 %)
44 (Slow down): 4,718 occurrences (1.23 %)
10 (Input request): 3,571 occurrences (0.93 %)
50 (Permanent failure): 2,470 occurrences (0.64 %)
60 (Client certificate request): 2,270 occurrences (0.59 %)
42 (CGI error): 2,185 occurrences (0.57 %)
30 (Temporary redirect): 787 occurrences (0.21 %)
31 (Permanent redirect): 429 occurrences (0.11 %)
43 (Proxy error): 405 occurrences (0.11 %)
53 (Proxy request refused): 51 occurrences (0.01 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 217

Average number of incoming links: 0.12

Capsules

There are 1990 capsules. We successfully connected recently to 1659 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

gemini.techrights.org: 10000 URLs
blitter.com: 10000 URLs
gemini.conman.org: 9997 URLs
git.skyjake.fi: 9987 URLs
dw.schettler.net: 9982 URLs
gemini.susa.net: 9980 URLs
gemini.spam.works: 9976 URLs
taz.de: 9974 URLs
gem.benscraft.info: 9964 URLs
gemini.theuse.net: 9960 URLs
git.sysrq.in: 9918 URLs
jpfox.fr: 9841 URLs
geminispace.info: 9568 URLs
midnight.pub: 9466 URLs
vps01.rdelaage.ovh: 9229 URLs
ake.crabdance.com:1966: 9214 URLs
mastogem.picasoft.net: 9093 URLs
gemini.omarpolo.com: 9037 URLs
tilde.team: 7794 URLs
ecs.d2evs.net: 7112 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

jpfox.fr: 966.2 megabytes
blitter.com: 824.1 megabytes
yam655.com: 593.4 megabytes
gem.billsmugs.com: 351.6 megabytes
nytpu.com: 326.8 megabytes
snowcode.ovh: 301.4 megabytes
ecs.d2evs.net: 290.1 megabytes
kamalatta.ddnss.de: 270.8 megabytes
multiverse.thruhere.net: 233.6 megabytes
gemini.spam.works: 226.8 megabytes
mikelynch.org: 202.6 megabytes
gemini.theuse.net: 194.0 megabytes
shit.cx: 181.0 megabytes
gemini.techrights.org: 174.4 megabytes
si3t.ch: 168.4 megabytes
tweek.zyxxyz.eu: 164.3 megabytes
tilde.team: 159.8 megabytes
gemini.conman.org: 151.3 megabytes
oppen.digital: 119.0 megabytes
gemini.circumlunar.space: 113.0 megabytes
clemat.is: 110.4 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

1419 (85.5 %) capsules are self-signed, 196 (11.8 %) use the Certificate Authority Let's Encrypt, 44 (2.7 %) are signed by another CA (may be not a trusted one).

60 capsules (3.68 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1078 capsules
sha256WithRSAEncryption: 553 capsules
ED25519: 9 capsules
sha512WithRSAEncryption: 3 capsules
ecdsa-with-SHA384: 2 capsules
ecdsa-with-SHA512: 2 capsules
ecdsa-with-SHA1: 1 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1104 capsules
RSA: 536 capsules
ED25519: 9 capsules

Key sizes for RSA:

4096: 283 capsules
2048: 244 capsules
3072: 5 capsules
1024: 2 capsules
4098: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1018 capsules
384: 84 capsules
521: 2 capsules

TLS

89 % of the capsules use TLS 1.3, 11 % use TLS 1.2.

robots.txt

168 (10 %) the capsules have a robots.txt exclusion file.

Ports

10 working capsules (0.6 %) use an alternative port

Addresses

1060 IP addresses used. 15 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 514 vhosts
213.219.38.200: 105 vhosts
173.195.146.139: 74 vhosts
68.133.4.32: 41 vhosts
90.39.173.134: 23 vhosts
86.207.45.97: 22 vhosts
109.237.26.252: 16 vhosts
45.56.93.217: 15 vhosts
52.51.189.88: 8 vhosts
144.91.116.244: 7 vhosts
188.68.55.245: 6 vhosts
89.234.140.141: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
174.138.124.169: 6 vhosts
2a00:5881:4008:d00::42: 6 vhosts
85.156.142.127: 5 vhosts
178.209.50.237: 5 vhosts
216.238.66.109: 5 vhosts
37.79.202.136: 5 vhosts
104.207.153.51: 5 vhosts

TLDs

There are 200 TLDs in the capsule's names, and 1118 registered domains.

Most common TLDs

By number of registered domains

com: 164 domains
net: 99 domains
org: 89 domains
xyz: 83 domains
space: 54 domains
de: 37 domains
site: 29 domains
eu: 26 domains
me: 26 domains
dev: 25 domains
info: 20 domains
club: 18 domains
io: 18 domains
uk: 18 domains
fr: 17 domains
ca: 12 domains
us: 10 domains
ch: 9 domains
online: 8 domains
se: 8 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)

online: 516 capsules
com: 193 capsules
org: 153 capsules
net: 116 capsules
pub: 110 capsules
xyz: 88 capsules
space: 68 capsules
de: 44 capsules
club: 36 capsules
eu: 33 capsules
site: 31 capsules
me: 27 capsules
info: 26 capsules
dev: 26 capsules
io: 21 capsules
uk: 21 capsules
casa: 21 capsules
fr: 18 capsules
us: 17 capsules
ca: 15 capsules

Other statistics on the geminispace

At the search engine geminispace.info

By Nervuri (specially for certificates)

Contact

Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.

Home page of the crawler

Source code of the crawler

My capsule