💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2021-12-17 at 13:26:06. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2021-12-17 13:04:01Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 404,858 URIs, 337,442 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 236,822 URIs serve a Gemini content.

Resources

The average size of the resources is 28,798 bytes.

Quantiles

10% of the resources are 210 bytes or less,
20% of the resources are 394 bytes or less,
30% of the resources are 695 bytes or less,
40% of the resources are 1,152 bytes or less,
50% of the resources are 2,077 bytes or less, MEDIAN
60% of the resources are 3,105 bytes or less,
70% of the resources are 5,187 bytes or less,
80% of the resources are 10,295 bytes or less,
90% of the resources are 36,675 bytes or less,
100% of the resources are 7,143,369 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 160 bytes or less,
20% of the resources are 318 bytes or less,
30% of the resources are 487 bytes or less,
40% of the resources are 723 bytes or less,
50% of the resources are 1,063 bytes or less, MEDIAN
60% of the resources are 1,778 bytes or less,
70% of the resources are 2,624 bytes or less,
80% of the resources are 4,209 bytes or less,
90% of the resources are 7,222 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 1058 URLs (0.31 %)
10 to 100 bytes: 9307 URLs (2.8 %)
100 to 1000 bytes: 116649 URLs (34.6 %)
1 to 10 kbytes: 141823 URLs (42.0 %)
10 to 100 kbytes: 53274 URLs (15.8 %)
100 to 1000 kbytes: 11418 URLs (3.4 %)
More than 1000 kbytes: 3913 URLs (1.16 %)

Most common media (MIME) types

text/gemini: 236,822 URLs
text/plain: 53,422 URLs
image/jpeg: 15,051 URLs
image/png: 7,699 URLs
application/octet-stream: 4,876 URLs
application/pdf: 3,180 URLs
octet/stream: 2,258 URLs
image/gif: 2,008 URLs
text/html: 1,845 URLs
text/x-patch: 1,796 URLs
application/x-mscardfile: 1,195 URLs
text/x-python: 951 URLs
audio/mpeg: 919 URLs
application/zip: 560 URLs
text/x-diff: 444 URLs
image/svg+xml: 369 URLs
text/markdown: 316 URLs
text/x-csrc: 316 URLs
image/webp: 286 URLs
application/x-gzip: 205 URLs

Most common languages

Unspecified: 269,398 URLs
en: 50,762 URLs
ru: 10,096 URLs
fr: 5,356 URLs
ga: 422 URLs
de: 281 URLs
es: 240 URLs
it: 132 URLs
ko: 109 URLs
gl: 79 URLs
ca: 76 URLs
en,zh: 72 URLs
pl: 72 URLs
en_us: 60 URLs
es_ar: 40 URLs
sco,gd,it,en: 38 URLs
sv: 37 URLs
hu: 22 URLs
fi: 19 URLs
zh: 18 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 310,310 URLs
utf-8: 17,649 URLs
us-ascii: 9,457 URLs
binary: 18 URLs
gzip: 3 URLs
bzip2: 2 URLs
cp437: 1 URLs
utf-16: 1 URLs
windows-1252: 1 URLs

Most common encodings for gemtext files only

Unspecified: 228,162 URLs
utf-8: 8,657 URLs
cp437: 1 URLs
utf-16: 1 URLs
windows-1252: 1 URLs

By the way, 4,799 of recently tested URLs (1.194 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 337,442 occurrences (88.90 %)
51 (Not found): 14,556 occurrences (3.83 %)
50 (Permanent failure): 6,860 occurrences (1.81 %)
40 (Temporary failure): 5,736 occurrences (1.51 %)
44 (Slow down): 5,180 occurrences (1.36 %)
42 (CGI error): 3,903 occurrences (1.03 %)
60 (Client certificate request): 2,247 occurrences (0.59 %)
10 (Input request): 1,894 occurrences (0.50 %)
31 (Permanent redirect): 750 occurrences (0.20 %)
30 (Temporary redirect): 542 occurrences (0.14 %)
43 (Proxy error): 405 occurrences (0.11 %)
53 (Proxy request refused): 23 occurrences (0.01 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 200

Average number of incoming links: 0.12

Capsules

There are 1861 capsules. We successfully connected recently to 1517 of them.

Most common capsules by number of working URLs

ake.crabdance.com:1966: 10000 URLs
gemini.rob-bolton.co.uk: 9999 URLs
gemini.techrights.org: 9999 URLs
git.sysrq.in: 9993 URLs
gemini.susa.net: 9978 URLs
gemini.spam.works: 9977 URLs
blitter.com: 9967 URLs
gem.benscraft.info: 9963 URLs
tlgs.one: 9926 URLs
gemini.theuse.net: 9916 URLs
gemini.conman.org: 9748 URLs
geminispace.info: 9567 URLs
gemini.omarpolo.com: 9014 URLs
jpfox.fr: 8988 URLs
woeu6k57svt4t5mipf6w4lcdk4w3awdhnv7kqe6ooamtbxvnoo7oe7yd.onion: 8948 URLs
mastogem.picasoft.net: 8905 URLs
vps01.rdelaage.ovh: 8847 URLs
midnight.pub: 7947 URLs
tilde.team: 7693 URLs
ecs.d2evs.net: 7063 URLs

Most common capsules by number of bytes in working URLs

jpfox.fr: 906.5 megabytes
blitter.com: 822.1 megabytes
yam655.com: 595.7 megabytes
gem.billsmugs.com: 344.5 megabytes
ecs.d2evs.net: 288.9 megabytes
nytpu.com: 271.5 megabytes
kamalatta.ddnss.de: 270.8 megabytes
woeu6k57svt4t5mipf6w4lcdk4w3awdhnv7kqe6ooamtbxvnoo7oe7yd.onion: 238.1 megabytes
multiverse.thruhere.net: 229.6 megabytes
gemini.spam.works: 226.8 megabytes
mikelynch.org: 202.6 megabytes
gemini.techrights.org: 174.4 megabytes
si3t.ch: 170.8 megabytes
tweek.zyxxyz.eu: 159.1 megabytes
gemini.theuse.net: 149.9 megabytes
gemini.conman.org: 146.3 megabytes
gemini.circumlunar.space: 112.9 megabytes
clemat.is: 110.7 megabytes
tilde.team: 108.9 megabytes
kota.nz: 104.3 megabytes
pgorl32jhgkgald7tcsp6k7zpujvd763kywenr72yr76fqjaomxf7kid.onion: 104.1 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

1322 (87.1 %) capsules are self-signed, 155 (10.2 %) use the Certificate Authority Let's Encrypt, 40 (2.6 %) are signed by another CA (may be not a trusted one).

47 capsules (3.16 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 997 capsules
sha256WithRSAEncryption: 494 capsules
ED25519: 11 capsules
ecdsa-with-SHA512: 3 capsules
sha512WithRSAEncryption: 3 capsules
ecdsa-with-SHA384: 2 capsules
ecdsa-with-SHA1: 1 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1019 capsules
RSA: 482 capsules
ED25519: 11 capsules

Key sizes for RSA:

4096: 277 capsules
2048: 197 capsules
3072: 4 capsules
1024: 2 capsules
4098: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 940 capsules
384: 77 capsules
521: 2 capsules

TLS

88 % of the capsules use TLS 1.3, 12 % use TLS 1.2.

Ports

10 working capsules (0.7 %) use an alternative port

Addresses

1005 IP addresses used. 14 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 477 vhosts
213.219.38.200: 93 vhosts
173.195.146.139: 64 vhosts
90.39.173.134: 23 vhosts
109.237.26.252: 16 vhosts
45.56.93.217: 15 vhosts
52.51.189.88: 8 vhosts
144.91.116.244: 7 vhosts
188.68.55.245: 6 vhosts
174.138.124.169: 6 vhosts
89.234.140.141: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
2001:19f0:5c01:83b:5400:2ff:fe02:94cf: 5 vhosts
2001:19f0:6001:4f71:5400:3ff:fea8:7c5e: 5 vhosts
149.28.115.162: 5 vhosts
37.79.202.136: 5 vhosts
91.45.237.184: 5 vhosts
91.45.238.6: 5 vhosts
91.45.236.225: 5 vhosts
104.207.153.51: 5 vhosts

TLDs

There are 187 TLDs in the capsule's names, and 1088 registered domains.

Most common TLDs

By number of registered domains

com: 164 domains
org: 95 domains
net: 94 domains
xyz: 80 domains
space: 56 domains
de: 34 domains
me: 28 domains
eu: 27 domains
site: 25 domains
dev: 22 domains
uk: 20 domains
info: 17 domains
io: 17 domains
club: 16 domains
fr: 16 domains
ca: 12 domains
online: 10 domains
ch: 9 domains
us: 9 domains
se: 8 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)

online: 481 capsules
com: 192 capsules
org: 120 capsules
net: 112 capsules
pub: 99 capsules
xyz: 85 capsules
space: 68 capsules
de: 39 capsules
eu: 34 capsules
club: 34 capsules
me: 30 capsules
site: 25 capsules
dev: 23 capsules
uk: 23 capsules
info: 23 capsules
casa: 21 capsules
io: 20 capsules
fr: 17 capsules
us: 17 capsules
ca: 15 capsules

Other statistics on the geminispace

At the search engine geminispace.info

By Nervuri (specially for certificates)

Contact

Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.

Home page of the crawler

Source code of the crawler

My capsule