💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2021-07-01.gmi captured on 2023-09-28 at 23:32:25. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2021-07-01 00:04:02Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 332,273 URIs, 255,816 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 182,709 URIs serve a Gemini content.

Resources

The average size of the resources is 30,235 bytes.

Quantiles

10% of the resources are 275 bytes or less,
20% of the resources are 423 bytes or less,
30% of the resources are 712 bytes or less,
40% of the resources are 1,135 bytes or less,
50% of the resources are 2,045 bytes or less, MEDIAN
60% of the resources are 3,214 bytes or less,
70% of the resources are 5,550 bytes or less,
80% of the resources are 10,625 bytes or less,
90% of the resources are 33,762 bytes or less,
100% of the resources are 24,550,785 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 246 bytes or less,
20% of the resources are 342 bytes or less,
30% of the resources are 516 bytes or less,
40% of the resources are 738 bytes or less,
50% of the resources are 1,051 bytes or less, MEDIAN
60% of the resources are 1,697 bytes or less,
70% of the resources are 2,627 bytes or less,
80% of the resources are 4,347 bytes or less,
90% of the resources are 7,451 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 756 URLs (0.30 %)
10 to 100 bytes: 7021 URLs (2.7 %)
100 to 1000 bytes: 88790 URLs (34.7 %)
1 to 10 kbytes: 106183 URLs (41.5 %)
10 to 100 kbytes: 42265 URLs (16.5 %)
100 to 1000 kbytes: 6926 URLs (2.7 %)
More than 1000 kbytes: 3875 URLs (1.51 %)

Most common media (MIME) types

text/gemini: 182,709 URLs
text/plain: 42,666 URLs
image/jpeg: 12,107 URLs
image/png: 6,222 URLs
application/octet-stream: 3,958 URLs
video/mp4: 1,663 URLs
text/x-python: 882 URLs
application/pdf: 800 URLs
image/gif: 782 URLs
text/html: 712 URLs
text/x-patch: 605 URLs
audio/mpeg: 375 URLs
application/postscript: 209 URLs
application/zip: 202 URLs
text/markdown: 187 URLs
image/svg+xml: 187 URLs
text/xml: 148 URLs
audio/ogg: 143 URLs
image/webp: 117 URLs
audio/flac: 99 URLs

Most common languages

Unspecified: 204,717 URLs
en: 44,009 URLs
fr: 6,030 URLs
de: 258 URLs
es: 191 URLs
ko: 105 URLs
it: 95 URLs
en_us: 54 URLs
es,en: 46 URLs
pl: 45 URLs
es_ar: 40 URLs
sv: 37 URLs
en,zh: 33 URLs
en,fr: 30 URLs
ru: 29 URLs
en,he: 26 URLs
pl,en: 16 URLs
ca: 13 URLs
pt: 13 URLs
pl_pl: 12 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 228,711 URLs
utf-8: 17,559 URLs
us-ascii: 9,525 URLs
binary: 15 URLs
iso-8859-1: 1 URLs
utf-16: 1 URLs
windows-1252: 1 URLs
bzip2: 1 URLs
cp437: 1 URLs
gzip: 1 URLs

Most common encodings for gemtext files only

Unspecified: 175,959 URLs
utf-8: 6,743 URLs
us-ascii: 3 URLs
iso-8859-1: 1 URLs
utf-16: 1 URLs
cp437: 1 URLs
windows-1252: 1 URLs

By the way, 2,327 of recently tested URLs (0.706 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 255,816 occurrences (85.70 %)
51 (Not found): 18,751 occurrences (6.28 %)
50 (Permanent failure): 14,335 occurrences (4.80 %)
44 (Slow down): 4,243 occurrences (1.42 %)
42 (CGI error): 1,717 occurrences (0.58 %)
10 (Input request): 1,294 occurrences (0.43 %)
40 (Temporary failure): 947 occurrences (0.32 %)
60 (Client certificate request): 453 occurrences (0.15 %)
30 (Temporary redirect): 426 occurrences (0.14 %)
43 (Proxy error): 405 occurrences (0.14 %)
31 (Permanent redirect): 45 occurrences (0.02 %)
59 (Bad request): 43 occurrences (0.01 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 156

Average number of incoming links: 0.07

Capsules

There are 1342 capsules. We successfully connected recently to 1149 of them.

Most common capsules by number of working URLs

gemini.techrights.org: 10000 URLs
git.sysrq.in: 9996 URLs
gemini.rob-bolton.co.uk: 9995 URLs
gemini.conman.org: 9990 URLs
gem.benscraft.info: 9962 URLs
gemini.spam.works: 9961 URLs
jpfox.fr: 9673 URLs
geminispace.info: 9602 URLs
vps01.rdelaage.ovh: 9592 URLs
mastogem.picasoft.net: 9430 URLs
dw.schettler.net: 9355 URLs
kamalatta.ddnss.de: 8910 URLs
gemini.omarpolo.com: 8827 URLs
gemini.theuse.net: 8694 URLs
midnight.pub: 7188 URLs
caolan.uk: 6257 URLs
pon.ix.tc: 6135 URLs
ecs.d2evs.net: 5516 URLs
pgorl32jhgkgald7tcsp6k7zpujvd763kywenr72yr76fqjaomxf7kid.onion: 5271 URLs
godocs.io: 5078 URLs

Most common capsules by number of bytes in working URLs

pon.ix.tc: 1615.8 megabytes
jpfox.fr: 805.4 megabytes
ybad.name: 229.1 megabytes
si3t.ch: 228.6 megabytes
gemini.spam.works: 226.7 megabytes
mikelynch.org: 202.6 megabytes
ecs.d2evs.net: 197.5 megabytes
kamalatta.ddnss.de: 183.5 megabytes
gemini.techrights.org: 174.4 megabytes
gemini.conman.org: 136.0 megabytes
gemini.theuse.net: 131.2 megabytes
tweek.zyxxyz.eu: 129.7 megabytes
nytpu.com: 115.6 megabytes
pgorl32jhgkgald7tcsp6k7zpujvd763kywenr72yr76fqjaomxf7kid.onion: 108.4 megabytes
gemini.circumlunar.space: 100.6 megabytes
thurk.org: 93.7 megabytes
oppen.digital: 91.6 megabytes
dw.schettler.net: 88.3 megabytes
clemat.is: 87.8 megabytes
vanwa.ch: 83.5 megabytes
park-city.club: 83.4 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

990 (86.2 %) capsules are self-signed, 123 (10.7 %) use the Certificate Authority Let's Encrypt, 36 (3.1 %) are signed by another CA (may be not a trusted one).

35 capsules (3.11 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 658 capsules
sha256WithRSAEncryption: 462 capsules
ED25519: 16 capsules
ecdsa-with-SHA512: 3 capsules
sha512WithRSAEncryption: 3 capsules
ecdsa-with-SHA384: 2 capsules
ecdsa-with-SHA1: 1 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 675 capsules
RSA: 455 capsules
ED25519: 16 capsules

Key sizes for RSA:

4096: 269 capsules
2048: 179 capsules
1024: 3 capsules
3072: 3 capsules
4098: 1 capsules

Key sizes for ECDSA:

256: 622 capsules
384: 51 capsules
521: 2 capsules

TLS

83 % of the capsules use TLS 1.3, 17 % use TLS 1.2.

41.5 % of URLs do NOT send a proper TLS shutdown (application

close). Even 33.7 % of those who return status 20 are in that case.

A proposal to make this shutdown mandatory.

Ports

6 working capsules (0.5 %) use an alternative port

Addresses

811 IP addresses used. 13 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 338 vhosts
173.195.146.139: 45 vhosts
213.219.38.200: 33 vhosts
86.248.169.233: 14 vhosts
109.237.26.252: 14 vhosts
45.56.93.217: 13 vhosts
86.221.245.90: 12 vhosts
52.51.189.88: 8 vhosts
89.234.140.141: 6 vhosts
2a00:5881:4008:d00::: 6 vhosts
135.181.153.189: 6 vhosts
2a01:4f9:c010:e919::1: 6 vhosts
144.91.116.244: 5 vhosts
185.73.232.189: 4 vhosts
193.70.85.11: 4 vhosts
91.45.235.192: 4 vhosts
174.138.124.169: 4 vhosts
211.207.184.198: 4 vhosts
82.64.229.81: 4 vhosts
94.130.177.83: 4 vhosts

TLDs

There are 166 TLDs in the capsule's names, and 815 registered domains.

Most common TLDs

By number of registered domains

com: 120 domains
org: 73 domains
net: 72 domains
xyz: 52 domains
space: 46 domains
de: 29 domains
me: 21 domains
eu: 20 domains
dev: 16 domains
uk: 15 domains
site: 15 domains
club: 14 domains
info: 14 domains
fr: 13 domains
io: 11 domains
tk: 10 domains
ca: 9 domains
ch: 8 domains
online: 7 domains
us: 6 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)

online: 341 capsules
com: 139 capsules
org: 95 capsules
net: 87 capsules
space: 55 capsules
xyz: 55 capsules
pub: 45 capsules
de: 30 capsules
club: 29 capsules
eu: 28 capsules
me: 22 capsules
info: 18 capsules
uk: 18 capsules
dev: 17 capsules
site: 16 capsules
fr: 14 capsules
io: 13 capsules
casa: 12 capsules
ca: 12 capsules
us: 11 capsules

Other statistics on the geminispace

At the search engine geminispace.info

By Nervuri (specially for certificates)

Contact

Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.

Home page of the crawler

Source code of the crawler

My capsule