💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2023-05-01.gmi captured on 2024-05-12 at 19:00:51. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

Statistics on the Gemini space

This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-04-22 08:11:13Z.

It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:

the capsule may forbid retrieval, through robots.txt,
we do not know all the URIs and some cannot be found from the ones we know,
Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).

On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.

Currently, our database includes 528,382 URIs, 391,578 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 306,411 URIs serve a Gemini content.

Resources

The average size of the resources is 43,575 bytes.

Quantiles

10% of the resources are 265 bytes or less,
20% of the resources are 633 bytes or less,
30% of the resources are 948 bytes or less,
40% of the resources are 1,563 bytes or less,
50% of the resources are 2,658 bytes or less, MEDIAN
60% of the resources are 4,786 bytes or less,
70% of the resources are 7,196 bytes or less,
80% of the resources are 16,079 bytes or less,
90% of the resources are 82,347 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Quantiles only for Gemini pages

10% of the resources are 232 bytes or less,
20% of the resources are 502 bytes or less,
30% of the resources are 782 bytes or less,
40% of the resources are 1,123 bytes or less,
50% of the resources are 1,799 bytes or less, MEDIAN
60% of the resources are 2,813 bytes or less,
70% of the resources are 4,825 bytes or less,
80% of the resources are 6,749 bytes or less,
90% of the resources are 13,510 bytes or less,
100% of the resources are 2,677,426 bytes or less.

Ranges

Less than 10 bytes: 3296 URLs (0.84 %)
10 to 100 bytes: 10756 URLs (2.7 %)
100 to 1000 bytes: 108175 URLs (27.6 %)
1 to 10 kbytes: 171279 URLs (43.7 %)
10 to 100 kbytes: 65660 URLs (16.8 %)
100 to 1000 kbytes: 25280 URLs (6.5 %)
More than 1000 kbytes: 7132 URLs (1.82 %)

Most common media (MIME) types

text/gemini: 306,411 URLs
image/png: 18,300 URLs
image/jpeg: 16,777 URLs
text/plain: 15,952 URLs
application/octet-stream: 11,165 URLs
application/pdf: 4,532 URLs
application/zip: 3,103 URLs
image/gif: 2,474 URLs
octet/stream: 2,215 URLs
text/html: 2,045 URLs
application/x-mscardfile: 1,197 URLs
audio/mpeg: 1,026 URLs
MIME: 997 URLs
text/x-diff: 777 URLs
application/json: 598 URLs
audio/ogg: 354 URLs
text/xml: 243 URLs
application/atom+xml: 239 URLs
application/lagrange-fontpack+zip: 200 URLs
image/webp: 198 URLs

Most common languages

Unspecified: 306,875 URLs
en: 60,420 URLs
de: 11,097 URLs
it: 7,020 URLs
fr: 1,969 URLs
fi: 1,115 URLs
ja: 1,078 URLs
ru: 843 URLs
es: 333 URLs
en_us: 217 URLs
ko: 102 URLs
ca: 86 URLs
sv: 60 URLs
gl: 57 URLs
sco,gd,it,en: 38 URLs
pl,en: 29 URLs
eo: 28 URLs
tok: 24 URLs
hu: 23 URLs
it_it: 21 URLs

Most common encodings ("charsets") for all files

(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)

Unspecified: 350,386 URLs
utf-8: 41,059 URLs
us-ascii: 75 URLs
binary: 24 URLs
gzip: 23 URLs
windows-1252: 2 URLs
bzip2: 2 URLs
cp437: 2 URLs
u: 2 URLs
utf-16: 2 URLs
iso-8859-1: 1 URLs

Most common encodings for gemtext files only

Unspecified: 273,777 URLs
utf-8: 32,627 URLs
cp437: 2 URLs
utf-16: 2 URLs
windows-1252: 2 URLs
iso-8859-1: 1 URLs

By the way, 1,216 of recently tested URLs (0.238 %) have a wrong encoding (it does not match the actual content).

Status codes

(Remember there are test capsules with funny status codes, to exercice Gemini clients.)

20 (Success): 391,578 occurrences (83.31 %)
51 (Not found): 37,900 occurrences (8.06 %)
40 (Temporary failure): 11,434 occurrences (2.43 %)
60 (Client certificate request): 5,665 occurrences (1.21 %)
44 (Slow down): 5,545 occurrences (1.18 %)
30 (Temporary redirect): 5,279 occurrences (1.12 %)
42 (CGI error): 4,378 occurrences (0.93 %)
53 (Proxy request refused): 3,653 occurrences (0.78 %)
10 (Input request): 3,432 occurrences (0.73 %)
31 (Permanent redirect): 770 occurrences (0.16 %)
50 (Permanent failure): 129 occurrences (0.03 %)
59 (Bad request): 117 occurrences (0.02 %)

Links

(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)

Maximum number of incoming links: 263

Average number of incoming links: 0.20

Capsules

There are 3133 capsules. We successfully connected recently to 2363 of them.

Most common capsules by number of working URLs

We have a limit of 10000 URLs per capsule.

gemini.conman.org: 10000 URLs
midnight.pub: 10000 URLs
gemlog.stargrave.org: 9999 URLs
blitter.com: 9998 URLs
rwv.io: 9996 URLs
taz.de: 9995 URLs
jsreed5.org: 9994 URLs
gemini.techrights.org: 9993 URLs
hoagie.space: 9991 URLs
mirrors.apple2.org.za: 9958 URLs
caiofior.pollux.casa: 9804 URLs
gemini.knusbaum.com: 9752 URLs
gemini.tuxmachines.org: 9586 URLs
news.tuxmachines.org: 9477 URLs
gemini.omarpolo.com: 9112 URLs
library.inu.red: 9103 URLs
gemini.autonomy.earth: 8827 URLs
ecs.d2evs.net: 8459 URLs
rawtext.club: 7787 URLs
skyjake.fi: 6644 URLs

Most common capsules by number of bytes in working URLs

We have a limit of bytes per URL.

Not properly documented yet

mirrors.apple2.org.za: 2776.0 megabytes
uscoffings.net: 915.7 megabytes
nytpu.com: 878.8 megabytes
blitter.com: 824.1 megabytes
gael.mooo.com: 667.2 megabytes
yam655.com: 584.6 megabytes
hoagie.space: 496.1 megabytes
skyjake.fi: 423.9 megabytes
mikelynch.org: 315.7 megabytes
ecs.d2evs.net: 287.4 megabytes
library.inu.red: 263.4 megabytes
b2khgkvb2wn4avjshjp63kknsjwikgwff5dwwydldia6qwf4kdnueyad.onion: 258.2 megabytes
si3t.ch: 252.5 megabytes
multiverse.thruhere.net: 234.7 megabytes
tweek.zyxxyz.eu: 233.5 megabytes
gem.librehacker.com: 228.7 megabytes
shit.cx: 180.5 megabytes
phreedom.club: 175.9 megabytes
gemini.techrights.org: 174.3 megabytes
rwv.io: 168.5 megabytes
gem.girlmeow.autos: 165.5 megabytes

All working capsules:

As a text file

As a gemtext, with links

Certificates

2095 (88.7 %) capsules are self-signed, 206 (8.7 %) use the Certificate Authority Let's Encrypt, 62 (2.6 %) are signed by another CA (may be not a trusted one).

58 capsules (2.47 %) have an expired certificate.

Algorithms:

ecdsa-with-SHA256: 1537 capsules
sha256WithRSAEncryption: 817 capsules
ED25519: 13 capsules
ecdsa-with-SHA512: 5 capsules
ecdsa-with-SHA384: 2 capsules
sha512WithRSAEncryption: 2 capsules
sha384WithRSAEncryption: 1 capsules

Key types:

ECDSA: 1570 capsules
RSA: 794 capsules
ED25519: 13 capsules

Key sizes for RSA:

2048: 531 capsules
4096: 251 capsules
3072: 9 capsules
1024: 1 capsules
512: 1 capsules
3584: 1 capsules

Key sizes for ECDSA:

256: 1489 capsules
384: 79 capsules
521: 2 capsules

TLS

98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.

8.8 % of capsules do NOT send a proper close.

The full list

robots.txt

224 (9 %) the capsules have a robots.txt exclusion file.

Ports

11 working capsules (0.5 %) use an alternative port

Addresses

1165 IP addresses used. 17 % are IPv6.

Addresses with most virtual hosts

173.230.145.243: 772 vhosts
68.133.1.71: 271 vhosts
213.219.38.200: 199 vhosts
173.195.146.139: 99 vhosts
90.65.170.44: 28 vhosts
109.237.26.252: 19 vhosts
45.56.93.217: 17 vhosts
216.238.66.109: 13 vhosts
104.245.33.223: 8 vhosts
52.51.189.88: 8 vhosts
174.138.124.169: 7 vhosts
85.208.51.149: 7 vhosts
139.162.187.208: 6 vhosts
51.222.161.16: 6 vhosts
2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
84.62.113.202: 5 vhosts
178.209.50.237: 5 vhosts
37.79.202.136: 5 vhosts
46.23.94.99: 5 vhosts
23.88.35.144: 5 vhosts

TLDs

There are 242 TLDs in the capsule's names, and 1555 registered domains.

Most common TLDs

By number of registered domains

com: 254 domains
net: 134 domains
org: 127 domains
xyz: 107 domains
space: 69 domains
de: 45 domains
site: 42 domains
me: 40 domains
dev: 38 domains
eu: 32 domains
uk: 25 domains
io: 24 domains
fr: 23 domains
info: 23 domains
club: 18 domains
online: 13 domains
ch: 13 domains
ca: 13 domains
se: 11 domains
us: 11 domains

By number of capsules

(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)