💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2023-11-01.gmi captured on 2024-05-26 at 14:42:57. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-11-14)
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-10-19 03:04:01Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 592,396 URIs, 473,220 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 362,334 URIs serve a Gemini content.
Resources
The average size of the resources is 41,381 bytes.
Quantiles
- 10% of the resources are 277 bytes or less,
- 20% of the resources are 605 bytes or less,
- 30% of the resources are 959 bytes or less,
- 40% of the resources are 1,626 bytes or less,
- 50% of the resources are 2,941 bytes or less, MEDIAN
- 60% of the resources are 5,385 bytes or less,
- 70% of the resources are 7,890 bytes or less,
- 80% of the resources are 17,443 bytes or less,
- 90% of the resources are 66,479 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 245 bytes or less,
- 20% of the resources are 481 bytes or less,
- 30% of the resources are 790 bytes or less,
- 40% of the resources are 1,139 bytes or less,
- 50% of the resources are 1,888 bytes or less, MEDIAN
- 60% of the resources are 3,321 bytes or less,
- 70% of the resources are 5,463 bytes or less,
- 80% of the resources are 7,532 bytes or less,
- 90% of the resources are 16,594 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3217 URLs (0.68 %)
- 10 to 100 bytes: 11836 URLs (2.5 %)
- 100 to 1000 bytes: 131043 URLs (27.7 %)
- 1 to 10 kbytes: 199818 URLs (42.2 %)
- 10 to 100 kbytes: 92062 URLs (19.5 %)
- 100 to 1000 kbytes: 27316 URLs (5.8 %)
- More than 1000 kbytes: 7928 URLs (1.68 %)
Most common media (MIME) types
- text/gemini: 362,334 URLs
- text/plain: 29,663 URLs
- image/jpeg: 20,137 URLs
- image/png: 19,279 URLs
- application/octet-stream: 16,359 URLs
- application/pdf: 4,794 URLs
- application/zip: 3,155 URLs
- octet/stream: 2,215 URLs
- image/gif: 2,020 URLs
- text/html: 2,001 URLs
- audio/mpeg: 1,293 URLs
- application/x-mscardfile: 1,199 URLs
- MIME: 1,063 URLs
- text/x-diff: 977 URLs
- text/markdown: 713 URLs
- application/json: 697 URLs
- application/atom+xml: 579 URLs
- text/xml: 571 URLs
- audio/ogg: 406 URLs
- image/webp: 302 URLs
Most common languages
- Unspecified: 363,045 URLs
- en: 81,826 URLs
- de: 11,071 URLs
- it: 7,125 URLs
- fr: 4,370 URLs
- es: 1,506 URLs
- es_ar: 1,189 URLs
- ja: 1,126 URLs
- ru: 505 URLs
- en_gb: 373 URLs
- en_us: 223 URLs
- pl: 157 URLs
- ko: 97 URLs
- ca: 86 URLs
- sv: 69 URLs
- eo: 68 URLs
- en,he: 56 URLs
- gl: 54 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 31 URLs
Most common language tags
- Unspecified: 363,000 URLs
- en: 35,467 URLs
- en-us: 23,471 URLs
- en-gb: 22,147 URLs
- de: 11,010 URLs
- it: 7,125 URLs
- fr: 3,409 URLs
- es-es: 1,479 URLs
- es_ar: 1,189 URLs
- ja: 1,126 URLs
- fr-fr: 961 URLs
- en-ie: 473 URLs
- en_gb: 373 URLs
- ru-ru: 370 URLs
- en_us: 223 URLs
- ru: 135 URLs
- en-au: 105 URLs
- pl: 105 URLs
- ko: 97 URLs
- ca-es: 84 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 398,241 URLs
- utf-8: 65,419 URLs
- us-ascii: 9,497 URLs
- binary: 35 URLs
- gzip: 23 URLs
- xz: 2 URLs
- bzip2: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 306,807 URLs
- utf-8: 55,526 URLs
- iso-8859-1: 1 URLs
By the way, 1,260 of recently tested URLs (0.223 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 473,220 occurrences (86.19 %)
- 51 (Not found): 22,510 occurrences (4.10 %)
- 50 (Permanent failure): 17,965 occurrences (3.27 %)
- 40 (Temporary failure): 12,629 occurrences (2.30 %)
- 53 (Proxy request refused): 9,829 occurrences (1.79 %)
- 60 (Client certificate request): 5,649 occurrences (1.03 %)
- 10 (Input request): 3,863 occurrences (0.70 %)
- 42 (CGI error): 1,315 occurrences (0.24 %)
- 30 (Temporary redirect): 1,218 occurrences (0.22 %)
- 59 (Bad request): 325 occurrences (0.06 %)
- 31 (Permanent redirect): 253 occurrences (0.05 %)
- 44 (Slow down): 169 occurrences (0.03 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 283
Average number of incoming links: 0.18
Capsules
There are 3606 capsules. We successfully connected recently to 2574 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- gemlog.stargrave.org: 10000 URLs
- blitter.com: 10000 URLs
- midnight.pub: 10000 URLs
- mirrors.apple2.org.za: 10000 URLs
- gemini.conman.org: 9999 URLs
- jsreed5.org: 9995 URLs
- rwv.io: 9994 URLs
- hoagie.space: 9993 URLs
- spam.works: 9984 URLs
- caiofior.pollux.casa: 9981 URLs
- taz.de: 9977 URLs
- library.inu.red: 9966 URLs
- gemini.unlimited.pizza: 9784 URLs
- gemini.knusbaum.com: 9752 URLs
- gemini.tuxmachines.org: 9745 URLs
- mastogem.remorse.us: 9733 URLs
- gemini.techrights.org: 9728 URLs
- tjp.lol: 9662 URLs
- gemini.omarpolo.com: 9571 URLs
- gemini.autonomy.earth: 9426 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2803.0 megabytes
- nytpu.com: 1100.9 megabytes
- uscoffings.net: 927.0 megabytes
- blitter.com: 824.2 megabytes
- gael.mooo.com: 752.4 megabytes
- gem.librehacker.com: 746.6 megabytes
- yam655.com: 597.2 megabytes
- hoagie.space: 498.6 megabytes
- skyjake.fi: 444.6 megabytes
- gemini.omarpolo.com: 374.0 megabytes
- gemini.zachdecook.com: 340.3 megabytes
- mikelynch.org: 336.5 megabytes
- library.inu.red: 324.0 megabytes
- ecs.d2evs.net: 296.6 megabytes
- tweek.zyxxyz.eu: 258.7 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- shit.cx: 182.3 megabytes
- phreedom.club: 178.1 megabytes
- higeki.jp: 176.4 megabytes
- gemini.techrights.org: 170.3 megabytes
- rwv.io: 168.5 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2308 (89.7 %) capsules are self-signed, 208 (8.1 %) use the Certificate Authority Let's Encrypt, 58 (2.3 %) are signed by another CA (may be not a trusted one).
59 capsules (2.30 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1651 capsules
- sha256WithRSAEncryption: 902 capsules
- ED25519: 18 capsules
- ecdsa-with-SHA512: 3 capsules
- sha512WithRSAEncryption: 3 capsules
- ecdsa-with-SHA384: 1 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1687 capsules
- RSA: 874 capsules
- ED25519: 18 capsules
Key sizes for RSA:
- 2048: 596 capsules
- 4096: 262 capsules
- 3072: 12 capsules
- 1024: 3 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1621 capsules
- 384: 65 capsules
- 521: 1 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
robots.txt
256 (10 %) the capsules have a robots.txt exclusion file.
Ports
11 working capsules (0.4 %) use an alternative port
Addresses
1178 IP addresses used. 18 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 817 vhosts
- 68.133.1.71: 346 vhosts
- 213.219.38.200: 226 vhosts
- 173.195.146.139: 103 vhosts
- 90.65.170.44: 29 vhosts
- 109.237.26.252: 24 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 128.140.115.191: 11 vhosts
- 81.187.234.86: 8 vhosts
- 51.222.161.16: 8 vhosts
- 85.208.51.149: 7 vhosts
- 174.138.124.169: 7 vhosts
- 86.147.131.225: 7 vhosts
- 89.234.140.141: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 66.175.211.51: 6 vhosts
- 139.162.187.208: 6 vhosts
- 46.23.94.99: 5 vhosts
TLDs
There are 268 TLDs in the capsule's names, and 1806 registered domains.
Most common TLDs
By number of registered domains
- com: 288 domains
- net: 154 domains
- org: 151 domains
- xyz: 125 domains
- space: 82 domains
- de: 55 domains
- dev: 52 domains
- me: 47 domains
- site: 47 domains
- eu: 34 domains
- fr: 32 domains
- uk: 30 domains
- io: 25 domains
- info: 24 domains
- club: 24 domains
- online: 16 domains
- se: 15 domains
- ch: 15 domains
- ca: 14 domains
- ru: 13 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 837 capsules
- org: 544 capsules
- com: 351 capsules
- pub: 236 capsules
- net: 180 capsules
- xyz: 137 capsules
- space: 105 capsules
- de: 63 capsules
- dev: 56 capsules
- site: 50 capsules
- me: 48 capsules
- club: 48 capsules
- eu: 42 capsules
- casa: 37 capsules
- io: 34 capsules
- fr: 34 capsules
- uk: 33 capsules
- info: 31 capsules
- cafe: 19 capsules
- us: 19 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule