💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2023-06-16 at 16:06:12. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-06-14)
➡️ Next capture (2023-07-10)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-06-16 03:04:02Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 536,061 URIs, 405,700 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 310,394 URIs serve a Gemini content.
Resources
The average size of the resources is 44,701 bytes.
Quantiles
- 10% of the resources are 283 bytes or less,
- 20% of the resources are 662 bytes or less,
- 30% of the resources are 1,017 bytes or less,
- 40% of the resources are 1,800 bytes or less,
- 50% of the resources are 3,005 bytes or less, MEDIAN
- 60% of the resources are 5,257 bytes or less,
- 70% of the resources are 7,795 bytes or less,
- 80% of the resources are 17,387 bytes or less,
- 90% of the resources are 86,861 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 235 bytes or less,
- 20% of the resources are 520 bytes or less,
- 30% of the resources are 790 bytes or less,
- 40% of the resources are 1,163 bytes or less,
- 50% of the resources are 1,930 bytes or less, MEDIAN
- 60% of the resources are 2,968 bytes or less,
- 70% of the resources are 4,841 bytes or less,
- 80% of the resources are 6,700 bytes or less,
- 90% of the resources are 12,818 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3218 URLs (0.79 %)
- 10 to 100 bytes: 9464 URLs (2.3 %)
- 100 to 1000 bytes: 107637 URLs (26.5 %)
- 1 to 10 kbytes: 177593 URLs (43.8 %)
- 10 to 100 kbytes: 74155 URLs (18.3 %)
- 100 to 1000 kbytes: 26080 URLs (6.4 %)
- More than 1000 kbytes: 7553 URLs (1.86 %)
Most common media (MIME) types
- text/gemini: 310,394 URLs
- text/plain: 24,521 URLs
- image/jpeg: 22,668 URLs
- image/png: 15,829 URLs
- application/octet-stream: 9,180 URLs
- application/pdf: 4,586 URLs
- application/zip: 3,085 URLs
- octet/stream: 2,211 URLs
- image/gif: 2,019 URLs
- text/html: 1,890 URLs
- audio/mpeg: 1,247 URLs
- application/x-mscardfile: 1,197 URLs
- MIME: 1,037 URLs
- text/x-diff: 864 URLs
- application/json: 597 URLs
- audio/ogg: 392 URLs
- image/webp: 366 URLs
- application/xml: 295 URLs
- text/xml: 254 URLs
- application/atom+xml: 252 URLs
Most common languages
- Unspecified: 321,872 URLs
- en: 61,476 URLs
- de: 11,078 URLs
- fr: 5,527 URLs
- es: 1,347 URLs
- es_ar: 1,102 URLs
- fi: 1,055 URLs
- ru: 859 URLs
- en_gb: 256 URLs
- en_us: 216 URLs
- it: 155 URLs
- gl: 124 URLs
- pl: 103 URLs
- ko: 97 URLs
- ca: 86 URLs
- sv: 63 URLs
- ja: 32 URLs
- pl,en: 29 URLs
- eo: 28 URLs
- hu: 23 URLs
Most common language tags
- Unspecified: 321,827 URLs
- en: 33,663 URLs
- en-us: 14,232 URLs
- en-gb: 12,865 URLs
- de: 11,046 URLs
- fr: 4,609 URLs
- es-es: 1,336 URLs
- es_ar: 1,102 URLs
- fi: 1,055 URLs
- fr-fr: 918 URLs
- ru-ru: 739 URLs
- en-ie: 471 URLs
- en_gb: 256 URLs
- en_us: 216 URLs
- en-au: 211 URLs
- it: 155 URLs
- ru: 120 URLs
- pl: 100 URLs
- ko: 97 URLs
- ca-es: 84 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 362,593 URLs
- utf-8: 34,615 URLs
- us-ascii: 8,436 URLs
- binary: 26 URLs
- gzip: 23 URLs
- bzip2: 2 URLs
- windows-1252: 1 URLs
- cp437: 1 URLs
- iso-8859-1: 1 URLs
- u: 1 URLs
- utf-16: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 284,924 URLs
- utf-8: 25,466 URLs
- cp437: 1 URLs
- iso-8859-1: 1 URLs
- utf-16: 1 URLs
- windows-1252: 1 URLs
By the way, 2,281 of recently tested URLs (0.446 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 405,700 occurrences (86.07 %)
- 51 (Not found): 19,873 occurrences (4.22 %)
- 40 (Temporary failure): 12,628 occurrences (2.68 %)
- 60 (Client certificate request): 5,661 occurrences (1.20 %)
- 30 (Temporary redirect): 5,514 occurrences (1.17 %)
- 42 (CGI error): 4,571 occurrences (0.97 %)
- 44 (Slow down): 4,520 occurrences (0.96 %)
- 10 (Input request): 3,453 occurrences (0.73 %)
- 50 (Permanent failure): 3,194 occurrences (0.68 %)
- 53 (Proxy request refused): 2,990 occurrences (0.63 %)
- 31 (Permanent redirect): 2,777 occurrences (0.59 %)
- 59 (Bad request): 373 occurrences (0.08 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 274
Average number of incoming links: 0.20
Capsules
There are 3352 capsules. We successfully connected recently to 2461 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- midnight.pub: 10000 URLs
- gemini.techrights.org: 9999 URLs
- jsreed5.org: 9995 URLs
- gemini.conman.org: 9995 URLs
- gemini.tuxmachines.org: 9994 URLs
- news.tuxmachines.org: 9994 URLs
- rwv.io: 9994 URLs
- blitter.com: 9993 URLs
- hoagie.space: 9993 URLs
- taz.de: 9981 URLs
- mirrors.apple2.org.za: 9976 URLs
- gemini.knusbaum.com: 9748 URLs
- gemlog.stargrave.org: 9508 URLs
- gemini.autonomy.earth: 9044 URLs
- spam.works: 8933 URLs
- gemini.omarpolo.com: 8857 URLs
- ecs.d2evs.net: 8544 URLs
- gmi.noulin.net: 8230 URLs
- rawtext.club: 7935 URLs
- jpfox.fr: 7296 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2793.3 megabytes
- nytpu.com: 950.7 megabytes
- uscoffings.net: 915.7 megabytes
- blitter.com: 823.0 megabytes
- gael.mooo.com: 748.9 megabytes
- yam655.com: 598.3 megabytes
- skyjake.fi: 499.4 megabytes
- hoagie.space: 494.6 megabytes
- jpfox.fr: 467.1 megabytes
- gem.librehacker.com: 459.8 megabytes
- mikelynch.org: 336.5 megabytes
- gemini.zachdecook.com: 331.8 megabytes
- ecs.d2evs.net: 289.9 megabytes
- tweek.zyxxyz.eu: 241.9 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- shit.cx: 182.3 megabytes
- phreedom.club: 177.1 megabytes
- higeki.jp: 177.0 megabytes
- gemini.techrights.org: 174.3 megabytes
- rwv.io: 168.5 megabytes
- going-flying.com: 154.2 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2190 (89.0 %) capsules are self-signed, 214 (8.7 %) use the Certificate Authority Let's Encrypt, 57 (2.3 %) are signed by another CA (may be not a trusted one).
65 capsules (2.65 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1583 capsules
- sha256WithRSAEncryption: 858 capsules
- ED25519: 15 capsules
- ecdsa-with-SHA512: 4 capsules
- ecdsa-with-SHA384: 2 capsules
- sha512WithRSAEncryption: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1612 capsules
- RSA: 838 capsules
- ED25519: 15 capsules
Key sizes for RSA:
- 2048: 566 capsules
- 4096: 259 capsules
- 3072: 10 capsules
- 1024: 2 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1536 capsules
- 384: 74 capsules
- 521: 2 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
robots.txt
245 (10 %) the capsules have a robots.txt exclusion file.
Ports
11 working capsules (0.4 %) use an alternative port
Addresses
1207 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 792 vhosts
- 68.133.1.71: 294 vhosts
- 213.219.38.200: 207 vhosts
- 173.195.146.139: 99 vhosts
- 90.65.170.44: 28 vhosts
- 109.237.26.252: 22 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 14 vhosts
- 104.245.33.223: 8 vhosts
- 52.51.189.88: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 89.234.140.141: 6 vhosts
- 139.162.187.208: 6 vhosts
- 51.222.161.16: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 89.253.220.199: 5 vhosts
- 178.209.50.237: 5 vhosts
- 37.79.202.136: 5 vhosts
TLDs
There are 258 TLDs in the capsule's names, and 1678 registered domains.
Most common TLDs
By number of registered domains
- com: 274 domains
- net: 144 domains
- org: 137 domains
- xyz: 112 domains
- space: 76 domains
- de: 47 domains
- site: 45 domains
- dev: 44 domains
- me: 41 domains
- eu: 32 domains
- uk: 31 domains
- fr: 27 domains
- info: 25 domains
- io: 24 domains
- club: 19 domains
- online: 15 domains
- ch: 14 domains
- ca: 14 domains
- us: 12 domains
- ru: 11 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 803 capsules
- org: 468 capsules
- com: 336 capsules
- pub: 215 capsules
- net: 169 capsules
- xyz: 120 capsules
- space: 101 capsules
- de: 55 capsules
- site: 49 capsules
- dev: 46 capsules
- me: 43 capsules
- club: 40 capsules
- eu: 39 capsules
- casa: 36 capsules
- uk: 34 capsules
- io: 33 capsules
- info: 32 capsules
- fr: 30 capsules
- us: 21 capsules
- ch: 19 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule