💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2023-05-24 at 17:43:46. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-04-26)
➡️ Next capture (2023-05-30)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-05-04 18:04:01Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 517,578 URIs, 395,677 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 308,704 URIs serve a Gemini content.
Resources
The average size of the resources is 45,229 bytes.
Quantiles
- 10% of the resources are 261 bytes or less,
- 20% of the resources are 635 bytes or less,
- 30% of the resources are 960 bytes or less,
- 40% of the resources are 1,598 bytes or less,
- 50% of the resources are 2,683 bytes or less, MEDIAN
- 60% of the resources are 4,854 bytes or less,
- 70% of the resources are 7,486 bytes or less,
- 80% of the resources are 16,694 bytes or less,
- 90% of the resources are 85,487 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 228 bytes or less,
- 20% of the resources are 496 bytes or less,
- 30% of the resources are 783 bytes or less,
- 40% of the resources are 1,117 bytes or less,
- 50% of the resources are 1,781 bytes or less, MEDIAN
- 60% of the resources are 2,775 bytes or less,
- 70% of the resources are 4,695 bytes or less,
- 80% of the resources are 6,909 bytes or less,
- 90% of the resources are 13,638 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Ranges
- Less than 10 bytes: 3308 URLs (0.84 %)
- 10 to 100 bytes: 10807 URLs (2.7 %)
- 100 to 1000 bytes: 108198 URLs (27.3 %)
- 1 to 10 kbytes: 171027 URLs (43.2 %)
- 10 to 100 kbytes: 68676 URLs (17.4 %)
- 100 to 1000 kbytes: 26096 URLs (6.6 %)
- More than 1000 kbytes: 7565 URLs (1.91 %)
Most common media (MIME) types
- text/gemini: 308,704 URLs
- image/jpeg: 18,895 URLs
- image/png: 18,569 URLs
- text/plain: 16,616 URLs
- application/octet-stream: 9,476 URLs
- application/pdf: 4,734 URLs
- application/zip: 3,134 URLs
- image/gif: 2,471 URLs
- octet/stream: 2,216 URLs
- text/html: 2,046 URLs
- application/x-mscardfile: 1,198 URLs
- audio/mpeg: 1,186 URLs
- MIME: 997 URLs
- text/x-diff: 786 URLs
- application/json: 600 URLs
- audio/ogg: 385 URLs
- application/atom+xml: 246 URLs
- text/xml: 243 URLs
- application/lagrange-fontpack+zip: 200 URLs
- image/webp: 198 URLs
Most common languages
- Unspecified: 308,657 URLs
- en: 60,986 URLs
- de: 11,120 URLs
- it: 7,025 URLs
- fr: 2,049 URLs
- ja: 1,122 URLs
- fi: 1,111 URLs
- es_ar: 978 URLs
- ru: 860 URLs
- en_gb: 455 URLs
- es: 335 URLs
- en_us: 216 URLs
- gl: 121 URLs
- pl: 103 URLs
- ko: 97 URLs
- ca: 81 URLs
- sv: 63 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 29 URLs
- eo: 28 URLs
Most common language tags
- Unspecified: 308,612 URLs
- en: 33,895 URLs
- en-us: 13,369 URLs
- en-gb: 12,953 URLs
- de: 11,059 URLs
- it: 7,025 URLs
- fr: 1,157 URLs
- ja: 1,122 URLs
- fi: 1,111 URLs
- es_ar: 978 URLs
- fr-fr: 892 URLs
- ru-ru: 722 URLs
- en-ie: 472 URLs
- en_gb: 455 URLs
- es-es: 324 URLs
- en-au: 273 URLs
- en_us: 216 URLs
- ru: 138 URLs
- pl: 100 URLs
- ko: 97 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 352,519 URLs
- utf-8: 43,026 URLs
- us-ascii: 75 URLs
- binary: 24 URLs
- gzip: 22 URLs
- windows-1252: 2 URLs
- bzip2: 2 URLs
- cp437: 2 URLs
- u: 2 URLs
- utf-16: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 275,292 URLs
- utf-8: 33,405 URLs
- cp437: 2 URLs
- utf-16: 2 URLs
- windows-1252: 2 URLs
- iso-8859-1: 1 URLs
By the way, 163 of recently tested URLs (0.032 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 395,677 occurrences (85.53 %)
- 51 (Not found): 26,278 occurrences (5.68 %)
- 40 (Temporary failure): 11,952 occurrences (2.58 %)
- 44 (Slow down): 5,926 occurrences (1.28 %)
- 60 (Client certificate request): 5,655 occurrences (1.22 %)
- 30 (Temporary redirect): 5,310 occurrences (1.15 %)
- 42 (CGI error): 4,383 occurrences (0.95 %)
- 10 (Input request): 3,502 occurrences (0.76 %)
- 53 (Proxy request refused): 1,866 occurrences (0.40 %)
- 31 (Permanent redirect): 1,109 occurrences (0.24 %)
- 50 (Permanent failure): 688 occurrences (0.15 %)
- 59 (Bad request): 153 occurrences (0.03 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 267
Average number of incoming links: 0.21
Capsules
There are 3190 capsules. We successfully connected recently to 2389 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- blitter.com: 10000 URLs
- midnight.pub: 10000 URLs
- gemini.techrights.org: 10000 URLs
- rwv.io: 9996 URLs
- taz.de: 9995 URLs
- gemini.conman.org: 9993 URLs
- gemlog.stargrave.org: 9992 URLs
- hoagie.space: 9989 URLs
- gemini.tuxmachines.org: 9988 URLs
- mirrors.apple2.org.za: 9969 URLs
- news.tuxmachines.org: 9844 URLs
- caiofior.pollux.casa: 9808 URLs
- gemini.knusbaum.com: 9748 URLs
- library.inu.red: 9441 URLs
- gemini.omarpolo.com: 9059 URLs
- gemini.autonomy.earth: 8818 URLs
- ecs.d2evs.net: 8479 URLs
- rawtext.club: 7852 URLs
- skyjake.fi: 6849 URLs
- federal.cx: 6121 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2789.8 megabytes
- uscoffings.net: 915.7 megabytes
- nytpu.com: 896.2 megabytes
- blitter.com: 824.2 megabytes
- gael.mooo.com: 662.6 megabytes
- yam655.com: 572.2 megabytes
- hoagie.space: 498.5 megabytes
- skyjake.fi: 439.9 megabytes
- gemini.zachdecook.com: 317.1 megabytes
- mikelynch.org: 315.7 megabytes
- ecs.d2evs.net: 288.4 megabytes
- gem.librehacker.com: 284.3 megabytes
- library.inu.red: 273.3 megabytes
- si3t.ch: 253.3 megabytes
- b2khgkvb2wn4avjshjp63kknsjwikgwff5dwwydldia6qwf4kdnueyad.onion: 246.0 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- tweek.zyxxyz.eu: 234.6 megabytes
- shit.cx: 181.8 megabytes
- phreedom.club: 177.0 megabytes
- gemini.techrights.org: 174.4 megabytes
- rwv.io: 168.4 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2124 (88.9 %) capsules are self-signed, 207 (8.7 %) use the Certificate Authority Let's Encrypt, 58 (2.4 %) are signed by another CA (may be not a trusted one).
55 capsules (2.32 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1545 capsules
- sha256WithRSAEncryption: 829 capsules
- ED25519: 13 capsules
- ecdsa-with-SHA512: 5 capsules
- ecdsa-with-SHA384: 2 capsules
- sha512WithRSAEncryption: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1575 capsules
- RSA: 809 capsules
- ED25519: 13 capsules
Key sizes for RSA:
- 2048: 550 capsules
- 4096: 247 capsules
- 3072: 9 capsules
- 1024: 2 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1496 capsules
- 384: 77 capsules
- 521: 2 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
6.1 % of capsules do NOT send a proper close.
The full list
robots.txt
229 (10 %) the capsules have a robots.txt exclusion file.
Ports
11 working capsules (0.5 %) use an alternative port
Addresses
1169 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 776 vhosts
- 68.133.1.71: 283 vhosts
- 213.219.38.200: 201 vhosts
- 173.195.146.139: 99 vhosts
- 90.65.170.44: 28 vhosts
- 109.237.26.252: 19 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 104.245.33.223: 8 vhosts
- 52.51.189.88: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 139.162.187.208: 6 vhosts
- 51.222.161.16: 6 vhosts
- 84.62.113.202: 5 vhosts
- 89.234.140.141: 5 vhosts
- 37.79.202.136: 5 vhosts
- 46.23.94.99: 5 vhosts
- 23.88.35.144: 5 vhosts
TLDs
There are 247 TLDs in the capsule's names, and 1580 registered domains.
Most common TLDs
By number of registered domains
- com: 254 domains
- net: 137 domains
- org: 125 domains
- xyz: 105 domains
- space: 72 domains
- de: 43 domains
- site: 42 domains
- me: 41 domains
- dev: 39 domains
- eu: 32 domains
- fr: 27 domains
- uk: 24 domains
- io: 23 domains
- club: 21 domains
- info: 20 domains
- online: 15 domains
- ca: 14 domains
- ch: 14 domains
- se: 13 domains
- ru: 12 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 791 capsules
- org: 446 capsules
- com: 305 capsules
- pub: 209 capsules
- net: 156 capsules
- xyz: 112 capsules
- space: 91 capsules
- de: 48 capsules
- club: 45 capsules
- site: 45 capsules
- me: 43 capsules
- dev: 41 capsules
- eu: 40 capsules
- casa: 36 capsules
- io: 31 capsules
- fr: 29 capsules
- info: 27 capsules
- uk: 26 capsules
- us: 19 capsules
- ch: 18 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule