💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2023-04-01.gmi captured on 2024-02-05 at 13:02:53. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-04-20)
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-03-27 18:04:01Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 532,208 URIs, 407,544 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 319,352 URIs serve a Gemini content.
Resources
The average size of the resources is 42,951 bytes.
Quantiles
- 10% of the resources are 263 bytes or less,
- 20% of the resources are 578 bytes or less,
- 30% of the resources are 867 bytes or less,
- 40% of the resources are 1,372 bytes or less,
- 50% of the resources are 2,462 bytes or less, MEDIAN
- 60% of the resources are 4,407 bytes or less,
- 70% of the resources are 7,206 bytes or less,
- 80% of the resources are 15,800 bytes or less,
- 90% of the resources are 76,897 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 235 bytes or less,
- 20% of the resources are 457 bytes or less,
- 30% of the resources are 728 bytes or less,
- 40% of the resources are 1,007 bytes or less,
- 50% of the resources are 1,575 bytes or less, MEDIAN
- 60% of the resources are 2,602 bytes or less,
- 70% of the resources are 4,445 bytes or less,
- 80% of the resources are 6,667 bytes or less,
- 90% of the resources are 13,268 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Ranges
- Less than 10 bytes: 3362 URLs (0.82 %)
- 10 to 100 bytes: 10572 URLs (2.6 %)
- 100 to 1000 bytes: 122724 URLs (30.1 %)
- 1 to 10 kbytes: 169670 URLs (41.6 %)
- 10 to 100 kbytes: 68006 URLs (16.7 %)
- 100 to 1000 kbytes: 26013 URLs (6.4 %)
- More than 1000 kbytes: 7197 URLs (1.77 %)
Most common media (MIME) types
- text/gemini: 319,352 URLs
- image/jpeg: 18,355 URLs
- image/png: 18,126 URLs
- text/plain: 15,905 URLs
- application/octet-stream: 12,693 URLs
- application/pdf: 4,368 URLs
- application/zip: 3,065 URLs
- image/gif: 3,034 URLs
- octet/stream: 2,217 URLs
- text/html: 1,976 URLs
- application/x-mscardfile: 1,198 URLs
- MIME: 997 URLs
- audio/mpeg: 878 URLs
- text/x-diff: 762 URLs
- application/json: 594 URLs
- audio/ogg: 326 URLs
- text/xml: 239 URLs
- application/atom+xml: 233 URLs
- image/webp: 231 URLs
- application/xml: 219 URLs
Most common languages
- Unspecified: 320,988 URLs
- en: 60,465 URLs
- de: 11,086 URLs
- it: 6,964 URLs
- fr: 3,291 URLs
- fi: 1,131 URLs
- ja: 1,110 URLs
- es_ar: 861 URLs
- ru: 441 URLs
- es: 316 URLs
- en_us: 209 URLs
- ko: 127 URLs
- gl: 120 URLs
- ca: 86 URLs
- sv: 59 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 29 URLs
- eo: 28 URLs
- hu: 22 URLs
- tok: 21 URLs
Most common language tags
- Unspecified: 320,943 URLs
- en: 33,493 URLs
- en-us: 13,249 URLs
- en-gb: 12,957 URLs
- de: 11,045 URLs
- it: 6,964 URLs
- fr: 2,431 URLs
- fi: 1,131 URLs
- ja: 1,110 URLs
- es_ar: 861 URLs
- fr-fr: 860 URLs
- en-ie: 471 URLs
- es-es: 305 URLs
- ru-ru: 304 URLs
- en-au: 261 URLs
- en_us: 209 URLs
- ru: 137 URLs
- ko: 127 URLs
- ca-es: 84 URLs
- gl: 66 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 368,152 URLs
- utf-8: 39,284 URLs
- us-ascii: 59 URLs
- gzip: 22 URLs
- binary: 16 URLs
- windows-1252: 2 URLs
- bzip2: 2 URLs
- cp437: 2 URLs
- u: 2 URLs
- utf-16: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 288,869 URLs
- utf-8: 30,476 URLs
- cp437: 2 URLs
- utf-16: 2 URLs
- windows-1252: 2 URLs
- iso-8859-1: 1 URLs
By the way, 1,291 of recently tested URLs (0.250 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 407,544 occurrences (84.95 %)
- 51 (Not found): 32,701 occurrences (6.82 %)
- 40 (Temporary failure): 6,374 occurrences (1.33 %)
- 60 (Client certificate request): 5,663 occurrences (1.18 %)
- 44 (Slow down): 5,523 occurrences (1.15 %)
- 30 (Temporary redirect): 5,177 occurrences (1.08 %)
- 10 (Input request): 4,943 occurrences (1.03 %)
- 42 (CGI error): 4,383 occurrences (0.91 %)
- 53 (Proxy request refused): 4,122 occurrences (0.86 %)
- 31 (Permanent redirect): 2,923 occurrences (0.61 %)
- 50 (Permanent failure): 124 occurrences (0.03 %)
- 59 (Bad request): 96 occurrences (0.02 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 259
Average number of incoming links: 0.20
Capsules
There are 3127 capsules. We successfully connected recently to 2349 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- blitter.com: 10000 URLs
- gemini.conman.org: 10000 URLs
- midnight.pub: 9999 URLs
- rwv.io: 9996 URLs
- gemini.techrights.org: 9996 URLs
- hoagie.space: 9993 URLs
- gemlog.stargrave.org: 9990 URLs
- taz.de: 9985 URLs
- mirrors.apple2.org.za: 9958 URLs
- caiofior.pollux.casa: 9766 URLs
- gemini.knusbaum.com: 9758 URLs
- mastogem.remorse.us: 9332 URLs
- gemini.omarpolo.com: 9112 URLs
- gemini.autonomy.earth: 8708 URLs
- news.tuxmachines.org: 8487 URLs
- ecs.d2evs.net: 8431 URLs
- gemini.tuxmachines.org: 8080 URLs
- mastogem.picasoft.net: 7886 URLs
- library.inu.red: 7835 URLs
- rawtext.club: 7734 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2771.8 megabytes
- uscoffings.net: 915.7 megabytes
- si3t.ch: 914.8 megabytes
- nytpu.com: 842.1 megabytes
- blitter.com: 824.1 megabytes
- gael.mooo.com: 666.5 megabytes
- yam655.com: 581.4 megabytes
- hoagie.space: 495.4 megabytes
- skyjake.fi: 396.6 megabytes
- jpfox.fr: 394.6 megabytes
- mikelynch.org: 315.2 megabytes
- ecs.d2evs.net: 286.7 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- tweek.zyxxyz.eu: 229.4 megabytes
- library.inu.red: 228.9 megabytes
- gem.librehacker.com: 191.1 megabytes
- shit.cx: 182.3 megabytes
- gemini.techrights.org: 174.4 megabytes
- phreedom.club: 174.2 megabytes
- rwv.io: 168.5 megabytes
- gem.girlmeow.autos: 165.5 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2079 (88.5 %) capsules are self-signed, 206 (8.8 %) use the Certificate Authority Let's Encrypt, 64 (2.7 %) are signed by another CA (may be not a trusted one).
68 capsules (2.91 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1518 capsules
- sha256WithRSAEncryption: 818 capsules
- ED25519: 14 capsules
- ecdsa-with-SHA512: 5 capsules
- ecdsa-with-SHA384: 2 capsules
- sha512WithRSAEncryption: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1549 capsules
- RSA: 797 capsules
- ED25519: 14 capsules
Key sizes for RSA:
- 2048: 524 capsules
- 4096: 259 capsules
- 3072: 9 capsules
- 512: 3 capsules
- 1024: 1 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1467 capsules
- 384: 80 capsules
- 521: 2 capsules
TLS
97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.
10.6 % of capsules do NOT send a proper close.
The full list
robots.txt
221 (9 %) the capsules have a robots.txt exclusion file.
Ports
13 working capsules (0.6 %) use an alternative port
Addresses
1185 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 752 vhosts
- 68.133.1.71: 262 vhosts
- 213.219.38.200: 200 vhosts
- 173.195.146.139: 98 vhosts
- 90.65.170.44: 28 vhosts
- 109.237.26.252: 19 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 104.245.33.223: 9 vhosts
- 52.51.189.88: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 139.162.187.208: 6 vhosts
- 51.222.161.16: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 178.209.50.237: 5 vhosts
- 89.253.220.199: 5 vhosts
- 64.226.23.78: 5 vhosts
- 37.79.202.136: 5 vhosts
- 46.23.94.99: 5 vhosts
TLDs
There are 244 TLDs in the capsule's names, and 1565 registered domains.
Most common TLDs
By number of registered domains
- com: 254 domains
- net: 136 domains
- org: 131 domains
- xyz: 103 domains
- space: 74 domains
- de: 44 domains
- dev: 41 domains
- site: 40 domains
- me: 40 domains
- eu: 27 domains
- fr: 24 domains
- io: 24 domains
- uk: 23 domains
- info: 22 domains
- club: 21 domains
- online: 16 domains
- ca: 14 domains
- ch: 14 domains
- se: 12 domains
- us: 11 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 766 capsules
- org: 426 capsules
- com: 305 capsules
- pub: 206 capsules
- net: 159 capsules
- xyz: 110 capsules
- space: 95 capsules
- de: 52 capsules
- club: 45 capsules
- dev: 43 capsules
- site: 42 capsules
- me: 42 capsules
- eu: 35 capsules
- casa: 34 capsules
- io: 32 capsules
- info: 27 capsules
- uk: 26 capsules
- fr: 26 capsules
- us: 19 capsules
- ca: 18 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule