💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2023-04-19 at 22:23:17. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-03-20)
➡️ Next capture (2023-04-26)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-04-18 18:04:02Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 539,075 URIs, 391,470 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 307,606 URIs serve a Gemini content.
Resources
The average size of the resources is 42,899 bytes.
Quantiles
- 10% of the resources are 264 bytes or less,
- 20% of the resources are 622 bytes or less,
- 30% of the resources are 930 bytes or less,
- 40% of the resources are 1,520 bytes or less,
- 50% of the resources are 2,608 bytes or less, MEDIAN
- 60% of the resources are 4,670 bytes or less,
- 70% of the resources are 7,192 bytes or less,
- 80% of the resources are 15,755 bytes or less,
- 90% of the resources are 78,818 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 232 bytes or less,
- 20% of the resources are 494 bytes or less,
- 30% of the resources are 774 bytes or less,
- 40% of the resources are 1,105 bytes or less,
- 50% of the resources are 1,764 bytes or less, MEDIAN
- 60% of the resources are 2,768 bytes or less,
- 70% of the resources are 4,759 bytes or less,
- 80% of the resources are 6,668 bytes or less,
- 90% of the resources are 13,263 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Ranges
- Less than 10 bytes: 3552 URLs (0.91 %)
- 10 to 100 bytes: 10723 URLs (2.7 %)
- 100 to 1000 bytes: 109708 URLs (28.0 %)
- 1 to 10 kbytes: 170905 URLs (43.7 %)
- 10 to 100 kbytes: 64755 URLs (16.5 %)
- 100 to 1000 kbytes: 24768 URLs (6.3 %)
- More than 1000 kbytes: 7059 URLs (1.80 %)
Most common media (MIME) types
- text/gemini: 307,606 URLs
- image/png: 17,627 URLs
- image/jpeg: 16,408 URLs
- text/plain: 15,924 URLs
- application/octet-stream: 11,295 URLs
- application/pdf: 4,482 URLs
- application/zip: 3,098 URLs
- image/gif: 2,268 URLs
- octet/stream: 2,216 URLs
- text/html: 1,975 URLs
- application/x-mscardfile: 1,198 URLs
- audio/mpeg: 1,035 URLs
- MIME: 997 URLs
- text/x-diff: 779 URLs
- application/json: 598 URLs
- audio/ogg: 354 URLs
- text/xml: 241 URLs
- application/atom+xml: 238 URLs
- application/lagrange-fontpack+zip: 200 URLs
- image/webp: 198 URLs
Most common languages
- Unspecified: 306,777 URLs
- en: 60,396 URLs
- de: 11,097 URLs
- it: 7,026 URLs
- fr: 1,968 URLs
- fi: 1,109 URLs
- ja: 1,079 URLs
- ru: 847 URLs
- es: 334 URLs
- en_us: 212 URLs
- ko: 112 URLs
- ca: 86 URLs
- gl: 66 URLs
- sv: 60 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 29 URLs
- eo: 28 URLs
- hu: 23 URLs
- tok: 22 URLs
- it_it: 21 URLs
Most common language tags
- Unspecified: 306,733 URLs
- en: 33,138 URLs
- en-us: 13,376 URLs
- en-gb: 13,113 URLs
- de: 11,056 URLs
- it: 7,026 URLs
- fi: 1,109 URLs
- fr: 1,103 URLs
- ja: 1,079 URLs
- fr-fr: 865 URLs
- ru-ru: 711 URLs
- en-ie: 472 URLs
- es-es: 323 URLs
- en-au: 268 URLs
- en_us: 212 URLs
- ru: 136 URLs
- ko: 112 URLs
- ca-es: 84 URLs
- sv: 60 URLs
- gl-es: 54 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 351,099 URLs
- utf-8: 40,239 URLs
- us-ascii: 75 URLs
- binary: 23 URLs
- gzip: 23 URLs
- windows-1252: 2 URLs
- bzip2: 2 URLs
- cp437: 2 URLs
- u: 2 URLs
- utf-16: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 275,839 URLs
- utf-8: 31,760 URLs
- cp437: 2 URLs
- utf-16: 2 URLs
- windows-1252: 2 URLs
- iso-8859-1: 1 URLs
By the way, 1,234 of recently tested URLs (0.236 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 391,470 occurrences (83.19 %)
- 51 (Not found): 38,799 occurrences (8.24 %)
- 40 (Temporary failure): 9,605 occurrences (2.04 %)
- 60 (Client certificate request): 5,665 occurrences (1.20 %)
- 44 (Slow down): 5,420 occurrences (1.15 %)
- 30 (Temporary redirect): 5,279 occurrences (1.12 %)
- 42 (CGI error): 4,382 occurrences (0.93 %)
- 53 (Proxy request refused): 3,657 occurrences (0.78 %)
- 10 (Input request): 3,558 occurrences (0.76 %)
- 31 (Permanent redirect): 2,353 occurrences (0.50 %)
- 50 (Permanent failure): 127 occurrences (0.03 %)
- 59 (Bad request): 120 occurrences (0.03 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 262
Average number of incoming links: 0.20
Capsules
There are 3167 capsules. We successfully connected recently to 2366 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- blitter.com: 10000 URLs
- midnight.pub: 10000 URLs
- gemini.conman.org: 10000 URLs
- rwv.io: 9996 URLs
- taz.de: 9995 URLs
- jsreed5.org: 9994 URLs
- gemini.techrights.org: 9993 URLs
- hoagie.space: 9991 URLs
- gemlog.stargrave.org: 9980 URLs
- mirrors.apple2.org.za: 9958 URLs
- caiofior.pollux.casa: 9812 URLs
- gemini.knusbaum.com: 9753 URLs
- news.tuxmachines.org: 9476 URLs
- gemini.tuxmachines.org: 9263 URLs
- gemini.omarpolo.com: 9112 URLs
- gemini.autonomy.earth: 8803 URLs
- ecs.d2evs.net: 8457 URLs
- library.inu.red: 8442 URLs
- rawtext.club: 7772 URLs
- skyjake.fi: 6591 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2776.0 megabytes
- uscoffings.net: 915.7 megabytes
- nytpu.com: 873.9 megabytes
- blitter.com: 824.2 megabytes
- gael.mooo.com: 742.1 megabytes
- yam655.com: 584.6 megabytes
- hoagie.space: 483.7 megabytes
- skyjake.fi: 420.4 megabytes
- mikelynch.org: 315.7 megabytes
- ecs.d2evs.net: 287.3 megabytes
- si3t.ch: 251.7 megabytes
- library.inu.red: 247.2 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- tweek.zyxxyz.eu: 233.5 megabytes
- gem.librehacker.com: 224.5 megabytes
- shit.cx: 182.3 megabytes
- phreedom.club: 175.9 megabytes
- gemini.techrights.org: 174.3 megabytes
- rwv.io: 168.5 megabytes
- gem.girlmeow.autos: 165.5 megabytes
- gemini.zachdecook.com: 162.1 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2097 (88.6 %) capsules are self-signed, 206 (8.7 %) use the Certificate Authority Let's Encrypt, 63 (2.7 %) are signed by another CA (may be not a trusted one).
62 capsules (2.64 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1536 capsules
- sha256WithRSAEncryption: 824 capsules
- ED25519: 13 capsules
- ecdsa-with-SHA512: 5 capsules
- ecdsa-with-SHA384: 2 capsules
- sha512WithRSAEncryption: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1569 capsules
- RSA: 801 capsules
- ED25519: 13 capsules
Key sizes for RSA:
- 2048: 530 capsules
- 4096: 257 capsules
- 3072: 9 capsules
- 512: 3 capsules
- 1024: 1 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1488 capsules
- 384: 79 capsules
- 521: 2 capsules
TLS
97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.
9.1 % of capsules do NOT send a proper close.
The full list
robots.txt
223 (9 %) the capsules have a robots.txt exclusion file.
Ports
11 working capsules (0.5 %) use an alternative port
Addresses
1180 IP addresses used. 16 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 770 vhosts
- 68.133.1.71: 271 vhosts
- 213.219.38.200: 199 vhosts
- 173.195.146.139: 99 vhosts
- 90.65.170.44: 28 vhosts
- 109.237.26.252: 19 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 104.245.33.223: 9 vhosts
- 52.51.189.88: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 139.162.187.208: 6 vhosts
- 51.222.161.16: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 84.62.113.202: 5 vhosts
- 178.209.50.237: 5 vhosts
- 37.79.202.136: 5 vhosts
- 46.23.94.99: 5 vhosts
- 23.88.35.144: 5 vhosts
TLDs
There are 244 TLDs in the capsule's names, and 1580 registered domains.
Most common TLDs
By number of registered domains
- com: 262 domains
- net: 136 domains
- org: 128 domains
- xyz: 108 domains
- space: 73 domains
- de: 45 domains
- site: 42 domains
- dev: 40 domains
- me: 40 domains
- eu: 32 domains
- uk: 25 domains
- io: 24 domains
- info: 23 domains
- fr: 22 domains
- club: 18 domains
- online: 14 domains
- ca: 13 domains
- ch: 12 domains
- us: 12 domains
- ru: 12 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 783 capsules
- org: 435 capsules
- com: 318 capsules
- pub: 204 capsules
- net: 160 capsules
- xyz: 115 capsules
- space: 90 capsules
- de: 53 capsules
- site: 45 capsules
- me: 42 capsules
- dev: 41 capsules
- eu: 39 capsules
- club: 39 capsules
- casa: 35 capsules
- io: 32 capsules
- info: 30 capsules
- uk: 28 capsules
- fr: 23 capsules
- us: 19 capsules
- ru: 17 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule