💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2023-06-01.gmi captured on 2024-06-16 at 12:38:56. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-06-16)
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-05-31 00:04:02Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 516,960 URIs, 404,243 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 309,520 URIs serve a Gemini content.
Resources
The average size of the resources is 44,095 bytes.
Quantiles
- 10% of the resources are 279 bytes or less,
- 20% of the resources are 646 bytes or less,
- 30% of the resources are 974 bytes or less,
- 40% of the resources are 1,636 bytes or less,
- 50% of the resources are 2,736 bytes or less, MEDIAN
- 60% of the resources are 4,955 bytes or less,
- 70% of the resources are 7,275 bytes or less,
- 80% of the resources are 16,476 bytes or less,
- 90% of the resources are 82,896 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 236 bytes or less,
- 20% of the resources are 496 bytes or less,
- 30% of the resources are 773 bytes or less,
- 40% of the resources are 1,094 bytes or less,
- 50% of the resources are 1,730 bytes or less, MEDIAN
- 60% of the resources are 2,690 bytes or less,
- 70% of the resources are 4,567 bytes or less,
- 80% of the resources are 6,576 bytes or less,
- 90% of the resources are 11,779 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Ranges
- Less than 10 bytes: 3214 URLs (0.80 %)
- 10 to 100 bytes: 9456 URLs (2.3 %)
- 100 to 1000 bytes: 110843 URLs (27.4 %)
- 1 to 10 kbytes: 177554 URLs (43.9 %)
- 10 to 100 kbytes: 70165 URLs (17.4 %)
- 100 to 1000 kbytes: 25484 URLs (6.3 %)
- More than 1000 kbytes: 7526 URLs (1.86 %)
Most common media (MIME) types
- text/gemini: 309,519 URLs
- text/plain: 23,796 URLs
- image/jpeg: 20,155 URLs
- image/png: 18,714 URLs
- application/octet-stream: 9,143 URLs
- application/pdf: 4,535 URLs
- application/zip: 3,100 URLs
- octet/stream: 2,211 URLs
- image/gif: 2,166 URLs
- text/html: 1,890 URLs
- audio/mpeg: 1,240 URLs
- application/x-mscardfile: 1,198 URLs
- MIME: 998 URLs
- text/x-diff: 785 URLs
- application/json: 600 URLs
- audio/ogg: 386 URLs
- image/webp: 321 URLs
- text/xml: 267 URLs
- application/atom+xml: 247 URLs
- application/lagrange-fontpack+zip: 200 URLs
Most common languages
- Unspecified: 315,129 URLs
- en: 61,607 URLs
- de: 11,085 URLs
- it: 7,119 URLs
- fr: 3,748 URLs
- ja: 1,112 URLs
- fi: 1,106 URLs
- es_ar: 908 URLs
- ru: 853 URLs
- es: 335 URLs
- en_gb: 252 URLs
- en_us: 216 URLs
- gl: 124 URLs
- pl: 104 URLs
- ko: 97 URLs
- ca: 84 URLs
- sv: 63 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 29 URLs
- eo: 28 URLs
Most common language tags
- Unspecified: 315,084 URLs
- en: 33,898 URLs
- en-us: 13,835 URLs
- en-gb: 13,075 URLs
- de: 11,052 URLs
- it: 7,119 URLs
- fr: 3,058 URLs
- ja: 1,112 URLs
- fi: 1,106 URLs
- es_ar: 908 URLs
- ru-ru: 715 URLs
- fr-fr: 690 URLs
- en-ie: 472 URLs
- es-es: 324 URLs
- en-au: 293 URLs
- en_gb: 252 URLs
- en_us: 216 URLs
- ru: 138 URLs
- pl: 101 URLs
- ko: 97 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 362,520 URLs
- utf-8: 33,273 URLs
- us-ascii: 8,389 URLs
- binary: 26 URLs
- gzip: 23 URLs
- windows-1252: 2 URLs
- bzip2: 2 URLs
- cp437: 2 URLs
- u: 2 URLs
- utf-16: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 284,523 URLs
- utf-8: 24,989 URLs
- cp437: 2 URLs
- utf-16: 2 URLs
- windows-1252: 2 URLs
- iso-8859-1: 1 URLs
By the way, 2,230 of recently tested URLs (0.454 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 404,242 occurrences (85.71 %)
- 51 (Not found): 19,859 occurrences (4.21 %)
- 40 (Temporary failure): 12,451 occurrences (2.64 %)
- 50 (Permanent failure): 6,099 occurrences (1.29 %)
- 60 (Client certificate request): 5,672 occurrences (1.20 %)
- 30 (Temporary redirect): 5,263 occurrences (1.12 %)
- 44 (Slow down): 5,041 occurrences (1.07 %)
- 42 (CGI error): 4,379 occurrences (0.93 %)
- 10 (Input request): 3,990 occurrences (0.85 %)
- 53 (Proxy request refused): 2,990 occurrences (0.63 %)
- 31 (Permanent redirect): 1,364 occurrences (0.29 %)
- 59 (Bad request): 145 occurrences (0.03 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 271
Average number of incoming links: 0.23
Capsules
There are 3249 capsules. We successfully connected recently to 2415 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- gemini.techrights.org: 10000 URLs
- gemini.conman.org: 10000 URLs
- midnight.pub: 10000 URLs
- rwv.io: 9996 URLs
- blitter.com: 9996 URLs
- jsreed5.org: 9995 URLs
- hoagie.space: 9994 URLs
- news.tuxmachines.org: 9992 URLs
- gemini.tuxmachines.org: 9990 URLs
- gemlog.stargrave.org: 9989 URLs
- caiofior.pollux.casa: 9988 URLs
- taz.de: 9986 URLs
- mirrors.apple2.org.za: 9980 URLs
- gemini.knusbaum.com: 9751 URLs
- library.inu.red: 9441 URLs
- gemini.omarpolo.com: 9048 URLs
- gemini.autonomy.earth: 8953 URLs
- spam.works: 8891 URLs
- ecs.d2evs.net: 8507 URLs
- rawtext.club: 7908 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2791.5 megabytes
- nytpu.com: 931.8 megabytes
- uscoffings.net: 915.7 megabytes
- blitter.com: 824.1 megabytes
- gael.mooo.com: 747.9 megabytes
- yam655.com: 596.2 megabytes
- skyjake.fi: 502.0 megabytes
- hoagie.space: 495.8 megabytes
- gem.librehacker.com: 407.4 megabytes
- gemini.zachdecook.com: 322.8 megabytes
- mikelynch.org: 315.7 megabytes
- ecs.d2evs.net: 289.2 megabytes
- jpfox.fr: 281.4 megabytes
- library.inu.red: 273.3 megabytes
- tweek.zyxxyz.eu: 238.8 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- shit.cx: 182.3 megabytes
- phreedom.club: 176.0 megabytes
- gemini.techrights.org: 174.4 megabytes
- rwv.io: 168.5 megabytes
- gem.girlmeow.autos: 165.5 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2147 (88.9 %) capsules are self-signed, 211 (8.7 %) use the Certificate Authority Let's Encrypt, 57 (2.4 %) are signed by another CA (may be not a trusted one).
62 capsules (2.58 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1560 capsules
- sha256WithRSAEncryption: 833 capsules
- ED25519: 13 capsules
- ecdsa-with-SHA512: 4 capsules
- ecdsa-with-SHA384: 2 capsules
- sha512WithRSAEncryption: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1588 capsules
- RSA: 814 capsules
- ED25519: 13 capsules
Key sizes for RSA:
- 2048: 554 capsules
- 4096: 248 capsules
- 3072: 9 capsules
- 1024: 2 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1514 capsules
- 384: 73 capsules
- 521: 1 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
4.9 % of capsules do NOT send a proper close.
The full list
robots.txt
236 (10 %) the capsules have a robots.txt exclusion file.
Ports
11 working capsules (0.5 %) use an alternative port
Addresses
1152 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 786 vhosts
- 68.133.1.71: 287 vhosts
- 213.219.38.200: 204 vhosts
- 173.195.146.139: 100 vhosts
- 90.65.170.44: 28 vhosts
- 109.237.26.252: 20 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 52.51.189.88: 8 vhosts
- 104.245.33.223: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 89.234.140.141: 6 vhosts
- 51.222.161.16: 6 vhosts
- 139.162.187.208: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 89.253.220.199: 5 vhosts
- 178.209.50.237: 5 vhosts
- 37.79.202.136: 5 vhosts
TLDs
There are 264 TLDs in the capsule's names, and 1629 registered domains.
Most common TLDs
By number of registered domains
- com: 249 domains
- net: 142 domains
- org: 139 domains
- xyz: 108 domains
- space: 74 domains
- de: 49 domains
- site: 44 domains
- dev: 42 domains
- me: 42 domains
- eu: 31 domains
- fr: 29 domains
- uk: 28 domains
- info: 23 domains
- io: 21 domains
- club: 20 domains
- online: 17 domains
- ca: 14 domains
- ch: 14 domains
- se: 13 domains
- us: 12 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 799 capsules
- org: 460 capsules
- com: 296 capsules
- pub: 212 capsules
- net: 164 capsules
- xyz: 116 capsules
- space: 95 capsules
- de: 53 capsules
- site: 49 capsules
- dev: 44 capsules
- club: 43 capsules
- me: 43 capsules
- eu: 37 capsules
- casa: 35 capsules
- fr: 32 capsules
- uk: 31 capsules
- info: 30 capsules
- io: 27 capsules
- us: 21 capsules
- ch: 19 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule