💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2023-09-08 at 15:49:42. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-07-22)
➡️ Next capture (2023-09-28)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-09-06 08:27:15Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 580,205 URIs, 461,837 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 359,565 URIs serve a Gemini content.
Resources
The average size of the resources is 41,876 bytes.
Quantiles
- 10% of the resources are 287 bytes or less,
- 20% of the resources are 611 bytes or less,
- 30% of the resources are 985 bytes or less,
- 40% of the resources are 1,670 bytes or less,
- 50% of the resources are 2,790 bytes or less, MEDIAN
- 60% of the resources are 5,174 bytes or less,
- 70% of the resources are 8,054 bytes or less,
- 80% of the resources are 17,905 bytes or less,
- 90% of the resources are 59,752 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 254 bytes or less,
- 20% of the resources are 494 bytes or less,
- 30% of the resources are 798 bytes or less,
- 40% of the resources are 1,179 bytes or less,
- 50% of the resources are 1,913 bytes or less, MEDIAN
- 60% of the resources are 3,010 bytes or less,
- 70% of the resources are 5,274 bytes or less,
- 80% of the resources are 7,497 bytes or less,
- 90% of the resources are 16,843 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3226 URLs (0.70 %)
- 10 to 100 bytes: 10363 URLs (2.2 %)
- 100 to 1000 bytes: 126367 URLs (27.4 %)
- 1 to 10 kbytes: 195873 URLs (42.4 %)
- 10 to 100 kbytes: 92895 URLs (20.1 %)
- 100 to 1000 kbytes: 25084 URLs (5.4 %)
- More than 1000 kbytes: 8029 URLs (1.74 %)
Most common media (MIME) types
- text/gemini: 359,565 URLs
- text/plain: 29,173 URLs
- image/jpeg: 19,536 URLs
- image/png: 19,059 URLs
- application/octet-stream: 9,574 URLs
- application/pdf: 4,787 URLs
- application/zip: 3,157 URLs
- octet/stream: 2,215 URLs
- image/gif: 2,008 URLs
- text/html: 1,885 URLs
- audio/mpeg: 1,287 URLs
- application/x-mscardfile: 1,199 URLs
- MIME: 1,041 URLs
- text/x-diff: 885 URLs
- application/json: 695 URLs
- text/markdown: 694 URLs
- application/atom+xml: 534 URLs
- text/xml: 494 URLs
- audio/ogg: 400 URLs
- image/webp: 312 URLs
Most common languages
- Unspecified: 366,532 URLs
- en: 64,358 URLs
- de: 11,157 URLs
- fr: 7,143 URLs
- it: 7,132 URLs
- es: 1,495 URLs
- es_ar: 1,172 URLs
- ja: 1,025 URLs
- ru: 517 URLs
- en_gb: 311 URLs
- en_us: 221 URLs
- pl: 150 URLs
- ko: 97 URLs
- ca: 86 URLs
- sv: 68 URLs
- gl: 54 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 31 URLs
- eo: 27 URLs
- en,he: 27 URLs
Most common language tags
- Unspecified: 366,487 URLs
- en: 35,843 URLs
- en-us: 14,882 URLs
- en-gb: 12,950 URLs
- de: 11,096 URLs
- it: 7,132 URLs
- fr: 6,205 URLs
- es-es: 1,469 URLs
- es_ar: 1,172 URLs
- ja: 1,025 URLs
- fr-fr: 938 URLs
- en-ie: 473 URLs
- ru-ru: 384 URLs
- en_gb: 311 URLs
- en_us: 221 URLs
- ru: 133 URLs
- pl: 105 URLs
- en-au: 104 URLs
- ko: 97 URLs
- ca-es: 84 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 405,352 URLs
- utf-8: 46,974 URLs
- us-ascii: 9,464 URLs
- gzip: 24 URLs
- binary: 20 URLs
- bzip2: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 322,082 URLs
- utf-8: 37,482 URLs
- iso-8859-1: 1 URLs
By the way, 1,295 of recently tested URLs (0.236 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 461,837 occurrences (88.51 %)
- 51 (Not found): 19,072 occurrences (3.66 %)
- 40 (Temporary failure): 12,770 occurrences (2.45 %)
- 50 (Permanent failure): 9,752 occurrences (1.87 %)
- 60 (Client certificate request): 5,661 occurrences (1.08 %)
- 53 (Proxy request refused): 5,000 occurrences (0.96 %)
- 10 (Input request): 3,896 occurrences (0.75 %)
- 30 (Temporary redirect): 1,317 occurrences (0.25 %)
- 42 (CGI error): 1,281 occurrences (0.25 %)
- 31 (Permanent redirect): 741 occurrences (0.14 %)
- 59 (Bad request): 346 occurrences (0.07 %)
- 43 (Proxy error): 55 occurrences (0.01 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 279
Average number of incoming links: 0.19
Capsules
There are 3488 capsules. We successfully connected recently to 2520 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- midnight.pub: 10000 URLs
- blitter.com: 10000 URLs
- gemini.techrights.org: 9999 URLs
- gemini.conman.org: 9999 URLs
- gemlog.stargrave.org: 9999 URLs
- gemini.tuxmachines.org: 9998 URLs
- mirrors.apple2.org.za: 9997 URLs
- news.tuxmachines.org: 9996 URLs
- rwv.io: 9996 URLs
- jsreed5.org: 9995 URLs
- hoagie.space: 9992 URLs
- caiofior.pollux.casa: 9989 URLs
- taz.de: 9979 URLs
- spam.works: 9973 URLs
- gemini.omarpolo.com: 9939 URLs
- gemini.knusbaum.com: 9753 URLs
- gemini.unlimited.pizza: 9750 URLs
- mastogem.remorse.us: 9441 URLs
- gemini.thegonz.net: 9323 URLs
- gemini.autonomy.earth: 8909 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2801.8 megabytes
- nytpu.com: 1052.9 megabytes
- uscoffings.net: 924.9 megabytes
- blitter.com: 824.2 megabytes
- gael.mooo.com: 755.4 megabytes
- gem.librehacker.com: 710.5 megabytes
- yam655.com: 598.3 megabytes
- hoagie.space: 499.3 megabytes
- skyjake.fi: 477.7 megabytes
- jpfox.fr: 456.9 megabytes
- gemini.omarpolo.com: 389.7 megabytes
- gemini.zachdecook.com: 337.1 megabytes
- ecs.d2evs.net: 293.5 megabytes
- tweek.zyxxyz.eu: 247.2 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- gemini.thegonz.net: 190.6 megabytes
- shit.cx: 182.3 megabytes
- phreedom.club: 178.2 megabytes
- higeki.jp: 176.6 megabytes
- gemini.techrights.org: 174.4 megabytes
- rwv.io: 168.6 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2251 (89.3 %) capsules are self-signed, 213 (8.5 %) use the Certificate Authority Let's Encrypt, 56 (2.2 %) are signed by another CA (may be not a trusted one).
63 capsules (2.51 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1625 capsules
- sha256WithRSAEncryption: 889 capsules
- ED25519: 16 capsules
- ecdsa-with-SHA512: 4 capsules
- sha512WithRSAEncryption: 2 capsules
- ecdsa-with-SHA384: 1 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1662 capsules
- RSA: 860 capsules
- ED25519: 16 capsules
Key sizes for RSA:
- 2048: 592 capsules
- 4096: 253 capsules
- 3072: 11 capsules
- 1024: 3 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1583 capsules
- 384: 77 capsules
- 521: 2 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
robots.txt
248 (10 %) the capsules have a robots.txt exclusion file.
Ports
11 working capsules (0.4 %) use an alternative port
Addresses
1155 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 807 vhosts
- 68.133.1.71: 329 vhosts
- 213.219.38.200: 217 vhosts
- 173.195.146.139: 102 vhosts
- 90.65.170.44: 29 vhosts
- 109.237.26.252: 22 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 128.140.115.191: 11 vhosts
- 104.245.33.223: 9 vhosts
- 51.222.161.16: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 139.162.187.208: 6 vhosts
- 89.234.140.141: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 68.183.213.240: 5 vhosts
- 89.253.220.199: 5 vhosts
- 37.79.202.136: 5 vhosts
TLDs
There are 260 TLDs in the capsule's names, and 1742 registered domains.
Most common TLDs
By number of registered domains
- com: 277 domains
- net: 151 domains
- org: 145 domains
- xyz: 119 domains
- space: 80 domains
- de: 51 domains
- dev: 50 domains
- site: 47 domains
- me: 43 domains
- eu: 32 domains
- fr: 31 domains
- uk: 29 domains
- io: 26 domains
- info: 23 domains
- club: 23 domains
- online: 16 domains
- se: 15 domains
- ch: 14 domains
- ca: 14 domains
- ru: 13 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 819 capsules
- org: 515 capsules
- com: 340 capsules
- pub: 225 capsules
- net: 177 capsules
- xyz: 131 capsules
- space: 105 capsules
- de: 59 capsules
- dev: 53 capsules
- site: 50 capsules
- club: 47 capsules
- me: 45 capsules
- eu: 40 capsules
- casa: 36 capsules
- io: 35 capsules
- fr: 33 capsules
- uk: 32 capsules
- info: 30 capsules
- us: 20 capsules
- ru: 18 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule