💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2024-09-29 at 05:52:52. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2024-08-31)
➡️ Next capture (2024-12-17)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2024-09-29 03:04:01Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 625,145 URIs, 528,834 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 390,897 URIs serve a Gemini content.
Resources
The average size of the resources is 60,692 bytes.
Quantiles
- 10% of the resources are 265 bytes or less,
- 20% of the resources are 571 bytes or less,
- 30% of the resources are 1,002 bytes or less,
- 40% of the resources are 1,575 bytes or less,
- 50% of the resources are 2,625 bytes or less, MEDIAN
- 60% of the resources are 4,552 bytes or less,
- 70% of the resources are 7,118 bytes or less,
- 80% of the resources are 15,557 bytes or less,
- 90% of the resources are 75,590 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 232 bytes or less,
- 20% of the resources are 425 bytes or less,
- 30% of the resources are 748 bytes or less,
- 40% of the resources are 1,109 bytes or less,
- 50% of the resources are 1,725 bytes or less, MEDIAN
- 60% of the resources are 2,732 bytes or less,
- 70% of the resources are 4,583 bytes or less,
- 80% of the resources are 6,614 bytes or less,
- 90% of the resources are 11,422 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3263 URLs (0.62 %)
- 10 to 100 bytes: 15486 URLs (2.9 %)
- 100 to 1000 bytes: 139678 URLs (26.4 %)
- 1 to 10 kbytes: 242240 URLs (45.8 %)
- 10 to 100 kbytes: 80136 URLs (15.2 %)
- 100 to 1000 kbytes: 29138 URLs (5.5 %)
- More than 1000 kbytes: 18893 URLs (3.57 %)
Most common media (MIME) types
- text/gemini: 390,897 URLs
- text/plain: 32,385 URLs
- image/png: 25,530 URLs
- image/jpeg: 22,108 URLs
- application/pdf: 14,081 URLs
- application/octet-stream: 10,984 URLs
- text/x-go: 5,491 URLs
- image/svg+xml: 3,113 URLs
- application/zip: 3,079 URLs
- image/gif: 2,342 URLs
- octet/stream: 1,944 URLs
- application/x-mscardfile: 1,902 URLs
- text/html: 1,879 URLs
- audio/mpeg: 1,418 URLs
- text/xml: 1,309 URLs
- MIME: 996 URLs
- text/x-diff: 916 URLs
- text/markdown: 788 URLs
- application/json: 736 URLs
- application/javascript: 683 URLs
Most common languages
- Unspecified: 402,386 URLs
- en: 92,315 URLs
- de: 11,948 URLs
- it: 7,485 URLs
- fr: 6,396 URLs
- es: 2,472 URLs
- es_ar: 1,273 URLs
- fa: 903 URLs
- arb: 588 URLs
- ja: 584 URLs
- ru: 577 URLs
- en_gb: 353 URLs
- en_au: 240 URLs
- grc: 216 URLs
- pl: 214 URLs
- en_us: 201 URLs
- he: 140 URLs
- eo: 82 URLs
- sv: 82 URLs
- gl: 55 URLs
Most common language tags
- Unspecified: 402,337 URLs
- en: 37,139 URLs
- en-us: 30,821 URLs
- en-gb: 23,304 URLs
- de: 11,898 URLs
- it: 7,485 URLs
- fr: 5,555 URLs
- es-es: 1,712 URLs
- es_ar: 1,273 URLs
- fa: 903 URLs
- fr-fr: 841 URLs
- es: 722 URLs
- arb: 588 URLs
- ja: 584 URLs
- en-ie: 476 URLs
- en-ca: 417 URLs
- ru: 413 URLs
- en_gb: 353 URLs
- en_au: 240 URLs
- grc: 216 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 449,811 URLs
- utf-8: 78,855 URLs
- us-ascii: 99 URLs
- binary: 43 URLs
- gzip: 22 URLs
- iso-8859-1: 2 URLs
- bzip2: 2 URLs
Most common encodings for gemtext files only
- Unspecified: 329,077 URLs
- utf-8: 61,817 URLs
- iso-8859-1: 2 URLs
- us-ascii: 1 URLs
By the way, 416 of recently tested URLs (0.070 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 528,834 occurrences (91.72 %)
- 51 (Not found): 21,261 occurrences (3.69 %)
- 60 (Client certificate request): 6,156 occurrences (1.07 %)
- 40 (Temporary failure): 6,015 occurrences (1.04 %)
- 44 (Slow down): 4,673 occurrences (0.81 %)
- 10 (Input request): 4,386 occurrences (0.76 %)
- 30 (Temporary redirect): 3,064 occurrences (0.53 %)
- 42 (CGI error): 1,402 occurrences (0.24 %)
- 31 (Permanent redirect): 375 occurrences (0.07 %)
- 50 (Permanent failure): 180 occurrences (0.03 %)
- 59 (Bad request): 121 occurrences (0.02 %)
- 53 (Proxy request refused): 83 occurrences (0.01 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 319
Average number of incoming links: 0.29
Capsules
There are 4038 capsules. We successfully connected recently to 2880 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- gemini.tuxmachines.org: 10000 URLs
- midnight.pub: 10000 URLs
- gemini.techrights.org: 10000 URLs
- mirrors.apple2.org.za: 10000 URLs
- fumble-around.mediocregopher.com: 9999 URLs
- gemini.conman.org: 9999 URLs
- 1436.ninja: 9999 URLs
- hoagie.space: 9993 URLs
- library.inu.red: 9993 URLs
- gemlog.stargrave.org: 9990 URLs
- caiofior.pollux.casa: 9979 URLs
- gemini.autonomy.earth: 9973 URLs
- blitter.com: 9963 URLs
- tjp.lol: 9956 URLs
- gmi.noulin.net: 9950 URLs
- bbs.geminispace.org: 9929 URLs
- mozz.us:7070: 9924 URLs
- oracular.space: 9901 URLs
- taz.de: 9874 URLs
- gemini.knusbaum.com: 9752 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- 1436.ninja: 9588.6 megabytes
- mirrors.apple2.org.za: 2818.6 megabytes
- nytpu.com: 1806.2 megabytes
- gem.librehacker.com: 933.3 megabytes
- uscoffings.net: 924.7 megabytes
- librehacker.com: 862.7 megabytes
- gael.mooo.com: 751.1 megabytes
- blitter.com: 687.0 megabytes
- yam655.com: 598.3 megabytes
- dfdn.info: 593.2 megabytes
- hoagie.space: 498.8 megabytes
- jpfox.fr: 376.5 megabytes
- si3t.ch: 371.4 megabytes
- b2khgkvb2wn4avjshjp63kknsjwikgwff5dwwydldia6qwf4kdnueyad.onion: 363.0 megabytes
- gemini.omarpolo.com: 347.6 megabytes
- library.inu.red: 325.3 megabytes
- tweek.zyxxyz.eu: 310.1 megabytes
- ecs.d2evs.net: 289.3 megabytes
- going-flying.com: 239.7 megabytes
- canary.city: 239.2 megabytes
- gemi.dev: 226.3 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2584 (89.7 %) capsules are self-signed, 26 (0.9 %) use the Certificate Authority Let's Encrypt, 270 (9.4 %) are signed by another CA (may be not a trusted one).
74 capsules (2.58 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1774 capsules
- sha256WithRSAEncryption: 1002 capsules
- ecdsa-with-SHA384: 75 capsules
- ED25519: 19 capsules
- sha512WithRSAEncryption: 5 capsules
- ecdsa-with-SHA512: 3 capsules
Key types:
- ECDSA: 1854 capsules
- RSA: 1005 capsules
- ED25519: 19 capsules
Key sizes for RSA:
- 2048: 726 capsules
- 4096: 267 capsules
- 3072: 8 capsules
- 1024: 3 capsules
- 8192: 1 capsules
Key sizes for ECDSA:
- 256: 1792 capsules
- 384: 61 capsules
- 521: 1 capsules
TLS
97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.
robots.txt
296 (10 %) the capsules have a robots.txt exclusion file.
Ports
16 working capsules (0.6 %) use an alternative port
Addresses
1171 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 896 vhosts
- 72.65.51.74: 460 vhosts
- 213.219.38.200: 264 vhosts
- 46.23.81.157: 124 vhosts
- 2a03:6000:1813:1337::157: 99 vhosts
- 90.65.170.44: 32 vhosts
- 109.237.26.252: 31 vhosts
- 5.161.108.85: 29 vhosts
- 2a01:4ff:f0:4fb3::1: 29 vhosts
- 45.56.93.217: 19 vhosts
- 128.140.115.191: 13 vhosts
- 2a03:6000:6f67:624::99: 10 vhosts
- 212.71.248.87: 10 vhosts
- 2a01:4f8:c17:20f1::42: 9 vhosts
- 51.222.161.16: 9 vhosts
- 23.88.35.144: 9 vhosts
- 46.23.94.99: 9 vhosts
- 2001:8b0:1d97:eeca:3da5:94ce:b61e:ee69: 8 vhosts
- 81.187.234.86: 8 vhosts
- 143.244.212.63: 8 vhosts
TLDs
There are 255 TLDs in the capsule's names, and 1942 registered domains.
Most common TLDs
By number of registered domains
- com: 287 domains
- net: 173 domains
- org: 157 domains
- xyz: 141 domains
- space: 91 domains
- site: 63 domains
- dev: 58 domains
- de: 56 domains
- me: 47 domains
- eu: 38 domains
- uk: 34 domains
- fr: 33 domains
- info: 26 domains
- io: 24 domains
- club: 22 domains
- ru: 17 domains
- se: 16 domains
- onion: 16 domains
- online: 16 domains
- ca: 16 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 904 capsules
- org: 666 capsules
- com: 352 capsules
- pub: 277 capsules
- net: 202 capsules
- xyz: 158 capsules
- space: 108 capsules
- site: 66 capsules
- de: 65 capsules
- dev: 64 capsules
- cc: 50 capsules
- me: 48 capsules
- club: 48 capsules
- eu: 48 capsules
- casa: 41 capsules
- uk: 37 capsules
- fr: 36 capsules
- info: 34 capsules
- io: 31 capsules
- ru: 22 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule