💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2023-09-01.gmi captured on 2024-05-12 at 19:00:46. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-09-28)
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-09-01 03:04:01Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 578,913 URIs, 469,257 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 367,172 URIs serve a Gemini content.
Resources
The average size of the resources is 41,308 bytes.
Quantiles
- 10% of the resources are 307 bytes or less,
- 20% of the resources are 655 bytes or less,
- 30% of the resources are 1,019 bytes or less,
- 40% of the resources are 1,698 bytes or less,
- 50% of the resources are 2,695 bytes or less, MEDIAN
- 60% of the resources are 5,017 bytes or less,
- 70% of the resources are 7,851 bytes or less,
- 80% of the resources are 17,628 bytes or less,
- 90% of the resources are 59,442 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 269 bytes or less,
- 20% of the resources are 540 bytes or less,
- 30% of the resources are 827 bytes or less,
- 40% of the resources are 1,222 bytes or less,
- 50% of the resources are 1,941 bytes or less, MEDIAN
- 60% of the resources are 2,889 bytes or less,
- 70% of the resources are 5,125 bytes or less,
- 80% of the resources are 7,347 bytes or less,
- 90% of the resources are 16,727 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3229 URLs (0.69 %)
- 10 to 100 bytes: 10357 URLs (2.2 %)
- 100 to 1000 bytes: 125499 URLs (26.7 %)
- 1 to 10 kbytes: 203612 URLs (43.4 %)
- 10 to 100 kbytes: 93403 URLs (19.9 %)
- 100 to 1000 kbytes: 25142 URLs (5.4 %)
- More than 1000 kbytes: 8015 URLs (1.71 %)
Most common media (MIME) types
- text/gemini: 367,172 URLs
- text/plain: 29,099 URLs
- image/jpeg: 19,583 URLs
- image/png: 19,111 URLs
- application/octet-stream: 9,618 URLs
- application/pdf: 4,785 URLs
- application/zip: 3,122 URLs
- octet/stream: 2,215 URLs
- image/gif: 2,007 URLs
- text/html: 1,953 URLs
- audio/mpeg: 1,280 URLs
- application/x-mscardfile: 1,199 URLs
- MIME: 1,041 URLs
- text/x-diff: 881 URLs
- application/json: 695 URLs
- application/atom+xml: 532 URLs
- text/xml: 497 URLs
- text/markdown: 454 URLs
- audio/ogg: 400 URLs
- image/webp: 310 URLs
Most common languages
- Unspecified: 373,833 URLs
- en: 64,316 URLs
- de: 11,171 URLs
- fr: 7,182 URLs
- it: 7,106 URLs
- es: 1,495 URLs
- es_ar: 1,172 URLs
- ja: 1,102 URLs
- ru: 518 URLs
- en_gb: 365 URLs
- en_us: 221 URLs
- pl: 150 URLs
- ko: 97 URLs
- ca: 86 URLs
- sv: 67 URLs
- gl: 54 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 30 URLs
- eo: 28 URLs
- en,he: 27 URLs
Most common language tags
- Unspecified: 373,788 URLs
- en: 35,845 URLs
- en-us: 14,900 URLs
- en-gb: 12,897 URLs
- de: 11,110 URLs
- it: 7,106 URLs
- fr: 6,242 URLs
- es-es: 1,469 URLs
- es_ar: 1,172 URLs
- ja: 1,102 URLs
- fr-fr: 940 URLs
- en-ie: 473 URLs
- ru-ru: 384 URLs
- en_gb: 365 URLs
- en_us: 221 URLs
- ru: 134 URLs
- pl: 105 URLs
- en-au: 104 URLs
- ko: 97 URLs
- ca-es: 84 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 410,855 URLs
- utf-8: 48,889 URLs
- us-ascii: 9,466 URLs
- gzip: 24 URLs
- binary: 20 URLs
- bzip2: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 327,691 URLs
- utf-8: 39,480 URLs
- iso-8859-1: 1 URLs
By the way, 1,291 of recently tested URLs (0.236 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 469,257 occurrences (91.00 %)
- 51 (Not found): 17,938 occurrences (3.48 %)
- 40 (Temporary failure): 12,660 occurrences (2.46 %)
- 60 (Client certificate request): 5,655 occurrences (1.10 %)
- 53 (Proxy request refused): 4,938 occurrences (0.96 %)
- 10 (Input request): 1,726 occurrences (0.33 %)
- 30 (Temporary redirect): 1,327 occurrences (0.26 %)
- 42 (CGI error): 1,250 occurrences (0.24 %)
- 59 (Bad request): 346 occurrences (0.07 %)
- 31 (Permanent redirect): 209 occurrences (0.04 %)
- 50 (Permanent failure): 199 occurrences (0.04 %)
- 44 (Slow down): 61 occurrences (0.01 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 278
Average number of incoming links: 0.18
Capsules
There are 3477 capsules. We successfully connected recently to 2519 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- blitter.com: 10000 URLs
- midnight.pub: 10000 URLs
- gemlog.stargrave.org: 10000 URLs
- gemini.techrights.org: 9999 URLs
- gemini.conman.org: 9999 URLs
- gemini.tuxmachines.org: 9998 URLs
- mirrors.apple2.org.za: 9998 URLs
- rwv.io: 9996 URLs
- news.tuxmachines.org: 9996 URLs
- jsreed5.org: 9995 URLs
- taz.de: 9993 URLs
- hoagie.space: 9992 URLs
- spam.works: 9973 URLs
- gemini.omarpolo.com: 9970 URLs
- caiofior.pollux.casa: 9948 URLs
- gemini.knusbaum.com: 9752 URLs
- gemini.unlimited.pizza: 9750 URLs
- nvdsli2ogtm7cgmftm3b7rdcx3tahozjsntjhl3oknuwfdcjk56n5qqd.onion: 9671 URLs
- gemini.thegonz.net: 9580 URLs
- mastogem.remorse.us: 9451 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2801.9 megabytes
- nytpu.com: 1048.8 megabytes
- uscoffings.net: 924.9 megabytes
- blitter.com: 824.2 megabytes
- gael.mooo.com: 753.3 megabytes
- gem.librehacker.com: 702.1 megabytes
- yam655.com: 598.3 megabytes
- hoagie.space: 499.0 megabytes
- skyjake.fi: 494.7 megabytes
- jpfox.fr: 460.3 megabytes
- gemini.omarpolo.com: 391.1 megabytes
- gemini.zachdecook.com: 337.1 megabytes
- ecs.d2evs.net: 293.1 megabytes
- tweek.zyxxyz.eu: 252.4 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- gemini.thegonz.net: 195.8 megabytes
- shit.cx: 182.3 megabytes
- phreedom.club: 178.2 megabytes
- higeki.jp: 176.6 megabytes
- gemini.techrights.org: 174.4 megabytes
- rwv.io: 168.6 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2251 (89.4 %) capsules are self-signed, 212 (8.4 %) use the Certificate Authority Let's Encrypt, 56 (2.2 %) are signed by another CA (may be not a trusted one).
64 capsules (2.55 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1619 capsules
- sha256WithRSAEncryption: 889 capsules
- ED25519: 17 capsules
- ecdsa-with-SHA512: 4 capsules
- sha512WithRSAEncryption: 2 capsules
- ecdsa-with-SHA384: 1 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1655 capsules
- RSA: 861 capsules
- ED25519: 17 capsules
Key sizes for RSA:
- 2048: 593 capsules
- 4096: 253 capsules
- 3072: 11 capsules
- 1024: 3 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1576 capsules
- 384: 77 capsules
- 521: 2 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
robots.txt
249 (10 %) the capsules have a robots.txt exclusion file.
Ports
11 working capsules (0.4 %) use an alternative port
Addresses
1160 IP addresses used. 18 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 805 vhosts
- 68.133.1.71: 329 vhosts
- 213.219.38.200: 217 vhosts
- 173.195.146.139: 102 vhosts
- 90.65.170.44: 29 vhosts
- 109.237.26.252: 22 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 128.140.115.191: 11 vhosts
- 104.245.33.223: 9 vhosts
- 51.222.161.16: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 139.162.187.208: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 89.234.140.141: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 68.183.213.240: 5 vhosts
- 89.253.220.199: 5 vhosts
- 46.23.94.99: 5 vhosts
TLDs
There are 260 TLDs in the capsule's names, and 1736 registered domains.
Most common TLDs
By number of registered domains
- com: 277 domains
- net: 151 domains
- org: 145 domains
- xyz: 119 domains
- space: 79 domains
- de: 51 domains
- dev: 50 domains
- site: 47 domains
- me: 43 domains
- eu: 32 domains
- fr: 31 domains
- uk: 29 domains
- io: 25 domains
- info: 23 domains
- club: 22 domains
- online: 16 domains
- se: 15 domains
- ch: 14 domains
- ca: 14 domains
- ru: 13 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 817 capsules
- org: 515 capsules
- com: 340 capsules
- pub: 225 capsules
- net: 177 capsules
- xyz: 130 capsules
- space: 104 capsules
- de: 59 capsules
- dev: 53 capsules
- site: 50 capsules
- club: 46 capsules
- me: 45 capsules
- eu: 40 capsules
- casa: 36 capsules
- io: 34 capsules
- fr: 33 capsules
- uk: 32 capsules
- info: 30 capsules
- us: 20 capsules
- ru: 18 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule