💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2023-01-01.gmi captured on 2024-08-31 at 18:00:57. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-01-29)
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2022-12-31 19:04:02Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 499,366 URIs, 366,271 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 282,013 URIs serve a Gemini content.
Resources
The average size of the resources is 37,415 bytes.
Quantiles
- 10% of the resources are 195 bytes or less,
- 20% of the resources are 545 bytes or less,
- 30% of the resources are 850 bytes or less,
- 40% of the resources are 1,407 bytes or less,
- 50% of the resources are 2,509 bytes or less, MEDIAN
- 60% of the resources are 4,303 bytes or less,
- 70% of the resources are 6,456 bytes or less,
- 80% of the resources are 12,964 bytes or less,
- 90% of the resources are 50,073 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 123 bytes or less,
- 20% of the resources are 409 bytes or less,
- 30% of the resources are 690 bytes or less,
- 40% of the resources are 959 bytes or less,
- 50% of the resources are 1,527 bytes or less, MEDIAN
- 60% of the resources are 2,542 bytes or less,
- 70% of the resources are 4,169 bytes or less,
- 80% of the resources are 5,771 bytes or less,
- 90% of the resources are 10,470 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 1119 URLs (0.31 %)
- 10 to 100 bytes: 10187 URLs (2.8 %)
- 100 to 1000 bytes: 112113 URLs (30.6 %)
- 1 to 10 kbytes: 158025 URLs (43.1 %)
- 10 to 100 kbytes: 62355 URLs (17.0 %)
- 100 to 1000 kbytes: 16710 URLs (4.6 %)
- More than 1000 kbytes: 5762 URLs (1.57 %)
Most common media (MIME) types
- text/gemini: 282,012 URLs
- text/plain: 28,180 URLs
- image/jpeg: 16,847 URLs
- image/png: 15,010 URLs
- application/octet-stream: 5,276 URLs
- application/pdf: 3,537 URLs
- image/gif: 3,275 URLs
- octet/stream: 2,213 URLs
- text/html: 1,937 URLs
- application/zip: 1,281 URLs
- application/x-mscardfile: 1,198 URLs
- audio/mpeg: 776 URLs
- text/x-diff: 764 URLs
- application/json: 612 URLs
- image/webp: 298 URLs
- application/atom+xml: 209 URLs
- application/lagrange-fontpack+zip: 200 URLs
- audio/midi: 184 URLs
- audio/ogg: 182 URLs
- text/xml: 179 URLs
Most common languages
- Unspecified: 292,130 URLs
- en: 53,655 URLs
- de: 11,012 URLs
- fr: 5,693 URLs
- fi: 1,115 URLs
- ja: 526 URLs
- es_ar: 514 URLs
- es: 311 URLs
- ru: 309 URLs
- en_us: 152 URLs
- it: 131 URLs
- ko: 127 URLs
- pl: 101 URLs
- ca: 86 URLs
- sv: 58 URLs
- gl: 54 URLs
- sco,gd,it,en: 38 URLs
- eo: 28 URLs
- no: 26 URLs
- pl,en: 26 URLs
Most common language tags
- Unspecified: 292,086 URLs
- en: 29,081 URLs
- en-gb: 12,885 URLs
- de: 10,988 URLs
- en-us: 10,964 URLs
- fr: 5,116 URLs
- fi: 1,115 URLs
- fr-fr: 577 URLs
- ja: 526 URLs
- es_ar: 514 URLs
- en-ie: 461 URLs
- es-es: 299 URLs
- en-au: 233 URLs
- ru-ru: 176 URLs
- en_us: 152 URLs
- ru: 133 URLs
- it: 131 URLs
- ko: 127 URLs
- pl: 99 URLs
- ca-es: 84 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 327,896 URLs
- utf-8: 28,851 URLs
- us-ascii: 9,478 URLs
- binary: 21 URLs
- gzip: 13 URLs
- windows-1252: 2 URLs
- cp437: 2 URLs
- u: 2 URLs
- utf-16: 2 URLs
- iso-8859-1: 1 URLs
- bzip2: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 261,054 URLs
- utf-8: 20,951 URLs
- cp437: 2 URLs
- utf-16: 2 URLs
- windows-1252: 2 URLs
- iso-8859-1: 1 URLs
By the way, 2,417 of recently tested URLs (0.499 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 366,268 occurrences (85.92 %)
- 51 (Not found): 25,878 occurrences (6.07 %)
- 40 (Temporary failure): 6,343 occurrences (1.49 %)
- 60 (Client certificate request): 5,470 occurrences (1.28 %)
- 50 (Permanent failure): 4,960 occurrences (1.16 %)
- 30 (Temporary redirect): 4,677 occurrences (1.10 %)
- 44 (Slow down): 4,642 occurrences (1.09 %)
- 42 (CGI error): 3,986 occurrences (0.94 %)
- 10 (Input request): 2,062 occurrences (0.48 %)
- 31 (Permanent redirect): 1,561 occurrences (0.37 %)
- 59 (Bad request): 294 occurrences (0.07 %)
- 43 (Proxy error): 54 occurrences (0.01 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 241
Average number of incoming links: 0.19
Capsules
There are 2988 capsules. We successfully connected recently to 2251 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- midnight.pub: 10000 URLs
- gemini.conman.org: 9997 URLs
- blitter.com: 9995 URLs
- gemini.techrights.org: 9994 URLs
- jpfox.fr: 9994 URLs
- hoagie.space: 9990 URLs
- jsreed5.org: 9989 URLs
- gemini.spam.works: 9983 URLs
- gemini.thebackupbox.net: 9981 URLs
- taz.de: 9935 URLs
- library.inu.red: 9435 URLs
- gemini.omarpolo.com: 9109 URLs
- gemini.autonomy.earth: 8453 URLs
- gemini.knusbaum.com: 8413 URLs
- mastogem.picasoft.net: 8375 URLs
- ecs.d2evs.net: 8316 URLs
- rawtext.club: 7571 URLs
- circumlunar.thebackupbox.net: 6365 URLs
- caolan.uk: 6053 URLs
- godocs.io: 5652 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- si3t.ch: 1087.2 megabytes
- jpfox.fr: 1069.7 megabytes
- uscoffings.net: 895.1 megabytes
- blitter.com: 824.1 megabytes
- nytpu.com: 735.4 megabytes
- gael.mooo.com: 616.0 megabytes
- hoagie.space: 515.2 megabytes
- snowcode.ovh: 300.7 megabytes
- ecs.d2evs.net: 283.0 megabytes
- skyjake.fi: 273.2 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- gemini.spam.works: 197.3 megabytes
- shit.cx: 182.3 megabytes
- library.inu.red: 180.5 megabytes
- gemini.techrights.org: 174.2 megabytes
- gem.girlmeow.autos: 161.7 megabytes
- gemini.conman.org: 151.5 megabytes
- rawtext.club: 127.0 megabytes
- gemini.autonomy.earth: 121.3 megabytes
- gemini.circumlunar.space: 120.2 megabytes
- kota.nz: 120.1 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
1981 (88.0 %) capsules are self-signed, 200 (8.9 %) use the Certificate Authority Let's Encrypt, 70 (3.1 %) are signed by another CA (may be not a trusted one).
57 capsules (2.56 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1455 capsules
- sha256WithRSAEncryption: 772 capsules
- ED25519: 13 capsules
- ecdsa-with-SHA512: 5 capsules
- sha512WithRSAEncryption: 3 capsules
- ecdsa-with-SHA384: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1480 capsules
- RSA: 758 capsules
- ED25519: 13 capsules
Key sizes for RSA:
- 2048: 475 capsules
- 4096: 271 capsules
- 3072: 7 capsules
- 512: 3 capsules
- 1024: 1 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1394 capsules
- 384: 84 capsules
- 521: 2 capsules
TLS
97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.
5.6 % of capsules do NOT send a proper close.
The full list
robots.txt
223 (10 %) the capsules have a robots.txt exclusion file.
Ports
13 working capsules (0.6 %) use an alternative port
Addresses
1165 IP addresses used. 16 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 714 vhosts
- 68.133.1.71: 219 vhosts
- 213.219.38.200: 191 vhosts
- 173.195.146.139: 98 vhosts
- 90.65.170.44: 25 vhosts
- 109.237.26.252: 19 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 14 vhosts
- 104.245.33.223: 8 vhosts
- 52.51.189.88: 8 vhosts
- 135.181.153.189: 7 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 139.162.187.208: 6 vhosts
- 89.234.140.141: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 51.222.161.16: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 64.226.23.78: 6 vhosts
- 89.253.220.199: 5 vhosts
TLDs
There are 232 TLDs in the capsule's names, and 1519 registered domains.
Most common TLDs
By number of registered domains
- com: 244 domains
- net: 136 domains
- org: 126 domains
- xyz: 109 domains
- space: 67 domains
- de: 43 domains
- me: 38 domains
- dev: 38 domains
- site: 37 domains
- eu: 31 domains
- fr: 27 domains
- io: 25 domains
- info: 25 domains
- uk: 23 domains
- club: 19 domains
- ch: 14 domains
- ca: 13 domains
- se: 12 domains
- online: 12 domains
- us: 11 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 722 capsules
- org: 384 capsules
- com: 298 capsules
- pub: 199 capsules
- net: 161 capsules
- xyz: 119 capsules
- space: 86 capsules
- de: 52 capsules
- club: 43 capsules
- dev: 39 capsules
- me: 39 capsules
- site: 39 capsules
- eu: 38 capsules
- casa: 33 capsules
- info: 31 capsules
- io: 30 capsules
- fr: 29 capsules
- uk: 25 capsules
- ch: 18 capsules
- us: 18 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule