💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2023-03-01.gmi captured on 2023-09-28 at 23:31:38. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-03-21)
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-03-01 01:04:02Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 509,801 URIs, 391,236 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 311,201 URIs serve a Gemini content.
Resources
The average size of the resources is 38,487 bytes.
Quantiles
- 10% of the resources are 270 bytes or less,
- 20% of the resources are 584 bytes or less,
- 30% of the resources are 878 bytes or less,
- 40% of the resources are 1,425 bytes or less,
- 50% of the resources are 2,509 bytes or less, MEDIAN
- 60% of the resources are 4,370 bytes or less,
- 70% of the resources are 6,671 bytes or less,
- 80% of the resources are 12,002 bytes or less,
- 90% of the resources are 53,383 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 238 bytes or less,
- 20% of the resources are 467 bytes or less,
- 30% of the resources are 731 bytes or less,
- 40% of the resources are 1,029 bytes or less,
- 50% of the resources are 1,646 bytes or less, MEDIAN
- 60% of the resources are 2,654 bytes or less,
- 70% of the resources are 4,462 bytes or less,
- 80% of the resources are 6,307 bytes or less,
- 90% of the resources are 10,384 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3540 URLs (0.90 %)
- 10 to 100 bytes: 9915 URLs (2.5 %)
- 100 to 1000 bytes: 115800 URLs (29.6 %)
- 1 to 10 kbytes: 174613 URLs (44.6 %)
- 10 to 100 kbytes: 61605 URLs (15.7 %)
- 100 to 1000 kbytes: 19301 URLs (4.9 %)
- More than 1000 kbytes: 6462 URLs (1.65 %)
Most common media (MIME) types
- text/gemini: 311,201 URLs
- image/jpeg: 21,964 URLs
- image/png: 18,392 URLs
- text/plain: 15,037 URLs
- application/octet-stream: 4,796 URLs
- application/pdf: 3,646 URLs
- image/gif: 3,270 URLs
- octet/stream: 2,215 URLs
- text/html: 1,888 URLs
- application/zip: 1,266 URLs
- application/x-mscardfile: 1,198 URLs
- audio/mpeg: 960 URLs
- text/x-diff: 771 URLs
- application/json: 589 URLs
- image/webp: 352 URLs
- audio/ogg: 307 URLs
- application/xml: 274 URLs
- text/xml: 223 URLs
- application/atom+xml: 222 URLs
- application/lagrange-fontpack+zip: 200 URLs
Most common languages
- Unspecified: 307,225 URLs
- en: 55,458 URLs
- de: 11,083 URLs
- it: 6,958 URLs
- fr: 6,076 URLs
- fi: 1,129 URLs
- ja: 817 URLs
- es_ar: 718 URLs
- es: 575 URLs
- ru: 330 URLs
- en_us: 154 URLs
- ko: 127 URLs
- gl: 120 URLs
- ca: 86 URLs
- no: 59 URLs
- sv: 58 URLs
- eo: 26 URLs
- pl,en: 26 URLs
- sco,gd,it,en: 23 URLs
- hu: 23 URLs
Most common language tags
- Unspecified: 307,180 URLs
- en: 29,245 URLs
- en-gb: 13,081 URLs
- en-us: 12,445 URLs
- de: 11,053 URLs
- it: 6,958 URLs
- fr: 5,284 URLs
- fi: 1,129 URLs
- ja: 817 URLs
- fr-fr: 792 URLs
- es_ar: 718 URLs
- es-es: 563 URLs
- en-ie: 471 URLs
- ru-ru: 199 URLs
- en-au: 182 URLs
- en_us: 154 URLs
- ru: 131 URLs
- ko: 127 URLs
- ca-es: 84 URLs
- gl: 66 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 357,630 URLs
- utf-8: 33,494 URLs
- us-ascii: 60 URLs
- gzip: 24 URLs
- binary: 16 URLs
- windows-1252: 2 URLs
- bzip2: 2 URLs
- cp437: 2 URLs
- u: 2 URLs
- utf-16: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 287,648 URLs
- utf-8: 23,546 URLs
- cp437: 2 URLs
- utf-16: 2 URLs
- windows-1252: 2 URLs
- iso-8859-1: 1 URLs
By the way, 1,187 of recently tested URLs (0.239 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 391,235 occurrences (85.10 %)
- 51 (Not found): 19,018 occurrences (4.14 %)
- 44 (Slow down): 10,167 occurrences (2.21 %)
- 53 (Proxy request refused): 10,026 occurrences (2.18 %)
- 40 (Temporary failure): 6,660 occurrences (1.45 %)
- 60 (Client certificate request): 5,405 occurrences (1.18 %)
- 30 (Temporary redirect): 4,831 occurrences (1.05 %)
- 10 (Input request): 4,690 occurrences (1.02 %)
- 42 (CGI error): 4,237 occurrences (0.92 %)
- 31 (Permanent redirect): 1,888 occurrences (0.41 %)
- 50 (Permanent failure): 1,291 occurrences (0.28 %)
- 59 (Bad request): 138 occurrences (0.03 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 255
Average number of incoming links: 0.19
Capsules
There are 3142 capsules. We successfully connected recently to 2327 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- gemini.techrights.org: 10000 URLs
- jpfox.fr: 10000 URLs
- blitter.com: 10000 URLs
- gemini.conman.org: 10000 URLs
- midnight.pub: 10000 URLs
- taz.de: 9996 URLs
- hoagie.space: 9992 URLs
- jsreed5.org: 9992 URLs
- gemlog.stargrave.org: 9977 URLs
- caiofior.pollux.casa: 9772 URLs
- gemini.knusbaum.com: 9757 URLs
- library.inu.red: 9547 URLs
- dw.schettler.net: 8800 URLs
- gemini.autonomy.earth: 8665 URLs
- ecs.d2evs.net: 8403 URLs
- mastogem.picasoft.net: 8083 URLs
- gemini.omarpolo.com: 7839 URLs
- rawtext.club: 7694 URLs
- gemini.tuxmachines.org: 7628 URLs
- news.tuxmachines.org: 7574 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- si3t.ch: 1099.1 megabytes
- jpfox.fr: 1069.9 megabytes
- uscoffings.net: 915.7 megabytes
- blitter.com: 824.2 megabytes
- nytpu.com: 812.4 megabytes
- gael.mooo.com: 663.4 megabytes
- yam655.com: 589.9 megabytes
- hoagie.space: 496.2 megabytes
- skyjake.fi: 357.0 megabytes
- mikelynch.org: 315.4 megabytes
- ecs.d2evs.net: 285.5 megabytes
- multiverse.thruhere.net: 233.5 megabytes
- tweek.zyxxyz.eu: 225.2 megabytes
- shit.cx: 182.3 megabytes
- library.inu.red: 181.7 megabytes
- phreedom.club: 175.3 megabytes
- gemini.techrights.org: 174.4 megabytes
- gem.girlmeow.autos: 165.5 megabytes
- gemini.conman.org: 151.6 megabytes
- gem.librehacker.com: 151.2 megabytes
- going-flying.com: 133.4 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2068 (88.9 %) capsules are self-signed, 193 (8.3 %) use the Certificate Authority Let's Encrypt, 66 (2.8 %) are signed by another CA (may be not a trusted one).
69 capsules (2.99 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1503 capsules
- sha256WithRSAEncryption: 809 capsules
- ED25519: 13 capsules
- ecdsa-with-SHA512: 5 capsules
- sha512WithRSAEncryption: 3 capsules
- ecdsa-with-SHA384: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1531 capsules
- RSA: 792 capsules
- ED25519: 13 capsules
Key sizes for RSA:
- 2048: 517 capsules
- 4096: 261 capsules
- 3072: 9 capsules
- 512: 3 capsules
- 1024: 1 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1448 capsules
- 384: 81 capsules
- 521: 2 capsules
TLS
97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.
11.1 % of capsules do NOT send a proper close.
The full list
robots.txt
218 (9 %) the capsules have a robots.txt exclusion file.
Ports
13 working capsules (0.6 %) use an alternative port
Addresses
1206 IP addresses used. 16 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 743 vhosts
- 68.133.1.71: 257 vhosts
- 213.219.38.200: 196 vhosts
- 173.195.146.139: 99 vhosts
- 90.65.170.44: 28 vhosts
- 109.237.26.252: 19 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 104.245.33.223: 9 vhosts
- 52.51.189.88: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 51.222.161.16: 6 vhosts
- 139.162.187.208: 6 vhosts
- 89.234.140.141: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 178.209.50.237: 5 vhosts
- 89.253.220.199: 5 vhosts
- 37.79.202.136: 5 vhosts
TLDs
There are 236 TLDs in the capsule's names, and 1582 registered domains.
Most common TLDs
By number of registered domains
- com: 258 domains
- net: 135 domains
- org: 130 domains
- xyz: 109 domains
- space: 70 domains
- de: 45 domains
- me: 42 domains
- site: 40 domains
- dev: 40 domains
- eu: 32 domains
- io: 26 domains
- fr: 26 domains
- uk: 25 domains
- info: 25 domains
- club: 21 domains
- online: 15 domains
- ch: 14 domains
- ca: 13 domains
- se: 12 domains
- us: 11 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 757 capsules
- org: 423 capsules
- com: 313 capsules
- pub: 205 capsules
- net: 159 capsules
- xyz: 117 capsules
- space: 91 capsules
- de: 54 capsules
- club: 45 capsules
- me: 44 capsules
- site: 43 capsules
- dev: 42 capsules
- eu: 40 capsules
- casa: 36 capsules
- io: 34 capsules
- info: 32 capsules
- uk: 28 capsules
- fr: 28 capsules
- ch: 19 capsules
- us: 18 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule