💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2023-03-20 at 17:25:41. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-01-29)
➡️ Next capture (2023-04-19)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-03-17 19:04:01Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 540,969 URIs, 422,525 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 331,038 URIs serve a Gemini content.
Resources
The average size of the resources is 43,449 bytes.
Quantiles
- 10% of the resources are 271 bytes or less,
- 20% of the resources are 596 bytes or less,
- 30% of the resources are 893 bytes or less,
- 40% of the resources are 1,461 bytes or less,
- 50% of the resources are 2,613 bytes or less, MEDIAN
- 60% of the resources are 4,776 bytes or less,
- 70% of the resources are 7,210 bytes or less,
- 80% of the resources are 16,182 bytes or less,
- 90% of the resources are 75,995 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 237 bytes or less,
- 20% of the resources are 470 bytes or less,
- 30% of the resources are 735 bytes or less,
- 40% of the resources are 1,034 bytes or less,
- 50% of the resources are 1,661 bytes or less, MEDIAN
- 60% of the resources are 2,689 bytes or less,
- 70% of the resources are 4,703 bytes or less,
- 80% of the resources are 6,683 bytes or less,
- 90% of the resources are 12,987 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3368 URLs (0.80 %)
- 10 to 100 bytes: 10405 URLs (2.5 %)
- 100 to 1000 bytes: 124286 URLs (29.4 %)
- 1 to 10 kbytes: 177593 URLs (42.0 %)
- 10 to 100 kbytes: 72443 URLs (17.1 %)
- 100 to 1000 kbytes: 26828 URLs (6.3 %)
- More than 1000 kbytes: 7602 URLs (1.80 %)
Most common media (MIME) types
- text/gemini: 331,038 URLs
- image/jpeg: 22,568 URLs
- image/png: 18,511 URLs
- text/plain: 15,788 URLs
- application/octet-stream: 12,397 URLs
- application/pdf: 4,339 URLs
- image/gif: 3,202 URLs
- application/zip: 3,061 URLs
- octet/stream: 2,202 URLs
- text/html: 1,856 URLs
- application/x-mscardfile: 1,183 URLs
- audio/mpeg: 923 URLs
- text/x-diff: 747 URLs
- application/json: 591 URLs
- image/webp: 355 URLs
- audio/ogg: 308 URLs
- application/xml: 292 URLs
- text/xml: 234 URLs
- application/atom+xml: 227 URLs
- application/lagrange-fontpack+zip: 184 URLs
Most common languages
- Unspecified: 334,569 URLs
- en: 59,429 URLs
- de: 10,687 URLs
- it: 6,941 URLs
- fr: 6,026 URLs
- fi: 1,102 URLs
- ja: 1,075 URLs
- es_ar: 970 URLs
- es: 522 URLs
- ru: 329 URLs
- en_us: 205 URLs
- ko: 126 URLs
- gl: 119 URLs
- ca: 85 URLs
- sv: 58 URLs
- sco,gd,it,en: 38 URLs
- eo: 28 URLs
- pl,en: 27 URLs
- hu: 22 URLs
- tok: 19 URLs
Most common language tags
- Unspecified: 334,525 URLs
- en: 32,822 URLs
- en-us: 13,149 URLs
- en-gb: 12,696 URLs
- de: 10,656 URLs
- it: 6,941 URLs
- fr: 5,192 URLs
- fi: 1,102 URLs
- ja: 1,075 URLs
- es_ar: 970 URLs
- fr-fr: 834 URLs
- es-es: 512 URLs
- en-ie: 471 URLs
- en-au: 257 URLs
- en_us: 205 URLs
- ru-ru: 200 URLs
- ru: 129 URLs
- ko: 126 URLs
- ca-es: 83 URLs
- gl: 65 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 382,339 URLs
- utf-8: 40,080 URLs
- us-ascii: 58 URLs
- gzip: 24 URLs
- binary: 13 URLs
- windows-1252: 2 URLs
- bzip2: 2 URLs
- cp437: 2 URLs
- u: 2 URLs
- utf-16: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 301,545 URLs
- utf-8: 29,486 URLs
- cp437: 2 URLs
- utf-16: 2 URLs
- windows-1252: 2 URLs
- iso-8859-1: 1 URLs
By the way, 1,330 of recently tested URLs (0.252 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 422,525 occurrences (85.28 %)
- 51 (Not found): 28,263 occurrences (5.70 %)
- 53 (Proxy request refused): 9,442 occurrences (1.91 %)
- 40 (Temporary failure): 6,226 occurrences (1.26 %)
- 60 (Client certificate request): 5,496 occurrences (1.11 %)
- 44 (Slow down): 5,469 occurrences (1.10 %)
- 30 (Temporary redirect): 5,163 occurrences (1.04 %)
- 10 (Input request): 4,879 occurrences (0.98 %)
- 42 (CGI error): 4,111 occurrences (0.83 %)
- 31 (Permanent redirect): 3,157 occurrences (0.64 %)
- 50 (Permanent failure): 446 occurrences (0.09 %)
- 59 (Bad request): 130 occurrences (0.03 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 257
Average number of incoming links: 0.19
Capsules
There are 3136 capsules. We successfully connected recently to 2351 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- rwv.io: 9994 URLs
- jsreed5.org: 9987 URLs
- mirrors.apple2.org.za: 9959 URLs
- hoagie.space: 9922 URLs
- blitter.com: 9905 URLs
- gemini.conman.org: 9880 URLs
- jpfox.fr: 9840 URLs
- gemini.techrights.org: 9831 URLs
- midnight.pub: 9773 URLs
- caiofior.pollux.casa: 9741 URLs
- gemini.knusbaum.com: 9737 URLs
- taz.de: 9607 URLs
- dw.schettler.net: 9485 URLs
- gemlog.stargrave.org: 9454 URLs
- mastogem.remorse.us: 9400 URLs
- gemini.omarpolo.com: 8959 URLs
- gemini.autonomy.earth: 8620 URLs
- ecs.d2evs.net: 8333 URLs
- news.tuxmachines.org: 8066 URLs
- mastogem.picasoft.net: 7716 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2771.9 megabytes
- jpfox.fr: 1052.0 megabytes
- si3t.ch: 1049.3 megabytes
- uscoffings.net: 911.5 megabytes
- blitter.com: 815.5 megabytes
- nytpu.com: 808.8 megabytes
- gael.mooo.com: 693.8 megabytes
- yam655.com: 595.1 megabytes
- hoagie.space: 494.9 megabytes
- skyjake.fi: 368.5 megabytes
- mikelynch.org: 315.3 megabytes
- ecs.d2evs.net: 282.9 megabytes
- multiverse.thruhere.net: 229.4 megabytes
- tweek.zyxxyz.eu: 228.3 megabytes
- library.inu.red: 221.4 megabytes
- shit.cx: 174.7 megabytes
- gemini.techrights.org: 171.8 megabytes
- rwv.io: 168.3 megabytes
- phreedom.club: 166.4 megabytes
- gem.librehacker.com: 166.3 megabytes
- gem.girlmeow.autos: 164.4 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2082 (88.6 %) capsules are self-signed, 206 (8.8 %) use the Certificate Authority Let's Encrypt, 63 (2.7 %) are signed by another CA (may be not a trusted one).
67 capsules (2.87 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1514 capsules
- sha256WithRSAEncryption: 819 capsules
- ED25519: 15 capsules
- ecdsa-with-SHA512: 5 capsules
- ecdsa-with-SHA384: 2 capsules
- sha512WithRSAEncryption: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1545 capsules
- RSA: 798 capsules
- ED25519: 15 capsules
Key sizes for RSA:
- 2048: 524 capsules
- 4096: 259 capsules
- 3072: 10 capsules
- 512: 3 capsules
- 1024: 1 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1463 capsules
- 384: 80 capsules
- 521: 2 capsules
TLS
97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.
10.9 % of capsules do NOT send a proper close.
The full list
robots.txt
215 (9 %) the capsules have a robots.txt exclusion file.
Ports
13 working capsules (0.6 %) use an alternative port
Addresses
1208 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 748 vhosts
- 68.133.1.71: 260 vhosts
- 213.219.38.200: 200 vhosts
- 173.195.146.139: 97 vhosts
- 90.65.170.44: 28 vhosts
- 109.237.26.252: 19 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 104.245.33.223: 9 vhosts
- 52.51.189.88: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 139.162.187.208: 6 vhosts
- 51.222.161.16: 6 vhosts
- 178.209.50.237: 5 vhosts
- 64.226.23.78: 5 vhosts
- 37.79.202.136: 5 vhosts
- 46.23.94.99: 5 vhosts
- 23.88.35.144: 5 vhosts
TLDs
There are 240 TLDs in the capsule's names, and 1568 registered domains.
Most common TLDs
By number of registered domains
- com: 246 domains
- net: 134 domains
- org: 127 domains
- xyz: 109 domains
- space: 74 domains
- de: 46 domains
- site: 40 domains
- dev: 40 domains
- me: 39 domains
- eu: 32 domains
- fr: 26 domains
- uk: 24 domains
- io: 24 domains
- info: 23 domains
- club: 21 domains
- online: 16 domains
- ch: 14 domains
- ca: 14 domains
- se: 13 domains
- us: 12 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 759 capsules
- org: 425 capsules
- com: 300 capsules
- pub: 208 capsules
- net: 158 capsules
- xyz: 117 capsules
- space: 95 capsules
- de: 53 capsules
- club: 45 capsules
- site: 43 capsules
- dev: 42 capsules
- me: 40 capsules
- eu: 39 capsules
- casa: 36 capsules
- info: 30 capsules
- fr: 29 capsules
- io: 29 capsules
- uk: 27 capsules
- us: 20 capsules
- ch: 18 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule