💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2023-11-04 at 11:24:29. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-09-28)
➡️ Next capture (2023-11-14)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-11-04 04:04:02Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 588,337 URIs, 476,490 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 364,767 URIs serve a Gemini content.
Resources
The average size of the resources is 40,808 bytes.
Quantiles
- 10% of the resources are 277 bytes or less,
- 20% of the resources are 609 bytes or less,
- 30% of the resources are 969 bytes or less,
- 40% of the resources are 1,656 bytes or less,
- 50% of the resources are 2,824 bytes or less, MEDIAN
- 60% of the resources are 5,221 bytes or less,
- 70% of the resources are 7,468 bytes or less,
- 80% of the resources are 16,718 bytes or less,
- 90% of the resources are 54,370 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 246 bytes or less,
- 20% of the resources are 482 bytes or less,
- 30% of the resources are 793 bytes or less,
- 40% of the resources are 1,153 bytes or less,
- 50% of the resources are 1,922 bytes or less, MEDIAN
- 60% of the resources are 3,115 bytes or less,
- 70% of the resources are 5,367 bytes or less,
- 80% of the resources are 7,245 bytes or less,
- 90% of the resources are 15,506 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3409 URLs (0.72 %)
- 10 to 100 bytes: 11756 URLs (2.5 %)
- 100 to 1000 bytes: 130876 URLs (27.5 %)
- 1 to 10 kbytes: 206256 URLs (43.3 %)
- 10 to 100 kbytes: 88553 URLs (18.6 %)
- 100 to 1000 kbytes: 27708 URLs (5.8 %)
- More than 1000 kbytes: 7932 URLs (1.66 %)
Most common media (MIME) types
- text/gemini: 364,767 URLs
- text/plain: 30,036 URLs
- image/jpeg: 20,927 URLs
- image/png: 19,445 URLs
- application/octet-stream: 15,696 URLs
- application/pdf: 4,814 URLs
- application/zip: 3,151 URLs
- octet/stream: 2,213 URLs
- image/gif: 2,026 URLs
- text/html: 2,002 URLs
- audio/mpeg: 1,302 URLs
- application/x-mscardfile: 1,197 URLs
- MIME: 1,072 URLs
- text/x-diff: 981 URLs
- text/markdown: 721 URLs
- application/json: 695 URLs
- application/atom+xml: 605 URLs
- text/xml: 565 URLs
- audio/ogg: 417 URLs
- image/webp: 358 URLs
Most common languages
- Unspecified: 364,002 URLs
- en: 83,401 URLs
- de: 11,065 URLs
- it: 7,127 URLs
- fr: 5,115 URLs
- es: 1,508 URLs
- es_ar: 1,200 URLs
- ja: 1,122 URLs
- ru: 496 URLs
- en_gb: 383 URLs
- en_us: 224 URLs
- pl: 157 URLs
- ko: 94 URLs
- ca: 86 URLs
- eo: 70 URLs
- sv: 69 URLs
- gl: 54 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 31 URLs
- uk: 26 URLs
Most common language tags
- Unspecified: 363,957 URLs
- en: 35,809 URLs
- en-us: 24,947 URLs
- en-gb: 21,904 URLs
- de: 11,004 URLs
- it: 7,127 URLs
- fr: 4,158 URLs
- es-es: 1,481 URLs
- es_ar: 1,200 URLs
- ja: 1,122 URLs
- fr-fr: 957 URLs
- en-ie: 473 URLs
- en_gb: 383 URLs
- ru-ru: 364 URLs
- en_us: 224 URLs
- ru: 132 URLs
- en-au: 105 URLs
- pl: 105 URLs
- ko: 94 URLs
- ca-es: 84 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 405,664 URLs
- utf-8: 61,256 URLs
- us-ascii: 9,496 URLs
- binary: 35 URLs
- gzip: 30 URLs
- br: 4 URLs
- bzip2: 2 URLs
- xz: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 313,411 URLs
- utf-8: 51,355 URLs
- iso-8859-1: 1 URLs
By the way, 492 of recently tested URLs (0.089 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 476,490 occurrences (87.62 %)
- 51 (Not found): 19,793 occurrences (3.64 %)
- 40 (Temporary failure): 13,876 occurrences (2.55 %)
- 50 (Permanent failure): 11,178 occurrences (2.06 %)
- 53 (Proxy request refused): 9,783 occurrences (1.80 %)
- 60 (Client certificate request): 5,342 occurrences (0.98 %)
- 10 (Input request): 4,001 occurrences (0.74 %)
- 30 (Temporary redirect): 1,303 occurrences (0.24 %)
- 42 (CGI error): 1,021 occurrences (0.19 %)
- 31 (Permanent redirect): 470 occurrences (0.09 %)
- 59 (Bad request): 327 occurrences (0.06 %)
- 44 (Slow down): 130 occurrences (0.02 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 286
Average number of incoming links: 0.19
Capsules
There are 3469 capsules. We successfully connected recently to 2584 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- midnight.pub: 10000 URLs
- gemlog.stargrave.org: 9999 URLs
- mirrors.apple2.org.za: 9998 URLs
- rwv.io: 9996 URLs
- blitter.com: 9995 URLs
- jsreed5.org: 9995 URLs
- hoagie.space: 9993 URLs
- spam.works: 9987 URLs
- caiofior.pollux.casa: 9985 URLs
- gemini.omarpolo.com: 9979 URLs
- taz.de: 9968 URLs
- library.inu.red: 9965 URLs
- gemini.conman.org: 9941 URLs
- gemini.unlimited.pizza: 9783 URLs
- mastogem.remorse.us: 9759 URLs
- gemini.tuxmachines.org: 9756 URLs
- gemini.techrights.org: 9734 URLs
- gemini.knusbaum.com: 9724 URLs
- gemini.autonomy.earth: 9530 URLs
- tjp.lol: 8813 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2802.8 megabytes
- nytpu.com: 1109.9 megabytes
- uscoffings.net: 927.0 megabytes
- blitter.com: 824.2 megabytes
- gael.mooo.com: 750.3 megabytes
- gem.librehacker.com: 655.1 megabytes
- yam655.com: 598.3 megabytes
- hoagie.space: 498.1 megabytes
- gemini.omarpolo.com: 393.8 megabytes
- jpfox.fr: 363.0 megabytes
- gemini.zachdecook.com: 341.3 megabytes
- mikelynch.org: 336.5 megabytes
- library.inu.red: 323.5 megabytes
- ecs.d2evs.net: 296.7 megabytes
- tweek.zyxxyz.eu: 261.9 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- shit.cx: 182.3 megabytes
- phreedom.club: 178.3 megabytes
- higeki.jp: 177.0 megabytes
- rwv.io: 168.5 megabytes
- gemini.techrights.org: 168.4 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2317 (89.7 %) capsules are self-signed, 209 (8.1 %) use the Certificate Authority Let's Encrypt, 58 (2.2 %) are signed by another CA (may be not a trusted one).
53 capsules (2.06 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1650 capsules
- sha256WithRSAEncryption: 904 capsules
- ED25519: 18 capsules
- sha512WithRSAEncryption: 4 capsules
- ecdsa-with-SHA512: 3 capsules
- ecdsa-with-SHA384: 1 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1688 capsules
- RSA: 875 capsules
- ED25519: 18 capsules
Key sizes for RSA:
- 2048: 595 capsules
- 4096: 264 capsules
- 3072: 12 capsules
- 1024: 3 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1622 capsules
- 384: 65 capsules
- 521: 1 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
robots.txt
261 (10 %) the capsules have a robots.txt exclusion file.
Ports
12 working capsules (0.5 %) use an alternative port
Addresses
1193 IP addresses used. 18 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 820 vhosts
- 68.133.1.71: 348 vhosts
- 213.219.38.200: 225 vhosts
- 173.195.146.139: 105 vhosts
- 90.65.170.44: 29 vhosts
- 109.237.26.252: 25 vhosts
- 45.56.93.217: 19 vhosts
- 216.238.66.109: 13 vhosts
- 128.140.115.191: 11 vhosts
- 81.187.234.86: 8 vhosts
- 51.222.161.16: 8 vhosts
- 86.147.131.225: 7 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 139.162.187.208: 6 vhosts
- 66.175.211.51: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 89.234.140.141: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 68.183.213.240: 5 vhosts
TLDs
There are 250 TLDs in the capsule's names, and 1705 registered domains.
Most common TLDs
By number of registered domains
- com: 267 domains
- net: 145 domains
- org: 141 domains
- xyz: 121 domains
- space: 81 domains
- de: 54 domains
- dev: 49 domains
- site: 48 domains
- me: 43 domains
- eu: 32 domains
- fr: 31 domains
- uk: 28 domains
- info: 24 domains
- io: 23 domains
- club: 23 domains
- se: 15 domains
- online: 15 domains
- ch: 13 domains
- ca: 13 domains
- ru: 12 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 830 capsules
- org: 530 capsules
- com: 321 capsules
- pub: 231 capsules
- net: 167 capsules
- xyz: 133 capsules
- space: 101 capsules
- de: 60 capsules
- dev: 53 capsules
- site: 51 capsules
- club: 49 capsules
- me: 44 capsules
- eu: 40 capsules
- casa: 35 capsules
- fr: 33 capsules
- uk: 32 capsules
- io: 32 capsules
- info: 31 capsules
- us: 18 capsules
- se: 18 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule