💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2024-08-01.gmi captured on 2024-08-18 at 22:17:26. Gemini links have been rewritten to link to archived content
View Raw
More Information
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2024-08-01 03:04:00Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 618,548 URIs, 516,066 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 393,392 URIs serve a Gemini content.
Resources
The average size of the resources is 60,533 bytes.
Quantiles
- 10% of the resources are 261 bytes or less,
- 20% of the resources are 537 bytes or less,
- 30% of the resources are 947 bytes or less,
- 40% of the resources are 1,483 bytes or less,
- 50% of the resources are 2,561 bytes or less, MEDIAN
- 60% of the resources are 4,439 bytes or less,
- 70% of the resources are 6,880 bytes or less,
- 80% of the resources are 14,429 bytes or less,
- 90% of the resources are 70,410 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 233 bytes or less,
- 20% of the resources are 423 bytes or less,
- 30% of the resources are 729 bytes or less,
- 40% of the resources are 1,090 bytes or less,
- 50% of the resources are 1,677 bytes or less, MEDIAN
- 60% of the resources are 2,691 bytes or less,
- 70% of the resources are 4,512 bytes or less,
- 80% of the resources are 6,519 bytes or less,
- 90% of the resources are 11,382 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 4295 URLs (0.83 %)
- 10 to 100 bytes: 15373 URLs (3.0 %)
- 100 to 1000 bytes: 141073 URLs (27.3 %)
- 1 to 10 kbytes: 233451 URLs (45.2 %)
- 10 to 100 kbytes: 75793 URLs (14.7 %)
- 100 to 1000 kbytes: 27381 URLs (5.3 %)
- More than 1000 kbytes: 18700 URLs (3.62 %)
Most common media (MIME) types
- text/gemini: 393,392 URLs
- text/plain: 23,271 URLs
- image/png: 21,798 URLs
- image/jpeg: 21,398 URLs
- application/pdf: 13,920 URLs
- application/octet-stream: 10,802 URLs
- text/x-go: 5,492 URLs
- image/svg+xml: 3,089 URLs
- application/zip: 3,036 URLs
- octet/stream: 1,919 URLs
- application/x-mscardfile: 1,869 URLs
- text/html: 1,814 URLs
- audio/mpeg: 1,461 URLs
- image/gif: 1,457 URLs
- text/xml: 1,311 URLs
- MIME: 997 URLs
- text/x-diff: 914 URLs
- text/markdown: 777 URLs
- application/json: 737 URLs
- application/atom+xml: 671 URLs
Most common languages
- Unspecified: 385,395 URLs
- en: 96,176 URLs
- de: 12,114 URLs
- it: 7,458 URLs
- fr: 6,762 URLs
- es: 2,447 URLs
- es_ar: 1,271 URLs
- fa: 1,019 URLs
- arb: 594 URLs
- ja: 586 URLs
- ru: 563 URLs
- en_gb: 303 URLs
- en_au: 227 URLs
- grc: 206 URLs
- en_us: 200 URLs
- he: 144 URLs
- pl: 101 URLs
- eo: 82 URLs
- sv: 80 URLs
- gl: 55 URLs
Most common language tags
- Unspecified: 385,348 URLs
- en: 41,537 URLs
- en-us: 30,905 URLs
- en-gb: 22,705 URLs
- de: 12,055 URLs
- it: 7,458 URLs
- fr: 5,934 URLs
- es-es: 1,679 URLs
- es_ar: 1,271 URLs
- fa: 1,019 URLs
- fr-fr: 828 URLs
- es: 730 URLs
- arb: 594 URLs
- ja: 586 URLs
- en-ie: 476 URLs
- ru: 406 URLs
- en-ca: 381 URLs
- en_gb: 303 URLs
- en_au: 227 URLs
- grc: 206 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 436,628 URLs
- utf-8: 79,290 URLs
- us-ascii: 98 URLs
- binary: 42 URLs
- gzip: 4 URLs
- bzip2: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 330,946 URLs
- utf-8: 62,445 URLs
- iso-8859-1: 1 URLs
By the way, 574 of recently tested URLs (0.098Â %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 516,065 occurrences (91.27 %)
- 51 (Not found): 21,948 occurrences (3.88 %)
- 60 (Client certificate request): 6,332 occurrences (1.12 %)
- 40 (Temporary failure): 5,448 occurrences (0.96 %)
- 30 (Temporary redirect): 4,839 occurrences (0.86 %)
- 44 (Slow down): 4,650 occurrences (0.82 %)
- 10 (Input request): 4,279 occurrences (0.76 %)
- 42 (CGI error): 885 occurrences (0.16 %)
- 31 (Permanent redirect): 634 occurrences (0.11 %)
- 59 (Bad request): 158 occurrences (0.03 %)
- 50 (Permanent failure): 133 occurrences (0.02 %)
- 53 (Proxy request refused): 37 occurrences (0.01 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 312
Average number of incoming links: 0.27
Capsules
There are 3924 capsules. We successfully connected recently to 2822 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- gemlog.stargrave.org: 10000 URLs
- git.skyjake.fi: 10000 URLs
- midnight.pub: 10000 URLs
- gemini.omarpolo.com: 9999 URLs
- hoagie.space: 9993 URLs
- gemini.tuxmachines.org: 9993 URLs
- gemini.techrights.org: 9993 URLs
- taz.de: 9993 URLs
- fumble-around.mediocregopher.com: 9991 URLs
- musicbrainz.uploadedlobster.com: 9990 URLs
- gemini.conman.org: 9987 URLs
- 1436.ninja: 9986 URLs
- library.inu.red: 9983 URLs
- gemini.autonomy.earth: 9977 URLs
- mirrors.apple2.org.za: 9969 URLs
- caiofior.pollux.casa: 9965 URLs
- tjp.lol: 9956 URLs
- bbs.geminispace.org: 9940 URLs
- gmi.noulin.net: 9933 URLs
- scholasticdiversity.us.to: 9923 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- 1436.ninja: 9581.9 megabytes
- mirrors.apple2.org.za: 2806.5 megabytes
- nytpu.com: 1743.1 megabytes
- gem.librehacker.com: 938.4 megabytes
- uscoffings.net: 924.7 megabytes
- librehacker.com: 887.5 megabytes
- gael.mooo.com: 725.8 megabytes
- blitter.com: 668.2 megabytes
- yam655.com: 596.2 megabytes
- dfdn.info: 586.7 megabytes
- hoagie.space: 447.3 megabytes
- gemini.omarpolo.com: 387.4 megabytes
- jpfox.fr: 385.1 megabytes
- si3t.ch: 339.5 megabytes
- b2khgkvb2wn4avjshjp63kknsjwikgwff5dwwydldia6qwf4kdnueyad.onion: 329.8 megabytes
- library.inu.red: 324.1 megabytes
- tweek.zyxxyz.eu: 301.7 megabytes
- canary.city: 239.2 megabytes
- gemi.dev: 225.1 megabytes
- going-flying.com: 224.1 megabytes
- shit.cx: 182.3 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2538 (89.9 %) capsules are self-signed, 110 (3.9 %) use the Certificate Authority Let's Encrypt, 174 (6.2 %) are signed by another CA (may be not a trusted one).
68 capsules (2.42Â %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1759 capsules
- sha256WithRSAEncryption: 1010 capsules
- ecdsa-with-SHA384: 23 capsules
- ED25519: 18 capsules
- sha512WithRSAEncryption: 4 capsules
- ecdsa-with-SHA512: 3 capsules
Key types:
- ECDSA: 1832 capsules
- RSA: 967 capsules
- ED25519: 18 capsules
Key sizes for RSA:
- 2048: 695 capsules
- 4096: 262 capsules
- 3072: 7 capsules
- 1024: 3 capsules
Key sizes for ECDSA:
- 256: 1774 capsules
- 384: 57 capsules
- 521: 1 capsules
TLS
97Â % of the capsules use TLS 1.3, 3Â % use TLS 1.2.
robots.txt
295 (10Â %) the capsules have a robots.txt exclusion file.
Ports
16 working capsules (0.6 %) use an alternative port
Addresses
1179 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 881 vhosts
- 68.133.1.71: 435 vhosts
- 213.219.38.200: 261 vhosts
- 46.23.81.157: 120 vhosts
- 2a03:6000:1813:1337::157: 95 vhosts
- 90.65.170.44: 31 vhosts
- 109.237.26.252: 31 vhosts
- 2a01:4ff:f0:4fb3::1: 25 vhosts
- 45.56.93.217: 19 vhosts
- 128.140.115.191: 13 vhosts
- 5.161.108.85: 12 vhosts
- 51.222.161.16: 9 vhosts
- 212.71.248.87: 9 vhosts
- 81.187.234.86: 8 vhosts
- 46.23.94.99: 8 vhosts
- 85.208.51.149: 8 vhosts
- 174.138.124.169: 8 vhosts
- 23.88.35.144: 8 vhosts
- 2001:8b0:1d97:eeca:3da5:94ce:b61e:ee69: 8 vhosts
- 2a01:4f8:c17:20f1::42: 8 vhosts
TLDs
There are 253 TLDs in the capsule's names, and 1884 registered domains.
Most common TLDs
By number of registered domains
- com: 294 domains
- net: 160 domains
- org: 158 domains
- xyz: 133 domains
- space: 86 domains
- site: 61 domains
- de: 55 domains
- dev: 54 domains
- me: 48 domains
- eu: 36 domains
- uk: 32 domains
- fr: 32 domains
- info: 26 domains
- io: 26 domains
- club: 21 domains
- ru: 16 domains
- ca: 16 domains
- online: 16 domains
- onion: 15 domains
- ch: 15 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 890 capsules
- org: 638 capsules
- com: 361 capsules
- pub: 272 capsules
- net: 188 capsules
- xyz: 150 capsules
- space: 101 capsules
- site: 65 capsules
- de: 64 capsules
- dev: 59 capsules
- me: 49 capsules
- cc: 48 capsules
- club: 47 capsules
- eu: 44 capsules
- casa: 39 capsules
- uk: 36 capsules
- fr: 35 capsules
- io: 35 capsules
- info: 34 capsules
- ru: 21 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule