💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2024-08-31 at 18:01:31. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2024-08-25)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2024-08-31 03:04:00Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 618,948 URIs, 533,033 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 396,781 URIs serve a Gemini content.
Resources
The average size of the resources is 59,635 bytes.
Quantiles
- 10% of the resources are 259 bytes or less,
- 20% of the resources are 537 bytes or less,
- 30% of the resources are 967 bytes or less,
- 40% of the resources are 1,522 bytes or less,
- 50% of the resources are 2,556 bytes or less, MEDIAN
- 60% of the resources are 4,431 bytes or less,
- 70% of the resources are 6,929 bytes or less,
- 80% of the resources are 14,999 bytes or less,
- 90% of the resources are 70,894 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 228 bytes or less,
- 20% of the resources are 408 bytes or less,
- 30% of the resources are 722 bytes or less,
- 40% of the resources are 1,088 bytes or less,
- 50% of the resources are 1,678 bytes or less, MEDIAN
- 60% of the resources are 2,691 bytes or less,
- 70% of the resources are 4,512 bytes or less,
- 80% of the resources are 6,526 bytes or less,
- 90% of the resources are 11,429 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3225 URLs (0.61 %)
- 10 to 100 bytes: 16316 URLs (3.1 %)
- 100 to 1000 bytes: 144050 URLs (27.0 %)
- 1 to 10 kbytes: 242193 URLs (45.4 %)
- 10 to 100 kbytes: 79722 URLs (15.0 %)
- 100 to 1000 kbytes: 28746 URLs (5.4 %)
- More than 1000 kbytes: 18781 URLs (3.52 %)
Most common media (MIME) types
- text/gemini: 396,781 URLs
- text/plain: 32,328 URLs
- image/png: 25,230 URLs
- image/jpeg: 21,297 URLs
- application/pdf: 14,019 URLs
- application/octet-stream: 10,818 URLs
- text/x-go: 5,490 URLs
- image/svg+xml: 3,136 URLs
- application/zip: 3,091 URLs
- image/gif: 2,268 URLs
- octet/stream: 1,920 URLs
- application/x-mscardfile: 1,869 URLs
- text/html: 1,818 URLs
- audio/mpeg: 1,453 URLs
- text/xml: 1,318 URLs
- MIME: 997 URLs
- text/x-diff: 915 URLs
- text/markdown: 779 URLs
- application/json: 737 URLs
- application/atom+xml: 677 URLs
Most common languages
- Unspecified: 403,712 URLs
- en: 95,752 URLs
- de: 12,192 URLs
- it: 7,079 URLs
- fr: 5,791 URLs
- es: 2,569 URLs
- es_ar: 1,273 URLs
- fa: 1,021 URLs
- arb: 682 URLs
- ru: 590 URLs
- ja: 543 URLs
- en_gb: 360 URLs
- grc: 251 URLs
- en_au: 230 URLs
- en_us: 200 URLs
- he: 157 URLs
- pl: 101 URLs
- eo: 82 URLs
- sv: 80 URLs
- gl: 55 URLs
Most common language tags
- Unspecified: 403,664 URLs
- en: 40,669 URLs
- en-us: 31,385 URLs
- en-gb: 22,648 URLs
- de: 12,143 URLs
- it: 7,079 URLs
- fr: 4,955 URLs
- es-es: 1,691 URLs
- es_ar: 1,273 URLs
- fa: 1,021 URLs
- es: 840 URLs
- fr-fr: 836 URLs
- arb: 682 URLs
- ja: 543 URLs
- en-ie: 476 URLs
- ru: 425 URLs
- en-ca: 396 URLs
- en_gb: 360 URLs
- grc: 251 URLs
- en_au: 230 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 454,479 URLs
- utf-8: 78,404 URLs
- us-ascii: 99 URLs
- binary: 43 URLs
- gzip: 4 URLs
- iso-8859-1: 2 URLs
- bzip2: 2 URLs
Most common encodings for gemtext files only
- Unspecified: 335,287 URLs
- utf-8: 61,491 URLs
- iso-8859-1: 2 URLs
- us-ascii: 1 URLs
By the way, 420 of recently tested URLs (0.071 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 533,033 occurrences (91.54 %)
- 51 (Not found): 22,037 occurrences (3.78 %)
- 40 (Temporary failure): 6,843 occurrences (1.18 %)
- 60 (Client certificate request): 6,335 occurrences (1.09 %)
- 30 (Temporary redirect): 4,932 occurrences (0.85 %)
- 10 (Input request): 4,374 occurrences (0.75 %)
- 44 (Slow down): 3,186 occurrences (0.55 %)
- 42 (CGI error): 874 occurrences (0.15 %)
- 31 (Permanent redirect): 468 occurrences (0.08 %)
- 59 (Bad request): 87 occurrences (0.01 %)
- 50 (Permanent failure): 80 occurrences (0.01 %)
- 53 (Proxy request refused): 30 occurrences (0.01 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 317
Average number of incoming links: 0.28
Capsules
There are 3958 capsules. We successfully connected recently to 2856 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- gemini.omarpolo.com: 10000 URLs
- midnight.pub: 10000 URLs
- 1436.ninja: 9999 URLs
- gemini.conman.org: 9999 URLs
- fumble-around.mediocregopher.com: 9998 URLs
- gemlog.stargrave.org: 9996 URLs
- mirrors.apple2.org.za: 9996 URLs
- hoagie.space: 9993 URLs
- gemini.techrights.org: 9991 URLs
- gemini.tuxmachines.org: 9990 URLs
- taz.de: 9990 URLs
- musicbrainz.uploadedlobster.com: 9989 URLs
- library.inu.red: 9987 URLs
- gemini.autonomy.earth: 9972 URLs
- tjp.lol: 9955 URLs
- gmi.noulin.net: 9932 URLs
- mozz.us:7070: 9924 URLs
- oracular.space: 9907 URLs
- scholasticdiversity.us.to: 9906 URLs
- blitter.com: 9774 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- 1436.ninja: 9588.6 megabytes
- mirrors.apple2.org.za: 2818.1 megabytes
- nytpu.com: 1783.2 megabytes
- gem.librehacker.com: 994.8 megabytes
- librehacker.com: 933.2 megabytes
- uscoffings.net: 923.6 megabytes
- gael.mooo.com: 706.8 megabytes
- blitter.com: 669.0 megabytes
- yam655.com: 598.3 megabytes
- dfdn.info: 586.8 megabytes
- hoagie.space: 499.0 megabytes
- gemini.omarpolo.com: 387.4 megabytes
- si3t.ch: 366.7 megabytes
- b2khgkvb2wn4avjshjp63kknsjwikgwff5dwwydldia6qwf4kdnueyad.onion: 350.1 megabytes
- library.inu.red: 324.6 megabytes
- tweek.zyxxyz.eu: 307.0 megabytes
- ecs.d2evs.net: 300.1 megabytes
- canary.city: 239.2 megabytes
- going-flying.com: 233.8 megabytes
- gemi.dev: 226.5 megabytes
- jpfox.fr: 224.9 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2560 (89.6 %) capsules are self-signed, 44 (1.5 %) use the Certificate Authority Let's Encrypt, 252 (8.8 %) are signed by another CA (may be not a trusted one).
79 capsules (2.78 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1777 capsules
- sha256WithRSAEncryption: 995 capsules
- ecdsa-with-SHA384: 65 capsules
- ED25519: 18 capsules
- sha512WithRSAEncryption: 4 capsules
- ecdsa-with-SHA512: 3 capsules
Key types:
- ECDSA: 1855 capsules
- RSA: 989 capsules
- ED25519: 18 capsules
Key sizes for RSA:
- 2048: 709 capsules
- 4096: 269 capsules
- 3072: 7 capsules
- 1024: 3 capsules
- 8192: 1 capsules
Key sizes for ECDSA:
- 256: 1795 capsules
- 384: 59 capsules
- 521: 1 capsules
TLS
97 % of the capsules use TLS 1.3, 3 % use TLS 1.2.
robots.txt
295 (10 %) the capsules have a robots.txt exclusion file.
Ports
15 working capsules (0.5 %) use an alternative port
Addresses
1169 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 891 vhosts
- 72.65.51.74: 444 vhosts
- 68.133.1.71: 435 vhosts
- 213.219.38.200: 263 vhosts
- 46.23.81.157: 124 vhosts
- 2a03:6000:1813:1337::157: 99 vhosts
- 90.65.170.44: 32 vhosts
- 109.237.26.252: 31 vhosts
- 2a01:4ff:f0:4fb3::1: 29 vhosts
- 5.161.108.85: 28 vhosts
- 45.56.93.217: 19 vhosts
- 128.140.115.191: 13 vhosts
- 212.71.248.87: 10 vhosts
- 51.222.161.16: 9 vhosts
- 85.208.51.149: 8 vhosts
- 81.187.234.86: 8 vhosts
- 2001:8b0:1d97:eeca:3da5:94ce:b61e:ee69: 8 vhosts
- 46.23.94.99: 8 vhosts
- 143.244.212.63: 8 vhosts
- 174.138.124.169: 8 vhosts
TLDs
There are 245 TLDs in the capsule's names, and 1894 registered domains.
Most common TLDs
By number of registered domains
- com: 294 domains
- net: 166 domains
- org: 161 domains
- xyz: 134 domains
- space: 89 domains
- site: 64 domains
- de: 56 domains
- dev: 54 domains
- me: 45 domains
- eu: 38 domains
- uk: 32 domains
- fr: 29 domains
- info: 26 domains
- io: 24 domains
- club: 22 domains
- ru: 16 domains
- ca: 16 domains
- online: 16 domains
- cc: 15 domains
- se: 14 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 899 capsules
- org: 655 capsules
- com: 359 capsules
- pub: 275 capsules
- net: 195 capsules
- xyz: 151 capsules
- space: 104 capsules
- site: 67 capsules
- de: 61 capsules
- dev: 59 capsules
- cc: 49 capsules
- club: 48 capsules
- eu: 47 capsules
- me: 46 capsules
- casa: 39 capsules
- uk: 36 capsules
- info: 34 capsules
- fr: 32 capsules
- io: 32 capsules
- us: 22 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule