💾 Archived View for radia.bortzmeyer.org › software › lupa › archive-stats › 2024-06-01.gmi captured on 2024-06-16 at 12:38:25. Gemini links have been rewritten to link to archived content
View Raw
More Information
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2024-06-01 03:04:00Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 633,862 URIs, 525,344 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 396,061 URIs serve a Gemini content.
Resources
The average size of the resources is 60,727 bytes.
Quantiles
- 10% of the resources are 263 bytes or less,
- 20% of the resources are 564 bytes or less,
- 30% of the resources are 903 bytes or less,
- 40% of the resources are 1,556 bytes or less,
- 50% of the resources are 2,689 bytes or less, MEDIAN
- 60% of the resources are 4,776 bytes or less,
- 70% of the resources are 7,062 bytes or less,
- 80% of the resources are 16,280 bytes or less,
- 90% of the resources are 86,113 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 232 bytes or less,
- 20% of the resources are 422 bytes or less,
- 30% of the resources are 737 bytes or less,
- 40% of the resources are 1,049 bytes or less,
- 50% of the resources are 1,732 bytes or less, MEDIAN
- 60% of the resources are 2,815 bytes or less,
- 70% of the resources are 4,743 bytes or less,
- 80% of the resources are 6,367 bytes or less,
- 90% of the resources are 11,140 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3377 URLs (0.64 %)
- 10 to 100 bytes: 15106 URLs (2.9 %)
- 100 to 1000 bytes: 149371 URLs (28.4 %)
- 1 to 10 kbytes: 229773 URLs (43.7 %)
- 10 to 100 kbytes: 78180 URLs (14.9 %)
- 100 to 1000 kbytes: 30826 URLs (5.9 %)
- More than 1000 kbytes: 18711 URLs (3.56 %)
Most common media (MIME) types
- text/gemini: 396,061 URLs
- image/jpeg: 25,207 URLs
- text/plain: 24,484 URLs
- image/png: 24,030 URLs
- application/pdf: 13,880 URLs
- application/octet-stream: 10,943 URLs
- text/x-go: 5,495 URLs
- application/zip: 3,026 URLs
- image/svg+xml: 2,809 URLs
- image/gif: 2,292 URLs
- octet/stream: 1,919 URLs
- application/x-mscardfile: 1,869 URLs
- text/html: 1,807 URLs
- audio/mpeg: 1,419 URLs
- text/xml: 1,252 URLs
- text/x-diff: 895 URLs
- text/markdown: 756 URLs
- application/json: 724 URLs
- application/atom+xml: 671 URLs
- application/javascript: 579 URLs
Most common languages
- Unspecified: 394,366 URLs
- en: 95,550 URLs
- de: 12,201 URLs
- it: 7,500 URLs
- fr: 7,079 URLs
- es: 2,873 URLs
- es_ar: 1,181 URLs
- fa: 1,009 URLs
- arb: 669 URLs
- ja: 585 URLs
- ru: 569 URLs
- en_gb: 337 URLs
- grc: 244 URLs
- en_au: 223 URLs
- en_us: 218 URLs
- he: 156 URLs
- pl: 101 URLs
- eo: 84 URLs
- sv: 76 URLs
- gl: 55 URLs
Most common language tags
- Unspecified: 394,319 URLs
- en: 40,319 URLs
- en-us: 31,264 URLs
- en-gb: 22,957 URLs
- de: 12,143 URLs
- it: 7,500 URLs
- fr: 6,253 URLs
- es-es: 1,665 URLs
- es_ar: 1,181 URLs
- es: 1,177 URLs
- fa: 1,009 URLs
- fr-fr: 826 URLs
- arb: 669 URLs
- ja: 585 URLs
- en-ie: 476 URLs
- ru: 427 URLs
- en-ca: 346 URLs
- en_gb: 337 URLs
- grc: 244 URLs
- en_au: 223 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 441,352 URLs
- utf-8: 83,687 URLs
- binary: 215 URLs
- us-ascii: 81 URLs
- gzip: 4 URLs
- xz: 2 URLs
- bzip2: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 328,943 URLs
- utf-8: 67,117 URLs
- iso-8859-1: 1 URLs
By the way, 1,509 of recently tested URLs (0.247Â %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 525,344 occurrences (91.64 %)
- 51 (Not found): 26,196 occurrences (4.57 %)
- 60 (Client certificate request): 5,989 occurrences (1.04 %)
- 40 (Temporary failure): 5,220 occurrences (0.91 %)
- 30 (Temporary redirect): 4,437 occurrences (0.77 %)
- 10 (Input request): 4,273 occurrences (0.75 %)
- 42 (CGI error): 921 occurrences (0.16 %)
- 31 (Permanent redirect): 494 occurrences (0.09 %)
- 44 (Slow down): 113 occurrences (0.02 %)
- 59 (Bad request): 90 occurrences (0.02 %)
- 53 (Proxy request refused): 86 occurrences (0.02 %)
- 50 (Permanent failure): 53 occurrences (0.01 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 304
Average number of incoming links: 0.25
Capsules
There are 3801 capsules. We successfully connected recently to 2765 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- mirrors.apple2.org.za: 10000 URLs
- midnight.pub: 10000 URLs
- git.skyjake.fi: 10000 URLs
- gemlog.stargrave.org: 10000 URLs
- fumble-around.mediocregopher.com: 9999 URLs
- taz.de: 9997 URLs
- gemini.omarpolo.com: 9996 URLs
- hoagie.space: 9993 URLs
- 1436.ninja: 9993 URLs
- gemini.techrights.org: 9991 URLs
- musicbrainz.uploadedlobster.com: 9991 URLs
- gemini.tuxmachines.org: 9989 URLs
- library.inu.red: 9983 URLs
- caiofior.pollux.casa: 9982 URLs
- tjp.lol: 9956 URLs
- bbs.geminispace.org: 9953 URLs
- gemini.autonomy.earth: 9949 URLs
- oracular.space: 9897 URLs
- gmi.noulin.net: 9893 URLs
- scholasticdiversity.us.to: 9879 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- 1436.ninja: 9586.9 megabytes
- mirrors.apple2.org.za: 2803.9 megabytes
- nytpu.com: 1621.5 megabytes
- uscoffings.net: 930.2 megabytes
- gem.librehacker.com: 909.2 megabytes
- librehacker.com: 856.9 megabytes
- gael.mooo.com: 715.1 megabytes
- blitter.com: 668.3 megabytes
- jpfox.fr: 621.5 megabytes
- yam655.com: 598.3 megabytes
- dfdn.info: 554.8 megabytes
- hoagie.space: 499.1 megabytes
- gemini.omarpolo.com: 387.0 megabytes
- mikelynch.org: 368.7 megabytes
- si3t.ch: 336.6 megabytes
- library.inu.red: 324.2 megabytes
- ecs.d2evs.net: 306.9 megabytes
- tweek.zyxxyz.eu: 293.3 megabytes
- canary.city: 239.2 megabytes
- gemi.dev: 221.8 megabytes
- going-flying.com: 197.7 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2497 (90.3 %) capsules are self-signed, 208 (7.5 %) use the Certificate Authority Let's Encrypt, 60 (2.2 %) are signed by another CA (may be not a trusted one).
76 capsules (2.77Â %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1743 capsules
- sha256WithRSAEncryption: 996 capsules
- ED25519: 18 capsules
- sha512WithRSAEncryption: 5 capsules
- ecdsa-with-SHA512: 3 capsules
- ecdsa-with-SHA384: 1 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1795 capsules
- RSA: 954 capsules
- ED25519: 18 capsules
Key sizes for RSA:
- 2048: 674 capsules
- 4096: 270 capsules
- 3072: 7 capsules
- 1024: 3 capsules
Key sizes for ECDSA:
- 256: 1732 capsules
- 384: 62 capsules
- 521: 1 capsules
TLS
98Â % of the capsules use TLS 1.3, 2Â % use TLS 1.2.
robots.txt
288 (10Â %) the capsules have a robots.txt exclusion file.
Ports
17 working capsules (0.6 %) use an alternative port
Addresses
1184 IP addresses used. 18 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 868 vhosts
- 68.133.1.71: 416 vhosts
- 213.219.38.200: 252 vhosts
- 46.23.81.157: 117 vhosts
- 2a03:6000:1813:1337::157: 91 vhosts
- 109.237.26.252: 31 vhosts
- 90.65.170.44: 31 vhosts
- 45.56.93.217: 19 vhosts
- 128.140.115.191: 11 vhosts
- 212.71.248.87: 9 vhosts
- 51.222.161.16: 9 vhosts
- 2a03:6000:6f67:624::99: 8 vhosts
- 46.23.94.99: 8 vhosts
- 81.187.234.86: 8 vhosts
- 174.138.124.169: 8 vhosts
- 23.88.35.144: 8 vhosts
- 2a01:4f8:c17:20f1::42: 8 vhosts
- 64.226.23.78: 7 vhosts
- 85.208.51.149: 7 vhosts
- 66.175.211.51: 6 vhosts
TLDs
There are 253 TLDs in the capsule's names, and 1836 registered domains.
Most common TLDs
By number of registered domains
- com: 292 domains
- net: 155 domains
- org: 153 domains
- xyz: 124 domains
- space: 84 domains
- site: 62 domains
- de: 52 domains
- dev: 50 domains
- me: 47 domains
- eu: 33 domains
- uk: 31 domains
- fr: 29 domains
- io: 27 domains
- info: 25 domains
- club: 20 domains
- ca: 16 domains
- ch: 15 domains
- online: 14 domains
- ru: 14 domains
- cc: 14 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 875 capsules
- org: 612 capsules
- com: 358 capsules
- pub: 265 capsules
- net: 182 capsules
- xyz: 140 capsules
- space: 101 capsules
- site: 65 capsules
- de: 60 capsules
- dev: 56 capsules
- me: 48 capsules
- club: 46 capsules
- eu: 39 capsules
- casa: 38 capsules
- io: 36 capsules
- uk: 35 capsules
- fr: 32 capsules
- info: 32 capsules
- us: 21 capsules
- cc: 20 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule