💾 Archived View for gemini.bortzmeyer.org › software › lupa › archive-stats › 2023-05-01.gmi captured on 2023-09-28 at 23:31:34. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-06-14)
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-04-22 08:11:13Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 528,382 URIs, 391,578 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 306,411 URIs serve a Gemini content.
Resources
The average size of the resources is 43,575 bytes.
Quantiles
- 10% of the resources are 265 bytes or less,
- 20% of the resources are 633 bytes or less,
- 30% of the resources are 948 bytes or less,
- 40% of the resources are 1,563 bytes or less,
- 50% of the resources are 2,658 bytes or less, MEDIAN
- 60% of the resources are 4,786 bytes or less,
- 70% of the resources are 7,196 bytes or less,
- 80% of the resources are 16,079 bytes or less,
- 90% of the resources are 82,347 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 232 bytes or less,
- 20% of the resources are 502 bytes or less,
- 30% of the resources are 782 bytes or less,
- 40% of the resources are 1,123 bytes or less,
- 50% of the resources are 1,799 bytes or less, MEDIAN
- 60% of the resources are 2,813 bytes or less,
- 70% of the resources are 4,825 bytes or less,
- 80% of the resources are 6,749 bytes or less,
- 90% of the resources are 13,510 bytes or less,
- 100% of the resources are 2,677,426 bytes or less.
Ranges
- Less than 10 bytes: 3296 URLs (0.84 %)
- 10 to 100 bytes: 10756 URLs (2.7 %)
- 100 to 1000 bytes: 108175 URLs (27.6 %)
- 1 to 10 kbytes: 171279 URLs (43.7 %)
- 10 to 100 kbytes: 65660 URLs (16.8 %)
- 100 to 1000 kbytes: 25280 URLs (6.5 %)
- More than 1000 kbytes: 7132 URLs (1.82 %)
Most common media (MIME) types
- text/gemini: 306,411 URLs
- image/png: 18,300 URLs
- image/jpeg: 16,777 URLs
- text/plain: 15,952 URLs
- application/octet-stream: 11,165 URLs
- application/pdf: 4,532 URLs
- application/zip: 3,103 URLs
- image/gif: 2,474 URLs
- octet/stream: 2,215 URLs
- text/html: 2,045 URLs
- application/x-mscardfile: 1,197 URLs
- audio/mpeg: 1,026 URLs
- MIME: 997 URLs
- text/x-diff: 777 URLs
- application/json: 598 URLs
- audio/ogg: 354 URLs
- text/xml: 243 URLs
- application/atom+xml: 239 URLs
- application/lagrange-fontpack+zip: 200 URLs
- image/webp: 198 URLs
Most common languages
- Unspecified: 306,875 URLs
- en: 60,420 URLs
- de: 11,097 URLs
- it: 7,020 URLs
- fr: 1,969 URLs
- fi: 1,115 URLs
- ja: 1,078 URLs
- ru: 843 URLs
- es: 333 URLs
- en_us: 217 URLs
- ko: 102 URLs
- ca: 86 URLs
- sv: 60 URLs
- gl: 57 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 29 URLs
- eo: 28 URLs
- tok: 24 URLs
- hu: 23 URLs
- it_it: 21 URLs
Most common language tags
- Unspecified: 306,831 URLs
- en: 33,177 URLs
- en-us: 13,374 URLs
- en-gb: 13,099 URLs
- de: 11,056 URLs
- it: 7,020 URLs
- fi: 1,115 URLs
- fr: 1,103 URLs
- ja: 1,078 URLs
- fr-fr: 866 URLs
- ru-ru: 707 URLs
- en-ie: 472 URLs
- es-es: 322 URLs
- en-au: 271 URLs
- en_us: 217 URLs
- ru: 136 URLs
- ko: 102 URLs
- ca-es: 84 URLs
- sv: 60 URLs
- gl-es: 54 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 350,386 URLs
- utf-8: 41,059 URLs
- us-ascii: 75 URLs
- binary: 24 URLs
- gzip: 23 URLs
- windows-1252: 2 URLs
- bzip2: 2 URLs
- cp437: 2 URLs
- u: 2 URLs
- utf-16: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 273,777 URLs
- utf-8: 32,627 URLs
- cp437: 2 URLs
- utf-16: 2 URLs
- windows-1252: 2 URLs
- iso-8859-1: 1 URLs
By the way, 1,216 of recently tested URLs (0.238 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 391,578 occurrences (83.31 %)
- 51 (Not found): 37,900 occurrences (8.06 %)
- 40 (Temporary failure): 11,434 occurrences (2.43 %)
- 60 (Client certificate request): 5,665 occurrences (1.21 %)
- 44 (Slow down): 5,545 occurrences (1.18 %)
- 30 (Temporary redirect): 5,279 occurrences (1.12 %)
- 42 (CGI error): 4,378 occurrences (0.93 %)
- 53 (Proxy request refused): 3,653 occurrences (0.78 %)
- 10 (Input request): 3,432 occurrences (0.73 %)
- 31 (Permanent redirect): 770 occurrences (0.16 %)
- 50 (Permanent failure): 129 occurrences (0.03 %)
- 59 (Bad request): 117 occurrences (0.02 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 263
Average number of incoming links: 0.20
Capsules
There are 3133 capsules. We successfully connected recently to 2363 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- gemini.conman.org: 10000 URLs
- midnight.pub: 10000 URLs
- gemlog.stargrave.org: 9999 URLs
- blitter.com: 9998 URLs
- rwv.io: 9996 URLs
- taz.de: 9995 URLs
- jsreed5.org: 9994 URLs
- gemini.techrights.org: 9993 URLs
- hoagie.space: 9991 URLs
- mirrors.apple2.org.za: 9958 URLs
- caiofior.pollux.casa: 9804 URLs
- gemini.knusbaum.com: 9752 URLs
- gemini.tuxmachines.org: 9586 URLs
- news.tuxmachines.org: 9477 URLs
- gemini.omarpolo.com: 9112 URLs
- library.inu.red: 9103 URLs
- gemini.autonomy.earth: 8827 URLs
- ecs.d2evs.net: 8459 URLs
- rawtext.club: 7787 URLs
- skyjake.fi: 6644 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2776.0 megabytes
- uscoffings.net: 915.7 megabytes
- nytpu.com: 878.8 megabytes
- blitter.com: 824.1 megabytes
- gael.mooo.com: 667.2 megabytes
- yam655.com: 584.6 megabytes
- hoagie.space: 496.1 megabytes
- skyjake.fi: 423.9 megabytes
- mikelynch.org: 315.7 megabytes
- ecs.d2evs.net: 287.4 megabytes
- library.inu.red: 263.4 megabytes
- b2khgkvb2wn4avjshjp63kknsjwikgwff5dwwydldia6qwf4kdnueyad.onion: 258.2 megabytes
- si3t.ch: 252.5 megabytes
- multiverse.thruhere.net: 234.7 megabytes
- tweek.zyxxyz.eu: 233.5 megabytes
- gem.librehacker.com: 228.7 megabytes
- shit.cx: 180.5 megabytes
- phreedom.club: 175.9 megabytes
- gemini.techrights.org: 174.3 megabytes
- rwv.io: 168.5 megabytes
- gem.girlmeow.autos: 165.5 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2095 (88.7 %) capsules are self-signed, 206 (8.7 %) use the Certificate Authority Let's Encrypt, 62 (2.6 %) are signed by another CA (may be not a trusted one).
58 capsules (2.47 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1537 capsules
- sha256WithRSAEncryption: 817 capsules
- ED25519: 13 capsules
- ecdsa-with-SHA512: 5 capsules
- ecdsa-with-SHA384: 2 capsules
- sha512WithRSAEncryption: 2 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1570 capsules
- RSA: 794 capsules
- ED25519: 13 capsules
Key sizes for RSA:
- 2048: 531 capsules
- 4096: 251 capsules
- 3072: 9 capsules
- 1024: 1 capsules
- 512: 1 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1489 capsules
- 384: 79 capsules
- 521: 2 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
8.8 % of capsules do NOT send a proper close.
The full list
robots.txt
224 (9 %) the capsules have a robots.txt exclusion file.
Ports
11 working capsules (0.5 %) use an alternative port
Addresses
1165 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 772 vhosts
- 68.133.1.71: 271 vhosts
- 213.219.38.200: 199 vhosts
- 173.195.146.139: 99 vhosts
- 90.65.170.44: 28 vhosts
- 109.237.26.252: 19 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 104.245.33.223: 8 vhosts
- 52.51.189.88: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 139.162.187.208: 6 vhosts
- 51.222.161.16: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 84.62.113.202: 5 vhosts
- 178.209.50.237: 5 vhosts
- 37.79.202.136: 5 vhosts
- 46.23.94.99: 5 vhosts
- 23.88.35.144: 5 vhosts
TLDs
There are 242 TLDs in the capsule's names, and 1555 registered domains.
Most common TLDs
By number of registered domains
- com: 254 domains
- net: 134 domains
- org: 127 domains
- xyz: 107 domains
- space: 69 domains
- de: 45 domains
- site: 42 domains
- me: 40 domains
- dev: 38 domains
- eu: 32 domains
- uk: 25 domains
- io: 24 domains
- fr: 23 domains
- info: 23 domains
- club: 18 domains
- online: 13 domains
- ch: 13 domains
- ca: 13 domains
- se: 11 domains
- us: 11 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 784 capsules
- org: 429 capsules
- com: 308 capsules
- pub: 204 capsules
- net: 157 capsules
- xyz: 114 capsules
- space: 86 capsules
- de: 52 capsules
- site: 45 capsules
- me: 42 capsules
- dev: 40 capsules
- eu: 39 capsules
- club: 39 capsules
- casa: 35 capsules
- io: 32 capsules
- info: 29 capsules
- uk: 27 capsules
- fr: 24 capsules
- us: 18 capsules
- ch: 17 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule