💾 Archived View for gemini.bortzmeyer.org › software › lupa › stats.gmi captured on 2023-09-28 at 15:49:25. Gemini links have been rewritten to link to archived content
View Raw
More Information
⬅️ Previous capture (2023-09-08)
➡️ Next capture (2023-11-04)
🚧 View Differences
-=-=-=-=-=-=-
Statistics on the Gemini space
This page presents some statistics on the current state of the Gemini space. It has been updated on 2023-09-28 03:04:02Z.
It cannot claim to represent the entire space. The real number of URIs is certainly higher. There are several reasons why many URIs are not in the database:
- the capsule may forbid retrieval, through robots.txt,
- we do not know all the URIs and some cannot be found from the ones we know,
- Lupa has a maximum number of URIs per capsule, to save resources (currently 10000).
On this page, "working" means there was a successful connection recently. "recently" means "less than 31 days". "Dead" URLs and capsules are removed after 46 days and no longer appear in any statistics.
Currently, our database includes 587,923 URIs, 471,711 of them having been checked successfully (status code 20) and recently. Among the recently accessed, 363,447 URIs serve a Gemini content.
Resources
The average size of the resources is 40,616 bytes.
Quantiles
- 10% of the resources are 275 bytes or less,
- 20% of the resources are 581 bytes or less,
- 30% of the resources are 964 bytes or less,
- 40% of the resources are 1,654 bytes or less,
- 50% of the resources are 2,829 bytes or less, MEDIAN
- 60% of the resources are 5,223 bytes or less,
- 70% of the resources are 7,738 bytes or less,
- 80% of the resources are 17,035 bytes or less,
- 90% of the resources are 59,737 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Quantiles only for Gemini pages
- 10% of the resources are 244 bytes or less,
- 20% of the resources are 463 bytes or less,
- 30% of the resources are 778 bytes or less,
- 40% of the resources are 1,167 bytes or less,
- 50% of the resources are 1,963 bytes or less, MEDIAN
- 60% of the resources are 3,216 bytes or less,
- 70% of the resources are 5,463 bytes or less,
- 80% of the resources are 7,567 bytes or less,
- 90% of the resources are 16,568 bytes or less,
- 100% of the resources are 4,156,230 bytes or less.
Ranges
- Less than 10 bytes: 3250 URLs (0.69 %)
- 10 to 100 bytes: 11879 URLs (2.5 %)
- 100 to 1000 bytes: 129792 URLs (27.5 %)
- 1 to 10 kbytes: 201746 URLs (42.8 %)
- 10 to 100 kbytes: 91757 URLs (19.5 %)
- 100 to 1000 kbytes: 25458 URLs (5.4 %)
- More than 1000 kbytes: 7829 URLs (1.66 %)
Most common media (MIME) types
- text/gemini: 363,447 URLs
- text/plain: 29,446 URLs
- image/png: 19,165 URLs
- image/jpeg: 18,226 URLs
- application/octet-stream: 16,310 URLs
- application/pdf: 4,677 URLs
- application/zip: 3,134 URLs
- octet/stream: 2,215 URLs
- text/html: 2,006 URLs
- image/gif: 2,004 URLs
- audio/mpeg: 1,264 URLs
- application/x-mscardfile: 1,199 URLs
- MIME: 1,061 URLs
- text/x-diff: 978 URLs
- text/markdown: 698 URLs
- application/json: 694 URLs
- application/atom+xml: 558 URLs
- text/xml: 544 URLs
- audio/ogg: 404 URLs
- application/xml: 307 URLs
Most common languages
- Unspecified: 370,867 URLs
- en: 71,760 URLs
- de: 11,062 URLs
- it: 7,122 URLs
- fr: 5,441 URLs
- es: 1,505 URLs
- ja: 1,128 URLs
- es_ar: 905 URLs
- ru: 531 URLs
- en_gb: 369 URLs
- en_us: 223 URLs
- pl: 153 URLs
- ko: 97 URLs
- ca: 86 URLs
- sv: 69 URLs
- gl: 54 URLs
- eo: 40 URLs
- sco,gd,it,en: 38 URLs
- pl,en: 31 URLs
- en,he: 27 URLs
Most common language tags
- Unspecified: 370,822 URLs
- en: 35,356 URLs
- en-us: 19,705 URLs
- en-gb: 15,962 URLs
- de: 11,001 URLs
- it: 7,122 URLs
- fr: 4,492 URLs
- es-es: 1,479 URLs
- ja: 1,128 URLs
- fr-fr: 949 URLs
- es_ar: 905 URLs
- en-ie: 473 URLs
- ru-ru: 398 URLs
- en_gb: 369 URLs
- en_us: 223 URLs
- ru: 133 URLs
- pl: 105 URLs
- en-au: 104 URLs
- ko: 97 URLs
- ca-es: 84 URLs
Most common encodings ("charsets") for all files
(Remember there exists testing capsules, with very exotic encodings, so don't be surprised by some strange ones.)
- Unspecified: 401,473 URLs
- utf-8: 60,716 URLs
- us-ascii: 9,474 URLs
- gzip: 24 URLs
- binary: 20 URLs
- bzip2: 2 URLs
- iso-8859-1: 1 URLs
Most common encodings for gemtext files only
- Unspecified: 312,516 URLs
- utf-8: 50,930 URLs
- iso-8859-1: 1 URLs
By the way, 1,257 of recently tested URLs (0.222 %) have a wrong encoding (it does not match the actual content).
Status codes
(Remember there are test capsules with funny status codes, to exercice Gemini clients.)
- 20 (Success): 471,710 occurrences (86.91 %)
- 51 (Not found): 21,156 occurrences (3.90 %)
- 50 (Permanent failure): 19,407 occurrences (3.58 %)
- 40 (Temporary failure): 12,629 occurrences (2.33 %)
- 60 (Client certificate request): 5,571 occurrences (1.03 %)
- 53 (Proxy request refused): 4,934 occurrences (0.91 %)
- 10 (Input request): 3,902 occurrences (0.72 %)
- 42 (CGI error): 1,590 occurrences (0.29 %)
- 30 (Temporary redirect): 1,218 occurrences (0.22 %)
- 31 (Permanent redirect): 279 occurrences (0.05 %)
- 44 (Slow down): 175 occurrences (0.03 %)
- 59 (Bad request): 130 occurrences (0.02 %)
Links
(We count only backlinks from external capsules, and at most one link per capsule. Also, we exclude links from capsules like search engines or directories.)
Maximum number of incoming links: 281
Average number of incoming links: 0.18
Capsules
There are 3554 capsules. We successfully connected recently to 2551 of them.
Most common capsules by number of working URLs
We have a limit of 10000 URLs per capsule.
- gemini.conman.org: 10000 URLs
- midnight.pub: 10000 URLs
- blitter.com: 9998 URLs
- mirrors.apple2.org.za: 9997 URLs
- rwv.io: 9996 URLs
- jsreed5.org: 9995 URLs
- hoagie.space: 9994 URLs
- library.inu.red: 9991 URLs
- gemlog.stargrave.org: 9990 URLs
- spam.works: 9983 URLs
- caiofior.pollux.casa: 9980 URLs
- taz.de: 9975 URLs
- tjp.lol: 9950 URLs
- gemini.techrights.org: 9796 URLs
- gemini.unlimited.pizza: 9785 URLs
- gemini.knusbaum.com: 9749 URLs
- gemini.omarpolo.com: 9718 URLs
- mastogem.remorse.us: 9648 URLs
- auragem.letz.dev: 9416 URLs
- gemini.autonomy.earth: 9362 URLs
Most common capsules by number of bytes in working URLs
We have a limit of bytes per URL.
Not properly documented yet
- mirrors.apple2.org.za: 2801.8 megabytes
- nytpu.com: 1082.2 megabytes
- uscoffings.net: 926.0 megabytes
- blitter.com: 824.1 megabytes
- gael.mooo.com: 755.5 megabytes
- gem.librehacker.com: 750.8 megabytes
- yam655.com: 597.2 megabytes
- hoagie.space: 496.5 megabytes
- skyjake.fi: 440.6 megabytes
- gemini.omarpolo.com: 379.6 megabytes
- gemini.zachdecook.com: 340.3 megabytes
- library.inu.red: 324.7 megabytes
- ecs.d2evs.net: 297.0 megabytes
- jpfox.fr: 269.9 megabytes
- tweek.zyxxyz.eu: 255.5 megabytes
- shit.cx: 182.3 megabytes
- phreedom.club: 178.2 megabytes
- higeki.jp: 177.0 megabytes
- gemini.techrights.org: 171.0 megabytes
- rwv.io: 168.5 megabytes
- going-flying.com: 167.7 megabytes
All working capsules:
As a text file
As a gemtext, with links
Certificates
2281 (89.4 %) capsules are self-signed, 212 (8.3 %) use the Certificate Authority Let's Encrypt, 58 (2.3 %) are signed by another CA (may be not a trusted one).
62 capsules (2.44 %) have an expired certificate.
Algorithms:
- ecdsa-with-SHA256: 1647 capsules
- sha256WithRSAEncryption: 884 capsules
- ED25519: 14 capsules
- ecdsa-with-SHA512: 4 capsules
- sha512WithRSAEncryption: 2 capsules
- ecdsa-with-SHA384: 1 capsules
- sha384WithRSAEncryption: 1 capsules
Key types:
- ECDSA: 1686 capsules
- RSA: 853 capsules
- ED25519: 14 capsules
Key sizes for RSA:
- 2048: 588 capsules
- 4096: 249 capsules
- 3072: 12 capsules
- 1024: 3 capsules
- 3584: 1 capsules
Key sizes for ECDSA:
- 256: 1612 capsules
- 384: 72 capsules
- 521: 2 capsules
TLS
98 % of the capsules use TLS 1.3, 2 % use TLS 1.2.
robots.txt
252 (10 %) the capsules have a robots.txt exclusion file.
Ports
12 working capsules (0.5 %) use an alternative port
Addresses
1206 IP addresses used. 17 % are IPv6.
Addresses with most virtual hosts
- 173.230.145.243: 814 vhosts
- 68.133.1.71: 334 vhosts
- 213.219.38.200: 220 vhosts
- 173.195.146.139: 102 vhosts
- 90.65.170.44: 29 vhosts
- 109.237.26.252: 23 vhosts
- 45.56.93.217: 17 vhosts
- 216.238.66.109: 13 vhosts
- 128.140.115.191: 11 vhosts
- 51.222.161.16: 8 vhosts
- 174.138.124.169: 7 vhosts
- 85.208.51.149: 7 vhosts
- 104.245.33.223: 6 vhosts
- 89.234.140.141: 6 vhosts
- 2a00:5881:4008:d00::: 6 vhosts
- 139.162.187.208: 6 vhosts
- 2a01:7e01::f03c:93ff:fedf:bffe: 6 vhosts
- 68.183.213.240: 5 vhosts
- 172.105.4.126: 5 vhosts
- 89.253.220.199: 5 vhosts
TLDs
There are 260 TLDs in the capsule's names, and 1778 registered domains.
Most common TLDs
By number of registered domains
- com: 286 domains
- net: 150 domains
- org: 148 domains
- xyz: 123 domains
- space: 82 domains
- de: 55 domains
- dev: 52 domains
- me: 47 domains
- site: 46 domains
- eu: 32 domains
- fr: 32 domains
- uk: 30 domains
- io: 25 domains
- info: 24 domains
- club: 23 domains
- online: 16 domains
- se: 15 domains
- ch: 15 domains
- ru: 14 domains
- ca: 13 domains
By number of capsules
(There's a strong bias towards TLDs which have hosting services such as flounder.online, which has many capsules in subdomains. See before the TLDs per registered domains, which are probably more useful.)
- online: 834 capsules
- org: 528 capsules
- com: 347 capsules
- pub: 233 capsules
- net: 176 capsules
- xyz: 135 capsules
- space: 105 capsules
- de: 63 capsules
- dev: 55 capsules
- site: 49 capsules
- me: 48 capsules
- club: 47 capsules
- eu: 40 capsules
- casa: 37 capsules
- io: 34 capsules
- fr: 34 capsules
- uk: 33 capsules
- info: 31 capsules
- us: 19 capsules
- ru: 19 capsules
Other statistics on the geminispace
At the search engine geminispace.info
At the search engine TLGS
By Nervuri (specially for certificates)
Contact
Maintained by Stéphane Bortzmeyer (email <stephane+gemini@bortzmeyer.org>). Comments and criticisms are welcome.
Home page of the crawler
Source code of the crawler
My capsule