💾 Archived View for gemi.dev › gemini-mailing-list › 000869.gmi captured on 2023-11-04 at 13:10:05. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

[ANN] New version of Agunua with the recursive downloader

📧 Messages: 2
🗣️ Authors: 1
📅 First Message: 2021-04-17 15:16
📅 Last Message: 2021-05-05 13:00

Stephane Bortzmeyer <stephane (a) sources.org>

📅 Sent: 2021-04-17 15:16
📧 Message 1 of 2

I just released version 1.3 of the Agunua library
<gemini://gemini.bortzmeyer.org/software/agunua/>. It comes with a
command-line client, agunua, but also, new in version 1.3, a recursive
downloader, to get an entire capsule, geminitrack (the name comes from
the Web equivalent httrack). Useful for backups, for instance. I
believe there was no such program in the (rich) Gemini software
ecosystem.

geminitrack gemini://g?meaux.bortzmeyer.org/

And you have all the files at this capsule in your directory.

More details:

## Usage

 ```
geminitrack URL
 ```

And the files will be downloaded to the current directory, in a 
subdirectory named from the capsule name. The files will be named from the 
Gemini URL with some caveats (see later). The program limits itself to 
URLs which start with the original URL. So, it will never go to another 
capsule, for instance. `geminitrack` does not modify the files at all, so 
some internal links may break (for instance links to directories, links 
with queries, etc). 

By default, it limits the number of files downloaded and the time spent, 
mostly to preserve the remote server. *Don't change this behaviour unless 
you know the remote capsule authorizes it.*

Download is unconditional: whether or not there already exist a file in 
the destination directory, it will be written over.

Warning: characters in the URL path must be letters, digits and a few 
others. Everything else will be replaced with underscores.

## Options 


	`--verbose`: makes the download more talkative (default is false)
	`--maximum-files N`: maximum number of files to download (default 20)
	`--directory S`: directory to put the files on (default is current directory)
	`--exclude S`: files to exclude from downloading (a regular expression) 

(default is none)

	`--maximum-time N`:  maximum number of seconds for the download (default 30)
	`--sleep N`: number of seconds to sleep between two resources (default 1)
	`--raw-directory`: do not add the capsule name (and possibly path) after 

the storage directory (default is to add them)

	`--secure`: accepts only certificates signed a known Certificate 

Authority (default is to accept anything)

	`--no-tofu`: do not perform TOFU (Trust On First Use) key checking
	`--accept-expired-certificate`:  expired certificates are not accepted 

unless you use also this option

## Licence, author, etc

See [the general README of Agunua](README.md).

Link to individual message.

Stephane Bortzmeyer <stephane (a) sources.org>

Subject Changed! New Subject: [tech] Re: New version of Agunua with the recursive downloader
📅 Sent: 2021-05-05 13:00
📧 Message 2 of 2

On Sat, Apr 17, 2021 at 05:16:26PM +0200,
 Stephane Bortzmeyer <stephane at sources.org> wrote 
 a message of 45 lines which said:

> new in version 1.3, a recursive downloader, to get an entire
> capsule, geminitrack (the name comes from the Web equivalent
> httrack). Useful for backups, for instance. I believe there was no
> such program in the (rich) Gemini software ecosystem.

It seems there is a second one, now:

https://codeberg.org/oppenlab/cget

Link to individual message.

---

Previous Thread: [tech] tls user_canceled issue with Java server + Go client

Next Thread: [users] Announcing Gemini Quickstart!