💾 Archived View for gemini.complete.org › feeding-filespooler-queues-from-other-queues captured on 2024-08-18 at 17:45:54. Gemini links have been rewritten to link to archived content
⬅️ Previous capture (2024-07-09)
-=-=-=-=-=-=-
Sometimes with Filespooler[1], you may wish for your queue processing to effectively re-queue your jobs into other queues. Examples may be:
There are two approaches to this:
1. Directly reusing the job file in the destination. To do this, you would hard link the job file into the destination queue's jobs directory. See Parallel Processing of Filespooler Queues[2] for an example of this approach.
2. Alternatively, you could pipe data to `fspl prepare | fspl queue-write` as usual. This would have the effect of re-generating the sequence numbers, which may be desirable in some cases.
2: /parallel-processing-of-filespooler-queues/
Depending on the specifcs of your situation, you may have to process jobs out of order; see the conversation in Many-To-One with Filespooler[3] for more on this.
3: /many-to-one-with-filespooler/
--------------------------------------------------------------------------------
Filespooler lets you request the remote execution of programs, including stdin and environment. It can use tools such as S3, Dropbox, Syncthing[5], NNCP[6], ssh, UUCP[7], USB drives, CDs, etc. as transport; basically, a filesystem is the network for Filespooler.
Filespooler is particularly suited to distributed and Asynchronous Communication[8].
8: /asynchronous-communication/
(c) 2022-2024 John Goerzen