💾 Archived View for rawtext.club › ~sloum › geminilist › 000537.gmi captured on 2020-11-07 at 01:34:00. Gemini links have been rewritten to link to archived content

-=-=-=-=-=-=-

GUS questions

colecmac at protonmail.com colecmac at protonmail.com

Tue May 5 16:45:04 BST 2020

- - - - - - - - - - - - - - - - - - - ```

Hi, thanks for the reply!

Crawl-load is a good point, let's keep Gemini DDOS-free! I definitelythink that 500ms delay could be larger though, maybe 1-2 seconds?I suppose it depends what kind of server is hosting the website.

Thanks for the code link, it's very cool! I might play around with itlater.

As for paging, what if it was part of the URL path? Like the initialsearch link asks for a query, then leads you togemini://gus.guru/page/1?queryhere and then there's a link at thebottom leading you to gemini://gus.guru/page/2?queryhere, etc. Idon't know if Jetforce can extract the page number for you, but ifnot it would be easy to do.

makeworld


‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐On Tuesday, May 5, 2020 8:48 AM, Natalie Pendragon <natpen at natpen.net> wrote:

> Hi!
>
> The source code for GUS is available here [1]. I wouldn't consider it
> "batteries-included," so if you want to run it yourself it may be a
> bit of an adventure! If you host an instance, note that we'll be
> increasing the "crawl-load" on Geminispace non-trivially - this
> actually motivated a commit this morning to add support for respecting
> robots.txt's `crawl_delay` and also added a default per-domain 500ms
> delay. Let's be kind with our crawls together :)
>
> Paging is not implemented. I had been thinking about different ways to
> implement it, but haven't really figured a solution I like yet. I
> could just have it return all results I suppose, given the current
> size of Geminispace, but I have slight misgivings about that approach
> as well, since some queries can return hundreds of results. In the
> meantime, I've simply left it unimplemented and hoped that the top ten
> results would be sufficient for most usage.
>
> [1] https://git.sr.ht/~natpen/gus
>
> On Mon, May 04, 2020 at 11:47:56PM +0000, colecmac at protonmail.com wrote:
>
> 
> Hello all,
> 
> I just have some quick questions about GUS that I figured the whole list
> 
> could benefit from.
> 
> Is there source code available anywhere? I'd love to read it and learn,
> 
> or even host my own instance.
> 
> The other thing I'm wondering is how to get to other pages. When I search
> 
> something, GUS mentions "Page 1 of X" at the bottom, but there doesn't seem
> 
> to be any way to get to the other page.
> 
> makeworld