colecmac at protonmail.com colecmac at protonmail.com
Tue May 5 16:45:04 BST 2020
- - - - - - - - - - - - - - - - - - - ``` Hi, thanks for the reply! Crawl-load is a good point, let's keep Gemini DDOS-free! I definitelythink that 500ms delay could be larger though, maybe 1-2 seconds?I suppose it depends what kind of server is hosting the website. Thanks for the code link, it's very cool! I might play around with itlater. As for paging, what if it was part of the URL path? Like the initialsearch link asks for a query, then leads you togemini://gus.guru/page/1?queryhere and then there's a link at thebottom leading you to gemini://gus.guru/page/2?queryhere, etc. Idon't know if Jetforce can extract the page number for you, but ifnot it would be easy to do. makeworld ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐On Tuesday, May 5, 2020 8:48 AM, Natalie Pendragon <natpen at natpen.net> wrote: > Hi! > > The source code for GUS is available here [1]. I wouldn't consider it > "batteries-included," so if you want to run it yourself it may be a > bit of an adventure! If you host an instance, note that we'll be > increasing the "crawl-load" on Geminispace non-trivially - this > actually motivated a commit this morning to add support for respecting > robots.txt's `crawl_delay` and also added a default per-domain 500ms > delay. Let's be kind with our crawls together :) > > Paging is not implemented. I had been thinking about different ways to > implement it, but haven't really figured a solution I like yet. I > could just have it return all results I suppose, given the current > size of Geminispace, but I have slight misgivings about that approach > as well, since some queries can return hundreds of results. In the > meantime, I've simply left it unimplemented and hoped that the top ten > results would be sufficient for most usage. > > [1] https://git.sr.ht/~natpen/gus > > On Mon, May 04, 2020 at 11:47:56PM +0000, colecmac at protonmail.com wrote: > > > Hello all, > > I just have some quick questions about GUS that I figured the whole list > > could benefit from. > > Is there source code available anywhere? I'd love to read it and learn, > > or even host my own instance. > > The other thing I'm wondering is how to get to other pages. When I search > > something, GUS mentions "Page 1 of X" at the bottom, but there doesn't seem > > to be any way to get to the other page. > > makeworld