💾 Archived View for station.martinrue.com › astromech › fc86ffa16aa34717b517db3a305119a8 captured on 2024-05-12 at 16:43:24. Gemini links have been rewritten to link to archived content
⬅️ Previous capture (2024-03-21)
-=-=-=-=-=-=-
Search engine creators..... What do you do for capsules that go down (52 status code)? I find broken links from time to time..
2 years ago · 👍 acidus, krixano
I recently saw a tilde server go offline for two days due to a firewall mistake. I communicated this to the admins and they fixed it. Not a big deal. I would hope that search engines would implement a laid-back grace period to accomodate the DIY volunteer "slow Internet" crowd. · 2 years ago
@astromech One thing that I wanted to end up doing, which I got from the description of a very old web search engine, is instantly crawl capsules upon submission. This reporting of broken links idea could work well with that (by making sure submissions are actually broken).
Btw, I don't do a whole lot either - I don't even note which pages are broken yet. I've been planning on adding this eventually. Some search engines, from their description, will check the page multiple times before marking it as broken. · 2 years ago
awesome! I like that. Let me see what I can put together. · 2 years ago
I'm all for the report idea. That would make geminisphere even better imo.
Quick idea: Setup a content removal/broken links report form. Whether the submissions are processed manually or automatically or both is up to you. · 2 years ago
right now, not much. I mark the error and won’t return it for search results. i did have some ideas about producing a report for capsule owners about problems with their content. stuff like broken internal links, broken incoming links, incorrect mime types, missing/wrong lang attributes, etc.
Kennedy’s crawler doesn’t use the results of previous crawls to drive new crawls (beyond using it to create a list of initial capsules to visit), so despite the spec I will visit those URLs again. that will probably change at some point
what would you want to have happen? · 2 years ago