3 upvotes, 1 direct replies (showing 1)
Why not https://archive.org/[1] instead?
Or both?
Comment by CelineHagbard at 18/11/2017 at 22:17 UTC
6 upvotes, 2 direct replies
I had originally intended to use archive.org, but there's a few issues that complicate it. For one, it obeys robots.txt, which disallows webcrawlers from accessing sites who use it. It also appears to not follow redirects, meaning if someone uses a link shortener, it won't archive the correct page.
I'm not opposed to adding it, but it will work on far fewer links out of the box.