💾 Archived View for bbs.geminispace.org › s › Geminispace › 3812 captured on 2023-11-14 at 08:50:34. Gemini links have been rewritten to link to archived content
⬅️ Previous capture (2023-11-04)
-=-=-=-=-=-=-
I am working on converting the CIA World Factbook to gemtext. It is coming along pretty well, the original web version does not really use much more than three levels of headers anyway.
Aug 04 · 3 months ago · 👍 skyjake, gritty, Smokey, michaelnordmeyer, mieum, Mirari, Ruby_Witch, norayr, fab, Eggsalad, dragfyre · 🎉 1
Very cool!
🍄 Ruby_Witch · Aug 04 at 18:18:
This is very useful, definitely good information to have available on Gemini! The CIA factbook has been something I've used a lot for research when writing papers in the past. It'll be interesting if you can find some way to keep it up to date.
🍵 michaelnordmeyer · Aug 05 at 14:53:
This takes me back a couple of decades :-D
This is super awesome @solderpunk. How are you doing the converting? I know it said manual, but that's a lot of content to do it without even some perl one-liners or something.
📻 solderpunk · Aug 13 at 11:43:
@Acidus Oh, there are definitly scripts involved! Python scripts. Pretty standard stuff, with Requests, BeautifulSoup and html2text. It's manual in that it's a small pile of scripts I need to run by hand in the right order and sometimes comment things in/out. It won't be hard or take long to turn it into something a little more turn-key. Eventually there will just be a weekly cron job to pull in updates. I really hope some kind of conditional fetch is supported by the CIA's HTTPS setup, so I can only download genuinely new stuff each week.