💾 Archived View for tommi.space › Storage.gmi captured on 2023-07-22 at 16:33:25. Gemini links have been rewritten to link to archived content

View Raw

More Information

⬅️ Previous capture (2023-01-29)

-=-=-=-=-=-=-

In the XXI century, storage is a big deal. Preserving personal data and memories is hard, but it is hell considering privacy and ethics of possible solutions. Naturally, I am very interested in this, while being no developer, nor engineer, nor having enough time to dedicate to this issues, therefore I will be noting some thoughts here.

<div class='yellow box'>
    To better understand my positions about this topic and their reasons, it would be useful to read my experience with [[Data loss|data loss]].
</div>

Needs

1. Durability: I want to be able to effortlessly access all of my data now as 30 years from now.

2. Reliability: my storage system has to be absolutely fail-proof (of course, no system is. I need to achieve the best reliability I can afford). [[Data loss|I cannot lose any of my data again]].

3. Scalability: the amount of pictures collected and stored by everyone in the world is growing at a tremendously fast pace, my pictures are no exception. I would prefer not to end up stuck in a resources consuming framework which is great with 2TB of pictures, but makes 10TB of pictures unmanageable.

4. Affordability: I should not spend too much on this. In the end, shooting pictures is not my job (yet).

5. Accessibility: if possible, I would like to be able to access all of my pictures from anywhere anytime.

6. Portability: the system I choose must be as bare-bones and simple as possible, so that, if in the future I want to switch to a better one, I can do it as seamlessly as possible.

7. “Replicability”: why should my system work for me only? It would be ideal, by documenting everything, to make my final solution “replicable”, hence available to anyone as a source of inspiration. I am writing these words for this reason.

growing at a tremendously fast pace

Doubts

https://piwigo.org/forum/viewtopic.php?id=31166

Research

Solutions

SSH

~~The solution I found out to be working greatly up to now is the one described in [[Importing workflow]], which consists in setting a window of [[Cron Jobs|a few hours per week]] while [[Linuxplosion]] is available to synchronize pictures and run tasks via SSH. In this way, storage is safely and redundantly backed up at home~~. This solution requires too much maintenance time and effort, it is fragile and unreliable on the go.

Cubbit

[[Cubbit]] is the most promising long-term solution, but it still lacks some crucial features. Furthermore, it is not optimized for pictures (yet): albums and photo galleries are limited to folders and sub-folders, there is not even any support for tags.

Photoprism

Photoprism is arguably the best Google Photos alternative. Nevertheless, it requires a relatively powerful hardware to run. It is the best possible solution in terms of usability, but not in terms of costs and eco-friendliness. Some installation resources

Photoprism

Some installation resources

Resources

lecture on Backups

Missing Semester

An engineer’s guide to cloud capacity planning

RAID

On [[Linuxplosion]], I am considering to configure a RAID 1 storage system. Below, some notes about this.

RAID 1

![[Personal storage management notes]]

đź’˝ How to Setup Software RAID with MDADM Command on Linux Ubuntu in 2021 đź’ľ

Ubuntu 20.04 Mdadm Setup Guide

![[Backup checklist]]