full image - Repost: Help a n00b sort out their storage? (from Reddit.com, Help a n00b sort out their storage?)
Mining:
Exchanges:
Donations:
I've put together a system over the last few months by basically throwing things at it to see if it works and brute force learning how to fix it when it doesn't. All well and good and I've ended up with a nice setup that does what I want and I've gone from zero knowledge to learning a lot of new things along the way. Still a n00b though :) But, the storage was also just thrown together seemingly at random. I'm still learning, so why I've done things the way I have is a mystery to me. Seemed the right thing to do at the time I suppose.I'm open to suggestions on how to optimise this as I think I could do better.Anyway, got a 2 node Proxmox setup (and a QD)Node 1: 512Gb SSD + 1Tb SSD, both internalNode 2: x2 internal 2Tb SSDI don't use HA, although I might in the future.Node 1:The 512Gb is Proxmox and takes up the whole drive for LVM-Thin. Only using about 70Gb for that thoughThe 1Tb is set up as a ZFS "tank". This is "disposable" media that will deleted after watchingI have this attached to a Turnkey Linux Webmin lxc which shares it via NFSIt's also attached to the other containers that need it...Docker, Arr Stack, JellyfinIt is not mounted to the node (not even sure if you can?)Node 2: I installed Proxmox on one of the 2Tb. This took up the whole drive, so I then resized the partition to be 512Gb and is similar to above.The remaining 1.5Tb is set up as another ZFS "tank" and has stuff that I need would like to keep eg Immich photo dump/libraryThis is also attached to a Turnkey Linux Webmin lxc, shared via NFS and attached to other containers on the Node as needed.Again, not mounted to the actual node.The other 2Tb is unused at present.I run Docker on both nodes and on a Synology, so 3 separate machines. All 3 use the Tank on Node 2 for their persistent storage. The Synology & Node 1 access the Tank via NFS and Node 2 accesses it as it's mounted to the Docker container. All the compose files use full paths in their bind mounts to point to their relevant storage locations on the Tank. I have PBS running in Docker on the Synology NAS* and this backs up all the containers and virtual machines from both nodes to the SynologyI have Kopia running on Node 2 and this backs up the folder containing all the Docker stuff and other files and folders (Immich etc) from the Tank to the SynologySo, questionsI've read some folk don't use the LVM-Thin at all, what would be the advantages? All backups are done to the Synology and I have 1Gb/s internet, so I don't really need to store templates or ISO's, just storage for the container volumes and VM Disks. All 3 servers are on a wired 2.5Gb/s network. Even if I doubled how much storage I need for the containers, I'd still only be using less than 1/2 of the space on each Node.Should I have partitioned the drive on Node 2?Is ZFS correct for my use case? Should I have set things up differently? If so, in what way? Would a plain Directory have been better? (note, not sure what the difference is, remember I'm a n00b and some things stick when I read about them, some don't)Is there a better way to organise and back up the Docker stuff? I would prefer to keep it all in one place for easier backing up. I have a consistent folder structure and it's compatible with things like Dockge, although I mainly use Portainer.Should I be using some sort of mirroring?*The Synology is currently set up as 4 separate drives with SMB shares. It's that way because that's how it was set up 2 years ago when I only had an Arr Stack (not even a Stack, used the Synology apps), a desktop and an nvidia shield to contend with. This will be re-jigged into a 4 drive raid of some sort, but I want to sort the rest out first.I've also broken my set up more often than I should have but I have successfully recovered each time. My Disaster Recovery still needs some work but I've learned a bit more each time.If you've read this far, thanks :)Pre-emptive edits:I'm aware of the arguments over lxc vs VM for Docker. It's a Homelab, I've picked my side :pApologies if I haven't used the correct terminology, still learning :)
Social Media Icons