Data Integrity: Checksumming Filesystems

This is the fifth episode of a multi-part series on data integrity. Today we're going to be talking about the chucksumming filesystems that exist to protect your data and how they work. This video is intended to be more of a starting point for people who aren't familiar with RAID style data storage than it is a guide on any particular software.

===
Things I mentioned in the video:
===

SMR drives are a scrub nightmare: https://www.servethehome.com/wd-red-s...
Scroll down to the graph labelled "FreeNas 11.3-U2 RAIDZ Resilver Time". The data speaks for itself.

Western Digital caught selling SMR drives as enterprise drives without adequately labelling them: https://blocksandfiles.com/2020/04/14...

RAID architecture, why you should use mirroring instead of striping: https://jrs-s.net/2015/02/06/zfs-you-...

===
Further reading for getting started with a checksumming filesystem:
===

BTRFS is installed on most modern Linux distributions by default, with no additional configuration needed to install it. It's easy and I recommend it.
BTRFS Basic Use Guide: https://btrfs.wiki.kernel.org/index.p...
IMPORTANT! BTRFS WILL ONLY scrub your data for errors when you explicitly tell it to! You should set a cronjob to regularly scrub your array. Instruction on how to use the BTRFS scrub command can be found here: https://btrfs.readthedocs.io/en/lates...

I personally find ZFS annoying, but a lot of people swear by it because it has been the industry king for a long time. Check it out, maybe you'll like it more than BTRFS.
ZFS Getting Started: https://openzfs.github.io/openzfs-doc...
IMPORTANT! ZFS WILL ONLY scrub your data for errors when you explicitly tell it to! You should set a cronjob to regularly scrub your array. Instruction on how to use the ZFS scrub command can be found here: https://docs.oracle.com/cd/E18752_01/...

===
Data Integrity Playlist:    • Data Integrity and You  

Timestamps:
0:00 Recap
0:44 Intro
1:26 What is a filesystem?
3:08 What is RAID?
4:34 What is JBOD?
5:14 What is a checksum?
6:13 How does checksum error correction work?
7:02 Checksumming filesystems can do that automatically
8:00 Checksum your backups
9:16 Not all RAID tools are made equal
11:07 Hardware RAID sucks
11:40 Don't use SMR hard drives in your NAS
13:15 RAID is not a backup
14:23 Real time cloud sync tools are like RAID-- not a backup
15:12 Conclusions and further reading
16:05 Outro


---
Generic stock photos sourced from free to use assets on https://pixabay.com/
Meme photos sourced from wherever the hell you source memes from
---
Licensed model assets in use:
https://booth.pm/en/items/2245240
https://booth.pm/en/items/2660550