HN Hall of Fame Weekly email

Files Are Hard

Screenshot of danluu.com captured 2026-07-20
Page preview · captured 2026-07-20

Resurfaced independently across 6 calendar years, with breakout response in 3 of them.

submissions
8
submitters
8
observed span
2015–2022
peak thread · 151 comments
451 pts
latest 20+ return · 2019-12-01
170 pts

Submission timeline

2007–2026

One slot for every year since HN launched. Height is that year's peak points; orange marks a 100+ point or 50+ comment breakout. Select a bar to open its strongest thread.

First comments on top threads

HN comment order

Pretty much spot on. Local in-kernel file systems are hard, partly because of their essential nature and partly because of their history. A lot of the codebases involved still show their origins on single-core systems and pre-NCQ SATA disks, and the development/testing methods are from the same era. The developers always have time to improve the numbers on some ancient micro-benchmark, but new features often get pushed to the LVM layer (snapshots), languish for ages (unions/overlays), or are simply ignored…

I strongly recommend using Sqlite for your own document format. Sqlite is one of the most well-tested pieces of software on earth and ACID-compliant. You can even make it safer than the default if you don't need maximum performance only need it for storing documents. It is very crash and corruption proof, especially with the full sync option and if you use it from one thread only.

This entire situation is a barely contained disaster. Doing all the steps listed at the top of the article is not only exhausting and error prone, it also dramatically lowers write performance. The most frustrating part is that (as I understand it) SSD and NVME hardware exposes strict read and write ordering to the OS anyway. That would allow file modification code to be written in a way thats both fast and correct. After all, these are the primitives we…

josephg·127-point thread·

(2015) Previous discussions: - 2015-12-13: https://news.ycombinator.com/item?id=10725859 - 2019-12-01: https://news.ycombinator.com/item?id=21674610

The first top-level comment from each of the four biggest threads, in HN’s own order. Excerpts are shortened; open a comment for full context.

Breakout years
3

100+ points or 50+ comments

Total points
766

reference only — not used in Hall rules or ranking

Total comments
230

reference only — not used in Hall rules or ranking

Every submission

DateTitle as submittedByPointsComments
2015-12-13Files Are HardFirst breakout · Best threadpyb451151
2017-11-22File crash consistency and filesystems are hardJoshTriplett40
2018-03-30File consistency (2015)navinsylvester12726
2019-12-01Files Are Hard (2015)Latest 20+ point returnsigna1117050
2021-03-23Files Are HardHall inductionmzs21
2021-08-17Files Are Hard (2015)yagizdegirmenci31
2022-08-13Files Are Hardeis51
2022-08-24Files Are Hard (2015)s17n40