HN Hall of Fame Weekly email

SQLite small blob storage: 35% Faster Than the Filesystem

www.sqlite.org Research & data Technical reports Software engineering Class of 2023-01 Hall of Fame
Screenshot of www.sqlite.org captured 2026-07-20
Page preview · captured 2026-07-20

Resurfaced independently across 5 calendar years, with breakout response in 5 of them.

submissions
8
submitters
8
observed span
2017–2024
peak thread · 202 comments
612 pts
latest 20+ return · 2024-10-26
46 pts

Submission timeline

2007–2026

One slot for every year since HN launched. Height is that year's peak points; orange marks a 100+ point or 50+ comment breakout. Select a bar to open its strongest thread.

First comments on top threads

HN comment order

I must point out Jim Gray's paper To Blob or Not To Blob[0]. His team considered NTFS vs. SQL Server, but most rationale applies to any filesystem vs. database decision. The summary was "The study indicates that if objects are larger than one megabyte on average, NTFS has a clear advantage over SQL Server. If the objects are under 256 kilobytes, the database has a clear advantage. Inside this range, it depends on how write intensive the workload is," but…

rusanu·612-point thread·

No file system attributes or metadata on records which also means no (xattrs/fattrs) being written or updated, no checks to see if it's a physical file or a pipe/symlink, no permission checks, no block size alignment mismatches, single open command. Makes sense when you consider you're throwing out functionality and disregarding general purpose design. If you use a fuse mapping to SQLite, mount that directory and access it, you'd probably be very similar performance (perhaps even slower) and storage use…

tgtweak·487-point thread·

For small- to mid-sized projects, I’ve always realized huge gains in simplicity by haves “Files” tables to store various assets. It means instances in a web-farm can pull the files down when they initialize easily, it means files are automatically versioned, it provides an obvious place to put the files when they are being uploaded on the Admin panel. It means all the files are getting backed up as part of the database snapshots automatically. Things I’ve used this for…

zaroth·267-point thread·

This gets posted a lot here and I really wonder if anyone's bothered to try and replicate these results or test them with different sizes of data on different filesystems - You can see that the greatest disparity is with NTFS/windows while linux is pretty close in performance, but they don't bother to mention if they've got ubuntu formatted for ext4 or whatever. I can't really seem to find anything looking around, and this article is like 5 years old…

The first top-level comment from each of the four biggest threads, in HN’s own order. Excerpts are shortened; open a comment for full context.

Breakout years
5

100+ points or 50+ comments

Total points
1860

reference only — not used in Hall rules or ranking

Total comments
851

reference only — not used in Hall rules or ranking

Every submission

DateTitle as submittedByPointsComments
2017-06-14SQLite small blob storage: 35% Faster Than the FilesystemFirst breakout · Best threadi_feel_great612202
2019-08-1835% Faster Than The Filesystem (2017)Tomte267164
2021-05-1335% Faster Than the Filesystem (2017)cardamomo40
2021-07-20SQLite is 35% Faster Than The Filesystem (2017)emilengler226127
2023-01-15SQLite: 35% Faster Than the FilesystemHall inductionmadmax108216137
2024-07-27SQLite: 35% Faster Than the Filesystemyla92487193
2024-08-3035% Faster Than the Filesystemtosh21
2024-10-2635% Faster Than the Filesystem (2017)Latest 20+ point returnlopkeny12ko4627