HN Hall of Fame Weekly email

Differentiable programming from scratch

thenumb.at Books & learning Tutorials & guides AI & data Candidate
Screenshot of thenumb.at captured 2026-07-20
Page preview · captured 2026-07-20

Resurfaced independently across 2 calendar years, with breakout response in 2 of them.

submissions
3
submitters
3
observed span
2022–2025
peak thread · 107 comments
196 pts
latest 20+ return · 2025-04-17
108 pts

Submission timeline

2007–2026

One slot for every year since HN launched. Height is that year's peak points; orange marks a 100+ point or 50+ comment breakout. Select a bar to open its strongest thread.

First comments on top threads

HN comment order

One thing that I've thought about, when using calculus in programs, you're often dealing with a very small (but finite) Δx, rather than an infinitesimal 𝛿x. And I don't think that the common differential equation is the ideal form when dealing with that situation. (Take for example g(x) = -f(-x), the gradients at x and -x are not equivalent for Δx, but would be for 𝛿x.) Anyway, (limit(h -> 0)((f(x + h) - f(x))/h) Why do we even need h?…

yarg·196-point thread·

Historical fact: Differentiable programming was a little known secret back in the 90's, used mainly by engineers simulating numerically stiff systems like nukes and chemicals in FORTRAN 95. It then disappeared for nearly 30 yrs before rediscovery by the ML/AI researchers!

The first top-level comment from each of the four biggest threads, in HN’s own order. Excerpts are shortened; open a comment for full context.

Breakout years
2

100+ points or 50+ comments

Total points
309

reference only — not used in Hall rules or ranking

Total comments
127

reference only — not used in Hall rules or ranking

Every submission

DateTitle as submittedByPointsComments
2022-08-01Differentiable programming from scratchFirst breakout · Best threadTheNumbat196107
2025-01-13Differentiable Programming from ScratchChadNauseam50
2025-04-17Differentiable Programming from ScratchLatest 20+ point returnsksxihve10820