HN Hall of Fame Weekly email

Hacker's Guide to Neural Networks

karpathy.github.io Books & learning Tutorials & guides AI & data Class of 2017-07 Hall of Fame
Screenshot of karpathy.github.io captured 2026-07-20
Page preview · captured 2026-07-20

Resurfaced independently across 7 calendar years, with breakout response in 4 of them.

submissions
8
submitters
8
observed span
2014–2024
peak thread · 61 comments
450 pts
latest 20+ return · 2019-01-06
383 pts

Submission timeline

2007–2026

One slot for every year since HN launched. Height is that year's peak points; orange marks a 100+ point or 50+ comment breakout. Select a bar to open its strongest thread.

First comments on top threads

HN comment order

Thanks for the upvotes! I'm a little conflicted about this being linked around too much because it is still very much work in progress. I work on this guide on a side because I think there's a lot of interest in these models out there, and not enough explanations. On a related note, some of you might also be interested in a Stanford CS class I'll be co-teaching with my adviser next quarter. It will be focused primarily on Convolutional…

I've read so many of these, none of them include the information I need. If someone wrote a "Hackers guide to Tuning Hyperparameters" or "Hackers guide to building models for production" I would ready/share the shit out of those.

Since we're on the topic of tutorials to understand neural nets and modern deep learning, I will throw in Michael Nielsen's excellently written free online "book" on neural nets. It's really a set of 6 long posts that gets you from 0 to understanding all of the fundamentals with almost no prerequisite math needed. Using clear and easy to understand language, Michael explains neural nets, the backprop algorithm, challenges in training these models, some commonly used modern building blocks and…

Some more good posts when it was submitted last year: https://news.ycombinator.com/item?id=8553307

The first top-level comment from each of the four biggest threads, in HN’s own order. Excerpts are shortened; open a comment for full context.

Breakout years
4

100+ points or 50+ comments

Total points
1503

reference only — not used in Hall rules or ranking

Total comments
159

reference only — not used in Hall rules or ranking

Every submission

DateTitle as submittedByPointsComments
2014-08-05Understanding Neural Networks from a Programmer's Perspectivealbertzeyer40
2014-11-03Hacker's Guide to Neural NetworksFirst breakout · Best threadbernatfp45034
2015-03-23Hacker's guide to Neural Networkseaxitect23661
2016-07-14Hacker's guide to Neural Networkspvsukale130
2017-07-14Hacker's guide to Neural Networks (2012)Hall inductioncatherinezng42439
2019-01-06Hacker's guide to Neural Networks (2012)Latest 20+ point returnheadalgorithm38324
2020-04-17Hacker's Guide to Neural Networksgullyfur21
2024-03-08Hacker's Guide to Neural Networkstosh10