HN Hall of Fame Weekly email

What Is ChatGPT Doing and Why Does It Work?

writings.stephenwolfram.com Essays & writing Essays & articles AI & data Candidate
Screenshot of writings.stephenwolfram.com captured 2026-07-20
Page preview · captured 2026-07-20

Resurfaced independently across 3 calendar years, with breakout response in 2 of them.

submissions
4
submitters
4
observed span
2023–2025
peak thread · 496 comments
1090 pts
latest 20+ return · 2024-06-18
149 pts

Submission timeline

2007–2026

One slot for every year since HN launched. Height is that year's peak points; orange marks a 100+ point or 50+ comment breakout. Select a bar to open its strongest thread.

First comments on top threads

HN comment order

The answer to this is: "we don't really know as its a very complex function automatically discovered by means of slow gradient descent, and we're still finding out" Here are some of the fun things we've found out so far: - GPT style language models try to build a model of the world: https://arxiv.org/abs/2210.13382 - GPT style language models end up internally implementing a mini "neural network training algorithm" (gradient descent fine-tuning for given examples): https://arxiv.org/abs/2212.10559

spion·1090-point thread·

The better the models get, the harder it is for me to form a mental model of what goes on inside of them. An example of a prompt for which I don't have a good mental model why it works: What do you think about the following text? Joe drove Sue to university. Afterwards he drove home again and drank a tea with her in the kitchen. Older models behaved similar to Markov chains and completely missed that something is…

mg·149-point thread·

The first top-level comment from each of the four biggest threads, in HN’s own order. Excerpts are shortened; open a comment for full context.

Breakout years
2

100+ points or 50+ comments

Total points
1245

reference only — not used in Hall rules or ranking

Total comments
581

reference only — not used in Hall rules or ranking

Every submission

DateTitle as submittedByPointsComments
2023-02-14What Is ChatGPT Doing and Why Does It Work?First breakout · Best threadwashedup1090496
2023-02-14What Is ChatGPT Doing and Why Does It Work?dude0130
2024-06-18What Is ChatGPT Doing and Why Does It Work? (2023)Latest 20+ point returntaubek14985
2025-12-16What Is ChatGPT Doing and Why Does It Work? (2023)pella30