Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
Report a link problem
Submission timeline
2007–2026One slot for every year since HN launched. Height is that year's peak points; orange marks a 100+ point or 50+ comment breakout. Select a bar to open its strongest thread.
First comments on top threads
HN comment orderI recommend using clickhouse-local[1] for these tasks. It does SQL; it supports all imaginable data formats, streaming processing, and connecting to external data sources. It also outperforms every other tool[2]. [1] https://clickhouse.com/blog/extracting-converting-querying-l... [2] https://colab.research.google.com/github/dcmoura/spyql/blob/...
I always use sqlite3 for working with large CSV files: $ sqlite3 $ .mode csv $ .import my.csv foo $ SELECT * FROM foo WHERE name = 'bar'; It reads the header in automatically for the field names and then stores all the values as strings.
Previous discussion: https://news.ycombinator.com/item?id=10066742 (209 points, 1 day ago, 68 comments)
I need to remember to try it out next time my user name needs some whipping.
The first top-level comment from each of the four biggest threads, in HN’s own order. Excerpts are shortened; open a comment for full context.
- Breakout years
- 2
- Total points
- 606
- Total comments
- 173
100+ points or 50+ comments
reference only — not used in Hall rules or ranking
reference only — not used in Hall rules or ranking
Every submission
| Date | Title as submitted | By | Points | Comments |
|---|---|---|---|---|
| 2015-08-17 | Miller is like sed, awk, cut, join, and sort for name-indexed data such as CSV | roye | 10 | 2 |
| 2016-05-11 | Miller = sed, awk, cut, join, sort for CSV and tabular JSON | yarapavan | 2 | 1 |
| 2018-09-13 | Show HN: Miller is like awk,sed,cut,join,sort for CSV,TSV,JSON (repost) | mfrw | 3 | 0 |
| 2021-08-25 | Miller CLI – Like Awk, sed, cut, join, and sort for CSV, TSV and JSONFirst breakout | jabo | 273 | 66 |
| 2023-03-16 | Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSONBest thread · Latest 20+ point return | ingve | 318 | 104 |