List of command line tools for manipulating CSV, XML, HTML, JSON, INI, etc.

[lnav](https://www.lnav.org) is a terrific little tool, a "mini-ETL" of sorts with an embedded SQLite client and a clean, powerful interface. Its sweet spot is logfiles, but given regex-based custom formats, works great with any semi-structured input. Lnav easily handles a few million rows at a time. IME it pairs really really well with eg mitmproxy/mitmdump for client request logs, as well as webserver logs.

Also csvkit. in2csv data.xls > data.csv in2csv data.json > data.csv csvcut -c column_a,column_c data.csv > new.csv csvcut -c column_c,column_a data.csv > new.csv csvgrep -c phone_number -r 555-555-\d{4}" data.csv > matching.csv csvjson data.csv > data.json csvsql --query "select name from data where age > 30" data.csv > old_folks.csv csvsql --db postgresql:///database --insert data.csv sql2csv --db postgresql:///database --query "select * from data" > extract.csv https://github.com/wireservice/csvkit (Submitted a…