JSONGuide
Handling JSON Files Too Large to Parse With Ordinary Tools
A tested guide to JSON files too big to load: memory and string limits, array to JSON Lines, DuckDB, streaming, splitting, compression and databases.
18 min read
Library
Everything you need to level up your coding skills.
YAML
Converting YAML to JSON With yq and Back Again Cleanly
yq converts YAML to JSON and back in one command. The same file gave different JSON in yq and PyYAML, and a big integer made yq fail. Flags and traps.
6 min read
JSONGuide
Moving Between JSON and MongoDB Documents Without Loss
A working guide to moving data between JSON and MongoDB: types, import flags, Extended JSON exports, round trips, flattening, nested queries, validation.
17 min read
JSONGuide
Pulling JSON From APIs Into a Database Reliably in Python
A working guide to loading JSON APIs into a database: raw pages, pagination, rate limits, upserts, cursors, shape checks and retries, with a tested loader.
17 min read
YAML
YAML Versus JSON for Configuration Files That Last
Comments, types, size, parse speed and safety compared with measured numbers, plus why JSON is nearly valid YAML. One format costs 55 times more to parse.
6 min read
JSON
Converting JSON to CSV With Python and pandas Safely
Convert JSON to CSV with pandas and the csv module, and avoid the traps: Python repr in cells, True and False, ragged keys, Excel encoding and formula cells.
8 min read
JSONGuide
Converting JSON to CSV XML YAML and Excel Without Surprises
A working guide to converting JSON to CSV, XML, YAML, Excel, SQL and Markdown and back: what each format cannot hold, a 23 field round trip test, and checks.
18 min read
JSON
Normalizing a JSON Export Into Relational Tables Safely
Turn a blog export with authors, tags and comments into five PostgreSQL tables, with a tag junction table, merged author copies and checks against the source.
8 min read
JSON
Turning a Deeply Nested API Response Into Three Tables
Split a nested order response into customers, orders and order_items in PostgreSQL with keys and constraints, and see what the nested address belongs to.
7 min read
XML
Keeping Both XML and JSON Output From One Source Model
Build one internal model and two small renderers, negotiate the format with the Accept header, and test that both carry the same data on awkward cases.
6 min read
JSON
Flattening JSON in SQL With Lateral Joins in PostgreSQL
Flatten JSON arrays into rows in PostgreSQL with CROSS JOIN LATERAL, jsonb_to_recordset and WITH ORDINALITY, keep empty arrays, and compare MySQL and SQLite.
8 min read
XML
Migrating a Legacy XML Interface to JSON in Safe Steps
A step-by-step plan for moving an XML service to JSON without breaking consumers: freeze, map, run both, measure, announce a date and retire.
6 min read
Get new articles by email
We send one email when a new article is published. No spam.