CSV
Converting CSV to JSON in Node With a Few Lines of Code
Convert a CSV to JSON or NDJSON in Node with csv-parse, keep ZIP codes as text, and stream 2,000,000 rows at 120 MB instead of 1.6 GB.
8 min read
Tag
how-to
590 posts
XML
Flattening Hierarchical XML for Excel Users With Python
Turn orders with repeating items into a workbook a spreadsheet user can filter: one sheet per level linked by order id, or one wide sheet, plus the checks.
6 min read
YAML
Flattening Nested YAML Into Rows of Path and Value
Turn a nested YAML document into path, type and value rows with a short recursive generator, then load the rows into SQL to search and compare configs.
6 min read
Excel
Finding Duplicates and Gaps in an Excel Sheet With SQL
Use SQL on an Excel sheet to find repeated keys, missing numbers in a sequence and missing dates with GROUP BY, window functions and gaps and islands.
7 min read
XML
Opening XML Files in Excel Without Mangled Data or Loss
What happens when you open an XML file in Excel, the choices it offers, why leading zeros and long numbers change, and a safer route that keeps text as text.
5 min read
CSV
Generating a CSV Download From JavaScript in the Browser
Build a CSV string, wrap it in a Blob and trigger a download with an object URL. Covers escaping, the Excel BOM, formula guards and how 1,000,000 rows behave.
9 min read
CSV
Parsing CSV in the Browser With Papa Parse Without Blocking
Parse an uploaded CSV in the browser with Papa Parse: typing traps, error objects, encodings, and chunks and workers measured on 500,000 rows.
11 min read
YAML
Reading YAML Into SQLite for Quick Queries With json_extract
Load a YAML list into an in-memory SQLite table as JSON text and query it with json_extract and json_each, with a json_valid check that rejects bad rows.
6 min read
JSON
Validating Text as JSON With json_valid in SQLite Tables
What json_valid accepts in SQLite with each flag, why a CHECK can pass a NULL, how to find bad rows, add a check to an existing table and check JSONB blobs.
7 min read
Excel
Summarizing a Sales Workbook With GROUP BY in SQL Queries
Summarize a sales workbook with GROUP BY: totals by region and month, averages, rollups and ranking, with checks that make the numbers trustworthy.
7 min read
XML
Exporting Excel Data as XML With a Schema and What Blocks It
Excel exports XML only through an XML map built from a schema. The 65,536 row cap, the constructs that block export, and a script that does the same job.
6 min read
CSV
Using csv parse in Node for Large Files Without Surprises
The csv-parse options that matter on big files in Node: columns, cast, on_record, relax_quotes and max_record_size, timed on 2,000,000 rows.
8 min read