XMLGuide
Parsing Big XML Files Fast Without Running Out of Memory
A measured guide to large XML files: memory multipliers, streaming, library choice, COPY into PostgreSQL, parallel splits, compression and indexes.
17 min read
Tag
hub
102 posts
Editor's pick
CSVGuide
A Repeatable Way to Clean a Messy CSV File With Python
A cleaning pipeline that never edits the raw file, counts rows at every step and keeps rejects: 200,000 rows in 3.85 s, identical output twice.
25 min read
ExcelGuide
Excel Security Problems Developers Overlook in Pipelines
Excel risks a data pipeline inherits: formula injection, macros, zip bombs, XML entity attacks, hidden data and weak passwords, with the checks for each.
17 min read
XMLGuide
Designing XML Documents That Age Well From Day One
A practical guide to XML format design: names, attributes, lists, optional data, binary, namespaces and versions, with a tested worked example.
19 min read
ExcelGuide
Converting Excel to CSV JSON XML and YAML in Practice
Convert Excel workbooks to CSV, JSON, XML and YAML without losing data: choose a format, read types, dates and headers, then verify with counts and schemas.
17 min read
YAMLGuide
YAML Security Pitfalls and How to Test Your Own Code
Seven ways YAML hurts: object loading, alias bombs, size, type confusion, duplicate keys, leaked secrets and values used as code, tested in five languages.
17 min read
ExcelGuide
Reading and Writing Excel From JavaScript Java and C Sharp
Cross language reference for reading and writing xlsx in JavaScript, Java, C Sharp, PHP, R, Go, Ruby and Rust: libraries, types, dates, memory and security.
17 min read
XMLGuide
Comparing and Versioning XML Files in Git and in Pipelines
A tested guide to comparing XML, from canonical form and keyed record diffs to Git diffs, merges, feed shape checks and schema compatibility.
18 min read
Editor's pick
CSVGuide
Reading CSV Files in Go Java R Rust and C Sharp Compared
Ten languages read the same awkward CSV files: speed on 2,000,000 rows, BOM, bad quotes, ragged rows, leading zeros and defaults that bite, plus a test list.
18 min read
JSONGuide
JSON in SQL Server Oracle Snowflake and BigQuery Compared
How SQL Server, Oracle, Snowflake and BigQuery store, read, unpack, build and index JSON, side by side, with the null, type and size traps in each.
19 min read
Editor's pick
CSVGuide
Parsing CSV in JavaScript and Node Without Surprises
A tested guide to CSV in JavaScript: csv-parse, Papa Parse and a hand-written parser timed on 2,000,000 rows, plus streams, types, uploads and downloads.
20 min read
XMLGuide
Moving XML Into and Out of Spreadsheets Without Losing Data
How to get XML into a spreadsheet and back: XML maps, opening files, flattening, the 2003 format, scripts, types and the checks that catch silent loss.
17 min read