YAML
Summarizing dbt Project Metadata From YAML in One Report
Read the dbt manifest built from your properties YAML and report documentation coverage, untested models, owners, tags and source freshness in one script.
7 min read
Library
Everything you need to level up your coding skills.
ExcelGuide
Excel Formulas Data People Use Every Week Explained
The Excel formulas data people use every week: lookups, conditional sums, text and date cleanup, arrays, errors and LET, with their SQL equivalents.
19 min read
XML
Extracting Time Series From XML Sensor Files With Pandas
Turn XML sensor readings into a pandas time series, resample to hourly means, find a 50 minute gap and a silent switch from Celsius to Fahrenheit.
6 min read
CSV
Converting CSV to JSON With Python Without Losing Types
Convert CSV to JSON with the csv module, then decide on types: zip stays text, money stays exact. pandas gave 2134.0 for 02134; converters took 0.4 to 36 s.
9 min read
Excel
Differences Between Sheets and Excel Formulas to Know
How Google Sheets and Excel formulas differ: array handling, lookup and text functions, dates, locale, errors and what breaks when a file moves between them.
7 min read
JSONGuide
Validating JSON With JSON Schema in Real Team Projects
A working guide to JSON Schema: write a schema, run it in Python and Node, handle formats, refs and versions, and check JSON stored in a database.
19 min read
CSVGuide
Converting CSV to JSON XML YAML and Excel in Practice
Convert one awkward CSV to JSON, JSON Lines, XML, YAML, Excel, Parquet, Markdown and SQL, read each back and see the cost on 193,708 rows.
22 min read
XML
Counting Records by Attribute in a Large XML Export
Count 400,000 orders by status in a 132 MB XML file with grep in 0.4 s, lxml iterparse in 2.0 s or xmlstarlet in 5.1 s, and know when each can be trusted.
6 min read
Excel
Sheets IMPORTDATA and Its Limits for Live Data Feeds
What Sheets IMPORTDATA can and cannot do as a live feed from a CSV URL: format, refresh, auth, size, parsing quirks and a way to measure it for your data.
7 min read
CSV
Automating a Nightly CSV Export With cron and psql
A cron export that cannot publish a half-written file: lock, temporary name, row-count check, atomic rename. Real cron failed first, on the environment.
10 min read
YAML
Auditing Kubernetes Manifests With SQL and a Findings Score
Flatten Kubernetes Deployments into one row per container and audit limits, probes, latest tags and privileged mode with SQL, then rank workloads by findings.
7 min read
JSON
Reading JSON Lines With pandas Without the Usual Surprises
Read JSON Lines into a pandas DataFrame with read_json(lines=True): dtypes, chunking, nested fields, big integers, bad lines and the pyarrow engine.
6 min read
Get new articles by email
We send one email when a new article is published. No spam.