YAML
Summarizing dbt Project Metadata From YAML in One Report
Read the dbt manifest built from your properties YAML and report documentation coverage, untested models, owners, tags and source freshness in one script.
7 min read
Tag
analysis
92 posts
XML
Counting Records by Attribute in a Large XML Export
Count 400,000 orders by status in a 132 MB XML file with grep in 0.4 s, lxml iterparse in 2.0 s or xmlstarlet in 5.1 s, and know when each can be trusted.
6 min read
YAML
Auditing Kubernetes Manifests With SQL and a Findings Score
Flatten Kubernetes Deployments into one row per container and audit limits, probes, latest tags and privileged mode with SQL, then rank workloads by findings.
7 min read
XML
Summing Values Across Thousands of XML Invoices by Currency
Total 5,000 XML invoice files in under a second with Python, xmlstarlet or grep, group by currency, and catch malformed files and missing totals.
6 min read
XMLGuide
Answering Questions From XML Data With Counts and Joins
A method for turning an XML file into answers: inspect its shape, extract the fields once, check counts and totals, join carefully and record the result.
17 min read
YAML
Finding Inconsistent Versions Across YAML Configs in a Repo
Find image versions that disagree across Compose, CI, Helm and Kubernetes files in one pass: postgres in five tags, redis in three and latest in three files.
6 min read
YAML
Counting Services Across Many Compose Files With DuckDB
Turn 24 Compose files into a table of services with Python and DuckDB and answer which images, versions and missing healthchecks they share, in a few queries.
6 min read
Excel
Version Controlling the Query Behind an Excel Report
Keep the SQL behind an Excel report in Git: one file per query, parameters, reviewed changes, tests, and the commit hash written into the workbook.
7 min read
Excel
Putting a README Sheet Into Every Generated Workbook
Add a README sheet to every generated workbook with the period, source, definitions, checks and version, written by the same code that builds the report.
7 min read
YAMLGuide
Analyzing Configuration and Metadata Held in YAML With SQL
Turn a repository of YAML into tables and ask SQL: Compose fleets, version drift, Kubernetes audits, dbt coverage and duplicate keys, with tested results.
17 min read
Excel
Handling Currency and Locale in Generated Workbooks
Handle currency and locale in generated workbooks: store numbers, set format codes, name the currency and know what the reader's settings change.
7 min read
Excel
Rounding and Formatting Numbers for Finance Readers
Round and format numbers for finance readers: store exact values, round once on purpose, use number formats for display and make displayed totals add up.
7 min read