YAML
Generating SQL From YAML Templates Safely With Bound Values
See an f-string builder turn a YAML job file into a dropped table, then fix it with bound values, quoted identifiers and an allow-list of tables.
6 min read
Library
Everything you need to level up your coding skills.
YAML
Generating Table Schemas From YAML Definitions Safely
Generate CREATE TABLE statements from a YAML definition, quote identifiers so order and group work, and run the same DDL on PostgreSQL, SQLite and DuckDB.
6 min read
YAML
Defining Data Contracts in YAML That Fail the Build
Write a data contract as a YAML file, check a table against it with DuckDB, and fail the job on nulls, duplicates, bad values and drift, with tested output.
7 min read
YAMLGuide
YAML in Data Engineering Workflows and Where It Fits
Where YAML belongs in a data platform: tool config, contracts, schemas, pipelines, tests and docs, with a tested end to end example and the limits of each.
17 min read
YAML
Finding Duplicate Keys Across a Config Repository Reliably
Find YAML keys repeated inside a file and keys that differ across environment files, with ruamel.yaml, yamllint and a flatten pass over a repository.
6 min read
CSV
Converting CSV to YAML for Config Seeds Without Surprises
Hand-written YAML turned NO into false, 02134 into 1116 and 12:30 into 750; yaml.safe_dump quotes them. Dumping 193,708 records took 53 s, 15 s with libyaml.
9 min read
YAML
Summarizing dbt Project Metadata From YAML in One Report
Read the dbt manifest built from your properties YAML and report documentation coverage, untested models, owners, tags and source freshness in one script.
7 min read
CSVGuide
Converting CSV to JSON XML YAML and Excel in Practice
Convert one awkward CSV to JSON, JSON Lines, XML, YAML, Excel, Parquet, Markdown and SQL, read each back and see the cost on 193,708 rows.
22 min read
YAML
Auditing Kubernetes Manifests With SQL and a Findings Score
Flatten Kubernetes Deployments into one row per container and audit limits, probes, latest tags and privileged mode with SQL, then rank workloads by findings.
7 min read
YAML
Finding Inconsistent Versions Across YAML Configs in a Repo
Find image versions that disagree across Compose, CI, Helm and Kubernetes files in one pass: postgres in five tags, redis in three and latest in three files.
6 min read
YAML
Counting Services Across Many Compose Files With DuckDB
Turn 24 Compose files into a table of services with Python and DuckDB and answer which images, versions and missing healthchecks they share, in a few queries.
6 min read
YAMLGuide
Analyzing Configuration and Metadata Held in YAML With SQL
Turn a repository of YAML into tables and ask SQL: Compose fleets, version drift, Kubernetes audits, dbt coverage and duplicate keys, with tested results.
17 min read
Get new articles by email
We send one email when a new article is published. No spam.