CSV
Loading CSV Into BigQuery With bq load and Its Flags
Load a CSV from Cloud Storage into BigQuery with bq load: explicit schema, bad-record limits, quoted newlines, replace versus append and a job ID for reruns.
8 min read
Library
Everything you need to level up your coding skills.
CSVGuide
Loading CSV Into Cloud Warehouses Without Painful Reloads
How to load CSV into BigQuery, Snowflake and ClickHouse: stage the file, declare the schema, pick an error policy, load once and check the counts afterward.
17 min read
XML
Parsing XML in BigQuery With a JavaScript UDF or Upstream
BigQuery has no XML loader or functions. Two routes: a JavaScript UDF with fast-xml-parser, tested here in Node, or parsing before the load to Parquet.
6 min read
XMLGuide
Handling XML in Warehouses and Lakes the Practical Way
How to get XML into Snowflake, BigQuery, Spark, DuckDB and a lake: keep raw files, parse once with a typed schema, store Parquet and reconcile counts.
16 min read
JSON
Unnesting JSON Arrays in BigQuery With JSON_QUERY_ARRAY
Turn a JSON array into rows in BigQuery with UNNEST and JSON_QUERY_ARRAY or JSON_VALUE_ARRAY, with positions, empty arrays, nesting and filters.
7 min read
JSON
Extracting JSON Fields in BigQuery With JSON_VALUE
Read JSON in BigQuery with JSON_VALUE, JSON_QUERY, field access and typed converters such as INT64(), with the null rules, SAFE prefix and lax conversion.
7 min read
JSONGuide
JSON in SQL Server Oracle Snowflake and BigQuery Compared
How SQL Server, Oracle, Snowflake and BigQuery store, read, unpack, build and index JSON, side by side, with the null, type and size traps in each.
19 min read
Get new articles by email
We send one email when a new article is published. No spam.