CSV
Loading CSV Into BigQuery With bq load and Its Flags
Load a CSV from Cloud Storage into BigQuery with bq load: explicit schema, bad-record limits, quoted newlines, replace versus append and a job ID for reruns.
8 min read
Library
Everything you need to level up your coding skills.
CSVGuide
Loading CSV Into Cloud Warehouses Without Painful Reloads
How to load CSV into BigQuery, Snowflake and ClickHouse: stage the file, declare the schema, pick an error policy, load once and check the counts afterward.
17 min read
CSV
Choosing Between csvkit and Miller for Everyday CSV Work
csvkit and Miller timed on the same 200,000-row file. Type inference makes csvkit's sort, stat and JSON commands 100 times slower and can rewrite your dates.
6 min read
CSV
Datasette for Publishing CSV as a Searchable Site in Minutes
Turn a CSV into a browsable, searchable, filterable website with sqlite-utils and Datasette, with a JSON and CSV API, facets and full-text search built in.
7 min read
CSV
Polars for Large CSV Processing Beyond Memory Limits
Use Polars lazy scanning to filter and group a large CSV without loading it whole, set column types so zip codes stay text, and write Parquet as you go.
6 min read
PostgreSQL
Exporting JSON Lines From a Query in PostgreSQL Safely
Export JSON Lines from a PostgreSQL query with row_to_json or to_jsonb and COPY TO STDOUT, handle quoting, types, nulls, large results and compression.
6 min read
ExcelGuide
A Practical Guide to Connecting Excel Directly to a Database
Connect Excel to PostgreSQL, MySQL and SQL Server with connectors and ODBC, using read only accounts, parameters, safe credentials, refresh and speed checks.
16 min read
Excel
Access Versus SQLite Versus PostgreSQL for a Small App
Compare Microsoft Access, SQLite and PostgreSQL for a small team replacing a spreadsheet, by users, platform, interface, limits, safety and upgrade path.
7 min read
Excel
Audit Trails and History That Excel Cannot Give You
Excel cannot say who changed a cell and why. See what version history does, and build an audit trail in PostgreSQL with triggers or temporal tables.
8 min read
Excel
Shared Excel Files and the Lost Update Problem Explained
How two people editing the same Excel file lose each other's changes, what co-authoring and locks do about it, and how a database prevents lost updates.
7 min read
Excel
Keeping Excel as the Front End to a Database Safely
Keep Excel for reading and analysing database data through queries and refresh, and decide how writes should reach the database without losing rules.
7 min read
Excel
Turning Repeating Columns Into a Proper Child Table
Replace columns like Phone 1, Phone 2, Phone 3 from an Excel sheet with a child table: unpivot in SQL or pandas, drop blanks, add keys and check the counts.
7 min read
Get new articles by email
We send one email when a new article is published. No spam.