CSV
Fixing Expected Columns but Found Errors in SQLite Imports
SQLite prints expected N columns but found M and loads the row anyway, with exit status zero. See each import message and what it did to the data.
7 min read
Topic
Data Wrangling
Take messy CSV, JSON and spreadsheets and land them in tables without losing a row or a character on the way.
CSV
Exporting a SQLite Query Result to CSV From the Shell
Export a SQLite query to CSV with the shell, see exactly how 3.54 quotes values, writes NULL and ends lines, and learn which options change each.
8 min read
CSV
Querying a CSV File in SQLite Without Importing It
Compile SQLite's CSV virtual table, query a file in place, and compare the cost with importing it and with DuckDB, including the typed schema surprises.
6 min read
CSV
Importing a CSV Into an Existing SQLite Table Step by Step
Importing into a table that holds data goes wrong four ways: duplicate keys, missing columns, extra columns and a new order. See each and the staging fix.
7 min read
CSV
Setting Column Types When SQLite Imports a CSV File Safely
sqlite3 .import makes untyped columns. Create the table yourself, choose between INTEGER, TEXT and STRICT, and see what a ZIP code and a bad price do in each.
7 min read
CSV
Using the sqlite3 dot import Command With a CSV File
Every option of the sqlite3 .import command that matters for CSV, from --csv and --skip to --schema temp and piped input, with the output of each.
7 min read
Editor's pick
CSVGuide
Importing CSV Files Into SQLite From the Command Line
The sqlite3 .import command loads a CSV in seconds and reports problems as warnings with exit status zero. Import safely with types, checks and a swap.
20 min read
CSV
Fixing Data Truncated Warnings in a MySQL CSV Load
LOAD DATA LOCAL clips long strings and out of range numbers to the nearest value and only warns. See each warning, the checks that find them, and the fix.
9 min read
CSV
Importing a Large CSV Into MySQL Without Locking the Table
Measure what other sessions see while LOAD DATA runs on InnoDB, whether chunking helps, and how a build and swap with RENAME TABLE avoids any visible window.
8 min read
CSV
Loading a CSV Into MySQL Workbench Versus the Command Line
Use a GUI import wizard for small files and LOAD DATA for big ones. See the measured gap between row at a time and bulk loading, and what a GUI sends.
6 min read
CSV
Fixing Incorrect Date Value Errors in a MySQL CSV Import
MySQL rejects a US date with error 1292 on a server load and stores a zero date on a LOCAL load. See both, the STR_TO_DATE fix, and how to find zero dates.
9 min read
CSV
Mapping CSV Columns to Table Columns With LOAD DATA
Skip, reorder and compute columns in LOAD DATA with a column list, user variables and SET, plus the silent shift a short column list causes.
7 min read
Get new articles by email
We send one email when a new article is published. No spam.