Categories
Ubuntu

Fix DuckDB out of memory error Export Database Parquet

I’m using the latest DuckDB 0.10.0 and receive memory error when exporting database with Parquet Format. I did with CSV and its work fine.

Memory configuration also set like :

SET memory_limit = '50GB';
SET max_memory = '50GB';
PRAGMA memory_limit=50GB;

This still trigger OOM. The only solution that works is

SET preserve_insertion_order = false;

Hope this help you in solving memory error using DuckDB.

Leave a Reply

Your email address will not be published. Required fields are marked *