Results of 1 - 4 of about 4 for folders (0.001 sec.)
- Hive Partitioning 11668
- Examples Read data from a Hive partitioned dataset: SELECT * FROM read_parquet('orders/*/*/*.parquet', hive_partitioning = true); Write a table to a Hive partitioned dataset: COPY orders TO 'orders' (FORMAT parquet, PARTITION_BY (year, mont
...itioning strategy that is used to split a table into multiple files based on partition keys . The files are organized into folders. Within each folder, the partition key has a value that is determined by the name of the folder. Below is an example of a...ierarchy. And if so, the hive_partitioning flag is enabled automatically. The auto-detection will look at the names of the folders and search for a 'key' = 'value' pattern. This behavior can be overridden by using the hive_partitioning option of the rea... - https://man.mtool.work/duckdb/2.0/data/partitioning/hive_partitioning.html
- Reading Multiple Files 10374
- DuckDB can read multiple files of different types (CSV, Parquet, JSON files) at the same time using either the glob syntax, or by providing a list of files to read. See the combining schemas page for tips on reading files with different sch
...SELECT * FROM read_parquet(['file1.parquet', 'file2.parquet', 'file3.parquet']); Read all Parquet files from two specific folders: SELECT * FROM read_parquet(['folder1/*.parquet', 'folder2/*.parquet']); Read all Parquet files that match the glob patter...t input parameter can be combined to scan files that meet one of multiple patterns. Read all Parquet files from 2 specific folders. SELECT * FROM read_parquet(['folder1/*.parquet', 'folder2/*.parquet']); DuckDB can read multiple CSV files at the same ti... - https://man.mtool.work/duckdb/2.0/data/multiple_files/overview.html
- File Formats 7785
- Handling Parquet Files DuckDB has advanced support for Parquet files, which includes directly querying Parquet files . When deciding on whether to query these files directly or to first load them to the database, you need to consider severa
...ng for Filter Pushdown When querying many files with filter conditions, performance can be improved by using a Hive-format folder structure to partition the data along the columns used in the filter condition. DuckDB will only need to read the folders a... - https://man.mtool.work/duckdb/2.0/guides/performance/file_formats.html
- Reading and Writing Parquet Files 7138
- Examples Read a single Parquet file: SELECT * FROM 'test.parquet'; Figure out which columns/types are in a Parquet file: DESCRIBE SELECT * FROM 'test.parquet'; Create a table from a Parquet file: CREATE TABLE test AS SELECT * FROM 'test.par
...): SELECT *, filename FROM read_parquet('test/*.parquet'); Use a list of globs to read all Parquet files from two specific folders: SELECT * FROM read_parquet(['folder1/*.parquet', 'folder2/*.parquet']); Read over HTTPS: SELECT * FROM read_parquet('http... - https://man.mtool.work/duckdb/2.0/data/parquet/overview.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work