Results of 1 - 10 of about 370 for hive (0.011 sec.)
- Hive Partitioning – DuckDB 18916
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...rage Versions and Format Execution Format Pivot Sitemap Live Demo Documentation / Data Import / Partitioning Copy Markdown Hive Partitioning Examples Read data from a Hive partitioned data set: SELECT * FROM read_parquet ( 'orders/*/*/*.parquet' , hi...ve_partitioning = true ); Write a table to a Hive partitioned data set: COPY orders TO 'orders' ( FORMAT parquet , PARTITION_BY ( year , month )); Note that the PARTITION_B... - https://man.mtool.work/duckdb/1.3/data/partitioning/hive_partitioning.html
- Partitioned Writes – DuckDB 10132
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...Sitemap Live Demo Documentation / Data Import / Partitioning Copy Markdown Partitioned Writes Examples Write a table to a Hive partitioned data set of Parquet files: COPY orders TO 'orders' ( FORMAT parquet , PARTITION_BY ( year , month )); Write a...table to a Hive partitioned data set of CSV files, allowing overwrites: COPY orders TO 'orders' ( FORMAT csv , PARTITION_BY ( year , month... - https://man.mtool.work/duckdb/1.3/data/partitioning/partitioned_writes.html
- Relational API – DuckDB 8845
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...Optional[bool] Allow quoted NULL values. filename : Optional[bool], Optional[str] Add filename column or specify filename. hive_partitioning : Optional[bool] Enable Hive-style partitioning. union_by_name : Optional[bool] Union files by column name in...stead of position. hive_types : Optional[Dict[str, str]] Hive types for columns. hive_types_autocast : Optional[bool] Automatically cast Hive type... - https://man.mtool.work/duckdb/1.3/clients/python/relational_api.html
- Python Client API – DuckDB 6916
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...DBPyConnection, file_glob: str, binary_as_string: bool = False, * , file_row_number: bool = False, filename: bool = False, hive_partitioning: bool = False, union_by_name: bool = False, compression: object = None) -> duckdb.duckdb.DuckDBPyRelation Cre...nection, file_globs: list[str], binary_as_string: bool = False, * , file_row_number: bool = False, filename: bool = False, hive_partitioning: bool = False, union_by_name: bool = False, compression: object = None) -> duckdb.duckdb.DuckDBPyRelation Cre... - https://man.mtool.work/duckdb/1.3/clients/python/reference/
- Loading JSON – DuckDB 5955
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...r compatibility reasons. BOOL false format Can be one of auto , unstructured , newline_delimited and array . VARCHAR array hive_partitioning Whether or not to interpret the path as a Hive partitioned path . BOOL (auto-detected) ignore_errors Whether...ould be included in the result. BOOL false format Can be one of auto, unstructured, newline_delimited, array VARCHAR array hive_partitioning Whether or not to interpret the path as a Hive partitioned path . BOOL false ignore_errors Whether to ignore... - https://man.mtool.work/duckdb/1.3/data/json/loading_json.html
- File Formats – DuckDB 5955
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...f individual Parquet files moderate. Bestpractice The ideal range is between 100 MB and 10 GB per individual Parquet file. Hive Partitioning for Filter Pushdown When querying many files with filter conditions, performance can be improved by using a H...files, see the Parquet Tips page . Loading CSV Files CSV files are often distributed in compressed format such as GZIP archives ( .csv.gz ). DuckDB can decompress these files on the fly. In fact, this is typically faster than decompressing the files... - https://man.mtool.work/duckdb/1.3/guides/performance/file_formats.html
- S3 API Support – DuckDB 5629
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...: column_a column_b filename 1 examplevalue1 s3://bucket-name/file1.parquet 2 examplevalue1 s3://bucket-name/file2.parquet Hive Partitioning DuckDB also offers support for the Hive partitioning scheme , which is available when using HTTP(S) and S3 en...er Overview of S3 Secret Parameters Platform-Specific Secret Types Reading Partial Reading Reading Multiple Files Globbing Hive Partitioning Writing Configuration... - https://man.mtool.work/duckdb/1.3/core_extensions/httpfs/s3api.html
- CSV Import – DuckDB 5092
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...s zero-length strings instead of NULL s. VARCHAR[] [] header First line of each file contains the column names. BOOL false hive_partitioning Interpret the path as a Hive partitioned path . BOOL (auto-detected) ignore_errors Ignore any parsing errors... - https://man.mtool.work/duckdb/1.3/data/csv/overview.html
- Reading and Writing Parquet Files – DuckDB 5092
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer...ept for compatibility reasons. BOOL false file_row_number Whether or not to include the file_row_number column. BOOL false hive_partitioning Whether or not to interpret the path as a Hive partitioned path . BOOL (auto-detected) union_by_name Whether... - https://man.mtool.work/duckdb/1.3/data/parquet/overview.html
- Parquet Tips – DuckDB 4986
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../ from JSON Caveats Multiple Files Overview Combining Schemas Parquet Files Overview Metadata Encryption Tips Partitioning Hive Partitioning Partitioned Writes Appender INSERT Statements Client APIs Overview ADBC C Overview Startup Configuration Quer..._parquet ( 'flights*.parquet' , union_by_name = true ); Tips for Writing Parquet Files Using a glob pattern upon read or a Hive partitioning structure are good ways to transparently handle multiple files. Enabling PER_THREAD_OUTPUT If the final numbe... - https://man.mtool.work/duckdb/1.3/data/parquet/tips.html
DuckDB 1.3 Documentation / man.mtool.work