Results of 1 - 10 of about 15 for (⟨ (0.002 sec.)
- Writing to Iceberg 14263
- The DuckDB iceberg extension supports writing to Iceberg tables when an Iceberg catalog is attached. Writing to a table read directly from storage with iceberg_scan is not supported: the catalog is required to commit the new table metadata.
...ng the Iceberg partition transforms : Transform Description ⟨column⟩ Identity: partition by the column value directly. year(⟨column⟩) , month(⟨column⟩) , day(⟨column⟩) , hour(⟨column⟩) Partition by a date or timestamp component. bucket(⟨n⟩, ⟨column...⟩) Hash the column's value into n buckets. This is useful for stable partitioning on a high-cardinality column. truncate(⟨w⟩, ⟨column⟩) Group rows by the first w characters (or by the column's value rounded down to a multiple of w for numeric co... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/writing_to_iceberg.htm...
- WITH Clause 11285
- The WITH clause allows you to specify common table expressions (CTEs). Regular (non-recursive) common-table-expressions are essentially views that are limited in scope to a particular query. CTEs can reference each other and can be nested.
...function, it cannot be inlined. Take the following query for example, which invokes the same CTE three times: WITH t(x) AS (⟨complex_query⟩) SELECT * FROM t AS t1, t AS t2, t AS t3; Inlining duplicates the definition of t for each reference which r...esults in the following query: SELECT * FROM (⟨complex_query⟩) AS t1(x), (⟨complex_query⟩) AS t2(x), (⟨complex_query⟩) AS t3(x); If complex_query is expensive, materializ...ATERIALIZED keyword can improve performance. In this case, complex_query is evaluated only once. WITH t(x) AS MATERIALIZED (⟨complex_query⟩) SELECT * FROM t AS t1, t AS t2, t AS t3; If one wants to disable materialization, use NOT MATERIALIZED : WI... - https://man.mtool.work/duckdb/2.0/sql/query_syntax/with.html
- S3 API Support 8708
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...ension⟩'; Partitioned copy to S3 also works: COPY table TO 's3://⟨your-bucket⟩/partitioned' ( FORMAT parquet, PARTITION_BY (⟨part_col_a⟩, ⟨part_col_b⟩) ); An automatic check is performed for existing files/directories, which is currently quite cons...iting, an OVERWRITE_OR_IGNORE flag is added: COPY table TO 's3://⟨your-bucket⟩/partitioned' ( FORMAT parquet, PARTITION_BY (⟨part_col_a⟩, ⟨part_col_b⟩), OVERWRITE_OR_IGNORE true ); The naming scheme of the written files looks like this: s3://⟨your-... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- TPC-DS Extension 8708
- New In DuckDB 2.0, the dsdgen data generator was updated to match the TPC-DS version 4 tools. As a result, the generated data differs slightly from the data generated by DuckDB v1.x. See the related PR for more details. The tpcds extension
...S v4. tpcds-sf10.db (2.9 GB) tpcds-sf30.db (7.7 GB) tpcds-sf100.db (26.6 GB) tpcds-sf300.db (79.3 GB) Limitations The tpcds(⟨query_id⟩) function runs a fixed TPC-DS query with pre-defined bind parameters (a.k.a. substitution parameters). It is not... - https://man.mtool.work/duckdb/2.0/core_extensions/tpcds.html
- PIVOT Statement 8708
- The PIVOT statement allows distinct values within a column to be separated into their own columns. The values within those new columns are calculated using an aggregate function on the subset of rows that match each distinct value. DuckDB i
...ax The full syntax diagram is below, but the SQL Standard PIVOT syntax can be summarized as: SELECT * FROM ⟨dataset⟩ PIVOT ( ⟨values⟩ FOR ⟨column_1⟩ IN (⟨in_list⟩) ⟨column_2⟩ IN (⟨in_list⟩) ... GROUP BY ⟨rows⟩ ); Unlike the simplified syntax, the I... - https://man.mtool.work/duckdb/2.0/sql/statements/pivot.html
- TPC-H Extension 8499
- The tpch extension implements the data generator and queries for the TPC-H benchmark . Installing and Loading The tpch extension is shipped by default in some DuckDB builds, otherwise it will be transparently autoloaded on first use. If you
...the official TPC-H specification. To obtain fully TPC-compliant datasets, use the tpchgen-cli project . Limitation The tpch(⟨query_id⟩) function runs a fixed TPC-H query with pre-defined bind parameters (a.k.a. substitution parameters). It is not p... - https://man.mtool.work/duckdb/2.0/core_extensions/tpch.html
- Delta Extension 8307
- The delta extension adds support for the Delta Lake open-source storage format . It is built using the Delta Kernel . The extension reads Delta tables, local and remote, and writes them: it can create tables and append to them. For implemen
...uses Delta's per-application transaction versions. Within a transaction, tag the append with delta_set_transaction_version(⟨table⟩, ⟨app_id⟩, ⟨new_version⟩, ⟨expected_previous_version⟩) : ATTACH '⟨path⟩' AS my_table (TYPE delta); BEGIN TRANSACTION...fails. A rolled-back transaction leaves the version unchanged. Read the current version with delta_get_transaction_version(⟨table⟩, ⟨app_id⟩) , which returns NULL if no version has been recorded yet. Attach Options When attaching a Delta table you... - https://man.mtool.work/duckdb/2.0/core_extensions/delta.html
- CLI Charting with YouPlot 8307
- DuckDB can be used with CLI graphing tools to quickly pipe input to stdout to graph your data in one line. YouPlot is a Ruby-based CLI tool for drawing visually pleasing plots on the terminal. It can accept input from other programs by pipi
...wrap the SELECT in the COPY ... TO function with an output location of /dev/stdout . The syntax looks like this: sql COPY (⟨query⟩) TO '/dev/stdout' WITH (FORMAT csv, HEADER); The full DuckDB command below outputs the query in CSV format with a he... - https://man.mtool.work/duckdb/2.0/guides/data_viewers/youplot.html
- Enum Data Type 7906
- Name Description ENUM Dictionary representing all possible string values of a column The enum type represents a dictionary data structure with all possible unique values of a column. For example, a column storing the days of the week can be
...CHAR = name` -- No rows returned When comparing against a constant string, DuckDB will perform an optimization and try_cast(⟨constant string⟩, enum_type) so that physically we are doing an integer comparison instead of a string comparison (but logi... - https://man.mtool.work/duckdb/2.0/sql/data_types/enum.html
- R-Tree Indexes 7697
- The spatial extension provides support for spatial indexing through the R-tree extension index type. Why Should I Use an R-Tree Index? When working with geospatial datasets, it is very common that you want to filter rows based on their spat
...be passed to the WITH clause when creating an R-tree index: (e.g., CREATE INDEX my_idx ON my_table USING RTREE (geom) WITH (⟨option⟩ = ⟨value⟩); ) Option Description Default max_node_capacity The maximum number of entries per node in the R-tree 128... - https://man.mtool.work/duckdb/2.0/core_extensions/spatial/r-tree_indexes.html
DuckDB 2.0 Documentation / man.mtool.work