Results of 1 - 10 of about 13 for ⟩) (0.002 sec.)
- Writing to Iceberg 14023
- The DuckDB iceberg extension supports writing to Iceberg tables when an Iceberg catalog is attached. Writing to a table read directly from storage with iceberg_scan is not supported: the catalog is required to commit the new table metadata.
...ceberg partition transforms : Transform Description ⟨column⟩ Identity: partition by the column value directly. year(⟨column⟩) , month(⟨column⟩) , day(⟨column⟩) , hour(⟨column⟩) Partition by a date or timestamp component. bucket(⟨n⟩, ⟨column⟩) Hash...e column's value into n buckets. This is useful for stable partitioning on a high-cardinality column. truncate(⟨w⟩, ⟨column⟩) Group rows by the first w characters (or by the column's value rounded down to a multiple of w for numeric columns). This... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/writing_to_iceberg.htm...
- WITH Clause 11155
- The WITH clause allows you to specify common table expressions (CTEs). Regular (non-recursive) common-table-expressions are essentially views that are limited in scope to a particular query. CTEs can reference each other and can be nested.
...nnot be inlined. Take the following query for example, which invokes the same CTE three times: WITH t(x) AS (⟨complex_query⟩) SELECT * FROM t AS t1, t AS t2, t AS t3; Inlining duplicates the definition of t for each reference which results in the f...ollowing query: SELECT * FROM (⟨complex_query⟩) AS t1(x), (⟨complex_query⟩) AS t2(x), (⟨complex_query⟩) AS t3(x); If complex_query is expensive, materializing it with the...word can improve performance. In this case, complex_query is evaluated only once. WITH t(x) AS MATERIALIZED (⟨complex_query⟩) SELECT * FROM t AS t1, t AS t2, t AS t3; If one wants to disable materialization, use NOT MATERIALIZED : WITH t(x) AS NOT... - https://man.mtool.work/duckdb/2.0/sql/query_syntax/with.html
- TPC-DS Extension 8692
- New In DuckDB 2.0, the dsdgen data generator was updated to match the TPC-DS version 4 tools. As a result, the generated data differs slightly from the data generated by DuckDB v1.x. See the related PR for more details. The tpcds extension
...s-sf10.db (2.9 GB) tpcds-sf30.db (7.7 GB) tpcds-sf100.db (26.6 GB) tpcds-sf300.db (79.3 GB) Limitations The tpcds(⟨query_id⟩) function runs a fixed TPC-DS query with pre-defined bind parameters (a.k.a. substitution parameters). It is not possible t... - https://man.mtool.work/duckdb/2.0/core_extensions/tpcds.html
- PIVOT Statement 8692
- The PIVOT statement allows distinct values within a column to be separated into their own columns. The values within those new columns are calculated using an aggregate function on the subset of rows that match each distinct value. DuckDB i
...ut the SQL Standard PIVOT syntax can be summarized as: SELECT * FROM ⟨dataset⟩ PIVOT ( ⟨values⟩ FOR ⟨column_1⟩ IN (⟨in_list⟩) ⟨column_2⟩ IN (⟨in_list⟩) ... GROUP BY ⟨rows⟩ ); Unlike the simplified syntax, the IN clause must be specified for each co... - https://man.mtool.work/duckdb/2.0/sql/statements/pivot.html
- TPC-H Extension 8498
- The tpch extension implements the data generator and queries for the TPC-H benchmark . Installing and Loading The tpch extension is shipped by default in some DuckDB builds, otherwise it will be transparently autoloaded on first use. If you
...al TPC-H specification. To obtain fully TPC-compliant datasets, use the tpchgen-cli project . Limitation The tpch(⟨query_id⟩) function runs a fixed TPC-H query with pre-defined bind parameters (a.k.a. substitution parameters). It is not possible to... - https://man.mtool.work/duckdb/2.0/core_extensions/tpch.html
- Delta Extension 8305
- The delta extension adds support for the Delta Lake open-source storage format . It is built using the Delta Kernel . The extension reads Delta tables, local and remote, and writes them: it can create tables and append to them. For implemen
...transaction, tag the append with delta_set_transaction_version(⟨table⟩, ⟨app_id⟩, ⟨new_version⟩, ⟨expected_previous_version⟩) : ATTACH '⟨path⟩' AS my_table (TYPE delta); BEGIN TRANSACTION; CALL delta_set_transaction_version('my_table', 'my_app_id',...back transaction leaves the version unchanged. Read the current version with delta_get_transaction_version(⟨table⟩, ⟨app_id⟩) , which returns NULL if no version has been recorded yet. Attach Options When attaching a Delta table you can pass the fol... - https://man.mtool.work/duckdb/2.0/core_extensions/delta.html
- CLI Charting with YouPlot 8305
- DuckDB can be used with CLI graphing tools to quickly pipe input to stdout to graph your data in one line. YouPlot is a Ruby-based CLI tool for drawing visually pleasing plots on the terminal. It can accept input from other programs by pipi
...he SELECT in the COPY ... TO function with an output location of /dev/stdout . The syntax looks like this: sql COPY (⟨query⟩) TO '/dev/stdout' WITH (FORMAT csv, HEADER); The full DuckDB command below outputs the query in CSV format with a header: b... - https://man.mtool.work/duckdb/2.0/guides/data_viewers/youplot.html
- FROM and JOIN Clauses 8305
- The FROM clause specifies the source of the data on which the remainder of the query should operate. Logically, the FROM clause is where the query starts execution. The FROM clause can contain a single table, a combination of multiple table
..._(x); x 2 4 Specifying the Join Type Explicitly New This feature was introduced in DuckDB 2.0. The JOIN BY (TYPE ⟨join_type⟩) syntax allows you to explicitly select the join type, including DuckDB's internal join types that have no syntax in standa...rd SQL: SELECT ... FROM ⟨left_table⟩ JOIN BY (TYPE ⟨join_type⟩) ⟨right_table⟩ ON ⟨condition⟩; The join type name is case-insensitive and it can optionally have a _join suffix, e.g., mark... - https://man.mtool.work/duckdb/2.0/sql/query_syntax/from.html
- S3 API Support 7742
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...to S3 also works: COPY table TO 's3://⟨your-bucket⟩/partitioned' ( FORMAT parquet, PARTITION_BY (⟨part_col_a⟩, ⟨part_col_b⟩) ); An automatic check is performed for existing files/directories, which is currently quite conservative (and on S3 will a...ORE flag is added: COPY table TO 's3://⟨your-bucket⟩/partitioned' ( FORMAT parquet, PARTITION_BY (⟨part_col_a⟩, ⟨part_col_b⟩), OVERWRITE_OR_IGNORE true ); The naming scheme of the written files looks like this: s3://⟨your-bucket⟩/partitioned/part_c... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- Logging 7742
- DuckDB implements a logging mechanism that provides users with detailed information about events such as query execution, performance metrics and system events. Warning Logs may contain sensitive information, including secrets and credentia
...d log types expose the following schemas, which you can inspect at any time with DESCRIBE FROM duckdb_logs_parsed(⟨log_type⟩) : Log Type Schema FileSystem fs VARCHAR , path VARCHAR , op VARCHAR , bytes BIGINT , pos BIGINT HTTP request STRUCT(type,... - https://man.mtool.work/duckdb/2.0/operations_manual/logging/overview.html
DuckDB 2.0 Documentation / man.mtool.work