Results of 1 - 10 of about 27 for rest (0.003 sec.)
- Catalogs 15026
- The iceberg extension supports attaching Iceberg REST Catalogs. Attaching a catalog is required for writing to Iceberg . Before attaching an Iceberg REST Catalog, you must install the iceberg extension by following the instructions located
...in the overview . The section below describes the generic way of attaching an Iceberg REST Catalog. For instructions specific to a catalog implementation, see Amazon S3 Tables , AWS Glue , Cloudflare R2 Data Catal...og , Apache Polaris , Lakekeeper , SeaweedFS and Google Cloud BigLake . Attaching an Iceberg REST Catalog Most Iceberg REST Catalogs authenticate via OAuth2. You can use the existing DuckDB secret workflow to store login...SECRET iceberg_secret ( TYPE iceberg, CLIENT_ID '⟨admin⟩', CLIENT_SECRET '⟨password⟩', OAUTH2_SERVER_URI '⟨http://iceberg_rest_catalog_url.com/v1/oauth/tokens⟩' ); If you already have a Bearer token, you can pass it directly to your CREATE SECRET st... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/catalogs.html
- Iceberg Options 11372
- This page lists the options of the iceberg extension: the parameters accepted by the Iceberg functions , the options of the ATTACH and CREATE SECRET statements used to connect to a catalog , and the global settings. ATTACH Options To make a
...options provided to the ATTACH are divided into categories: Parameter Type Default Description URI VARCHAR NULL URL of the REST Catalog endpoint. In DuckDB 2.0, URI is the canonical option name; ENDPOINT is accepted as a deprecated alias (do not supp...prefix when communicating with the catalog. MAX_TABLE_STALENESS INTERVAL NULL Prevents unnecessary requests to the Iceberg REST Catalog. Accepts human-readable interval strings such as 10 minutes , 30 seconds , or 1 year . EXTRA_HTTP_HEADERS MAP(VARC...HAR, VARCHAR) NULL Extra headers (key-value) sent along with the requests to the REST Catalog. DEFAULT_TABLE_LOCATION_FROM_NAMESPACE BOOLEAN false If enabled, a CREATE TABLE without an explicit WITH ('locatio... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/iceberg_options.html
- Iceberg Functions 10401
- The iceberg extension provides the following functions: Function Description iceberg_scan(source) Reads an Iceberg table from a path. iceberg_metadata(source) Returns the manifest entries of an Iceberg table. iceberg_snapshots(source) Retur
...rtition-field statistics of an Iceberg table. iceberg_load_table_response(table) Returns the raw LoadTable response of the REST Catalog. iceberg_files(source) Returns the data and delete files of an Iceberg table snapshot. iceberg_manifests(source) R...n tasks (files to read) planned for an Iceberg table. iceberg_view_metadata(view) Returns the raw LoadView response of the REST Catalog. iceberg_table_properties(table) Returns all properties of the specified table. set_iceberg_table_properties(table...d_table_response The iceberg_load_table_response function is an advanced function that only works with an attached Iceberg REST Catalog . It returns the raw LoadTable response of the catalog with the columns metadata_location , metadata ( VARIANT ),... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/iceberg_functions.html
- Iceberg Extension 9430
- The iceberg extension implements support for the Apache Iceberg open table format . There are two ways to work with Iceberg in DuckDB: Individual tables are read directly from storage, by pointing at a table's metadata. This requires no cat
...alog and is read-only. Catalog-managed tables are accessed by attaching an Iceberg REST catalog. This unlocks the full feature set, including writing. This page covers the basics of both. See also: Writing to I...ons documents the scan parameters, ATTACH options, secret options and settings. Catalogs explains how to attach an Iceberg REST Catalog, with instructions for specific catalogs. Troubleshooting lists common problems and their solutions. Installing an...eberg_scan('data/iceberg/lineitem_iceberg', allow_moved_paths = true); count_star() 51793 The allow_moved_paths option ensures that some path resolution is performed, which allows scanning Iceberg tables that are moved. You can also directly specify... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/overview.html
- PEG Parser 8706
- New Starting with DuckDB 2.0, the PEG parser is the default parser. In earlier versions it was an experimental, opt-in feature enabled with enable_peg_parser() , which is no longer required or available. DuckDB uses a parser based on PEG (
...nge the SQL dialect. DuckDB 2.0 replaced the parser implementation and rewrote its grammar, but the dialect itself and the rest of the query pipeline, including the binder, continue to operate on the same internal syntax tree. Suggestions The PEG par...part of the parser, extensions can extend the tokenizer, add grammar rules, and register custom matchers while reusing the rest of the DuckDB grammar. This makes it possible to combine the syntax of multiple extensions, and you can expect extensions... - https://man.mtool.work/duckdb/2.0/sql/peg_parser.html
- Troubleshooting 8344
- Curl Request Fails Problem When trying to attach to an Iceberg REST Catalog endpoint, DuckDB returns the following error: IO Error: Curl Request to '/v1/oauth/tokens' failed with error: 'URL using bad/illegal format or missing URL' Solution
... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/troubleshooting.html
- Unity Catalog Extension 8097
- The unity_catalog extension attaches a Unity Catalog catalog, on Databricks or Unity Catalog OSS, as a DuckDB database. You can list, read, insert into and create its Delta Lake tables. It uses the delta extension to access the tables. For
...gion⟩' ); ATTACH '⟨catalog_name⟩' AS my_catalog (TYPE unity_catalog, DEFAULT_SCHEMA 'main'); ENDPOINT is the Unity Catalog REST API endpoint. For Databricks, it is your Workspace URL , typically https://⟨instance⟩.cloud.databricks.com/ . TOKEN is a c...Scan Planning New This feature was introduced in DuckDB 2.0. Databricks can plan scans on the server, through the Iceberg REST Catalog (IRC) API of Unity Catalog. The API uses catalog-wide statistics, which can improve filtering and reduce the numbe...ed commits. Tables created by other clients, e.g., Spark or the Unity Catalog CLI, are read and written the same way. Features This extension supports: Listing available tables: SHOW ALL TABLES; Interacting with tables using standard SQL: SELECT * FR... - https://man.mtool.work/duckdb/2.0/core_extensions/unity_catalog.html
- SeaweedFS Import 7965
- Prerequisites For SeaweedFS , the S3-compatible gateway allows you to use DuckDB's S3 support to read and write from SeaweedFS buckets. This requires the httpfs extension , which can be installed using the INSTALL SQL command. This only nee
...; SeaweedFS also supports Iceberg: table buckets store the table data as Parquet files, and the gateway's built-in Iceberg REST Catalog serves the table metadata. See the SeaweedFS catalog example to query Iceberg tables through it.... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/seaweedfs_import....
- Write User Defined Functions 7735
- Overview The JDBC driver can register user-defined functions (UDFs) written in Java, including scalar functions and table functions. This page covers building and registering both, from the simple functional-interface overloads to the vecto
...xception { Series cursor = info.getInitData(); long row = 0; // Fill at most one chunk; DuckDB calls apply() again for the rest. for (; row < output.capacity() && cursor.next < cursor.end; row++, cursor.next++) { for (long col = 0; col < output.colum...builder to let DuckDB tell the function which columns are actually needed, so that apply can skip the work of filling the rest. When pushdown is enabled, the init callback learns the projected columns from its DuckDBTableFunctionInitInfo : getColumn... - https://man.mtool.work/duckdb/2.0/clients/java/functions.html
- Python Client API 7735
- Connection class duckdb. Appender Bases: object append_row ( self , * args ) → None Buffer one row, one value per column, each converted as an executemany parameter would be append_rows ( self , rows : object ) → None Buffer each row of an
...one statement on the appender's connection class duckdb. DuckDBPyConnection Bases: object abort ( self ) → None Cancel the rest of the result of execute(); a statement that may write fails an open transaction append ( self , table_name : str , df : o...ssion ( function_name : str | tuple [ str , ... ] , * args : object ) → Expression A call of the function by its name, a bare string argument being a value as everywhere else. duckdb. lag ( subject : Expression , / , * args : object ) → Expression Th...as given, never from untrusted input. An alias in the text names the column, as SQLExpression(“sum(x) AS total”) does; the rest of the text is what the SQL holds, in parentheses on lines of its own. duckdb. star ( exclude : ColumnNames = () , rename... - https://man.mtool.work/duckdb/2.0/clients/python/reference/
DuckDB 2.0 Documentation / man.mtool.work