Results of 1 - 10 of about 10 for .⟨ (0.002 sec.)
- Catalogs 13890
- The iceberg extension supports attaching Iceberg REST Catalogs. Attaching a catalog is required for writing to Iceberg . Before attaching an Iceberg REST Catalog, you must install the iceberg extension by following the instructions located
...g ( TYPE iceberg, ENDPOINT_TYPE s3_tables ); Warning ENDPOINT_TYPE s3_tables always builds an endpoint of the form s3tables.⟨region⟩.amazonaws.com/iceberg . This is incorrect for any region whose endpoint does not use the plain amazonaws.com suffix...hment worked, list all tables: SHOW ALL TABLES; You can query a table as follows: SELECT count(*) FROM my_s3_tables_catalog.⟨namespace_name⟩.⟨table_name⟩; AWS Glue (Amazon SageMaker Lakehouse) The iceberg extension supports reading Iceberg tables t...ation methods are supported . Then, connect to the catalog: ATTACH '⟨account_id⟩' AS glue_catalog ( TYPE iceberg, URI 'glue.⟨region⟩.amazonaws.com/iceberg', AUTHORIZATION_TYPE 'sigv4' ); Or alternatively: ATTACH '⟨account_id⟩' AS glue_catalog ( TYP... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/catalogs.html
- Troubleshoot 9546
- Overview This page collects common issues encountered when using the DuckDB JDBC driver, together with their workarounds. If you run into a problem that is not covered here, search the driver's issue tracker on GitHub. Driver Class Not Foun
...a misleading message: java.lang.UnsatisfiedLinkError: Unsupported JNI version 0xffffffff, required by ⟨path⟩/libduckdb_java.⟨suffix⟩ This is what the library's JNI_OnLoad reports when an internal lookup failed, and the cause is the same missing met...library.path = [.] ... Caused by: java.io.FileNotFoundException: DuckDB JNI library not found, path: '⟨path⟩/libduckdb_java.⟨suffix⟩' The shared library was neither embedded in the executable nor found next to it. Either add a resource entry for yo... - https://man.mtool.work/duckdb/2.0/clients/java/troubleshoot.html
- S3 Parquet Import 9135
- Prerequisites To load a Parquet file from S3, the httpfs extension is required. This can be installed using the INSTALL SQL command. This only needs to be run once. INSTALL httpfs; To load the httpfs extension for usage, use the LOAD SQL co
...st-1⟩' ); Tip If you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitly via ENDPOINT 's3.⟨your-region⟩.amazonaws.com' . To fetch credentials automatically instead — or to use a named profile, SSO, or an assumed ro... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_import.html
- S3 Parquet Export 8938
- To write a Parquet file to S3, the httpfs extension is required. This can be installed using the INSTALL SQL command. This only needs to be run once. INSTALL httpfs; To load the httpfs extension for usage, use the LOAD SQL command: LOAD htt
...st-1⟩' ); Tip If you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitly via ENDPOINT 's3.⟨your-region⟩.amazonaws.com' . To fetch credentials automatically instead — or to use a named profile, SSO, or an assumed ro... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_export.html
- Amazon RDS with IAM Authentication 8724
- Managed PostgreSQL databases on Amazon RDS and Aurora can authenticate with short-lived IAM tokens instead of a static password. DuckDB supports this through the postgres and aws extensions: the aws extension generates the token from an AWS
...t ( TYPE rds, PROVIDER credential_chain, CHAIN 'env;sso', REGION '⟨eu-west-1⟩', RDS_USER '⟨postgres⟩', RDS_HOST '⟨instance⟩.⟨identifier⟩.⟨region⟩.rds.amazonaws.com', RDS_PORT '5432' ); Then create a secret of type postgres that references it via AW...ated by the rds secret is used (and refreshed) automatically: CREATE SECRET pg_rds_secret ( TYPE postgres, HOST '⟨instance⟩.⟨identifier⟩.⟨region⟩.rds.amazonaws.com', PORT '5432', USER '⟨postgres⟩', DATABASE '⟨postgres⟩', SSLMODE require, AWS_RDS_SE...then query it as a regular database: ATTACH '' AS rds_db (TYPE postgres, SECRET pg_rds_secret); SELECT * FROM rds_db.public.⟨tbl_name⟩; See Also Postgres extension secrets — AWS RDS IAM Authentication — the full reference, including verifying the s... - https://man.mtool.work/duckdb/2.0/guides/database_integration/rds_iam.html
- Iceberg Options 8313
- This page lists the options of the iceberg extension: the parameters accepted by the Iceberg functions , the options of the ATTACH and CREATE SECRET statements used to connect to a catalog , and the global settings. ATTACH Options To make a
...rameter Value AUTHORIZATION_TYPE SIGV4 SIGV4_REGION The REGION section of the ARN provided as the ATTACH path. URI s3tables.⟨region⟩.amazonaws.com/iceberg REMOVE_FILES_ON_DELETE false (unless explicitly set) STAGE_CREATE_TABLES false (unless explic...g S3/AWS SECRET . The parameters set by using the GLUE ENDPOINT_TYPE are: Parameter Value AUTHORIZATION_TYPE SIGV4 URI glue.⟨region⟩.amazonaws.com/iceberg using the region from the found SECRET REMOVE_FILES_ON_DELETE false (unless explicitly set) S... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/iceberg_options.html
- Legacy Authentication Scheme for S3 API 8098
- Prior to version 0.10.0, DuckDB did not have a Secrets manager . Hence, the configuration of and authentication to S3 endpoints was handled via variables. This page documents the legacy authentication scheme for the S3 API. Warning This pag
...1'; Optionally, the endpoint can be configured in case a non-AWS object storage server is used: SET s3_endpoint = '⟨domain⟩.⟨tld⟩:⟨port⟩'; If the endpoint is not SSL-enabled then run: SET s3_use_ssl = false; Switching between path-style and vhost-s..., note that this may also require updating the endpoint. For example for AWS S3 it is required to change the endpoint to s3.⟨region⟩.amazonaws.com . After configuring the correct endpoint and region, public files can be read. To also read private f... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api_legacy_authentica...
- Rust Client 7687
- Installation To use the DuckDB Rust client, visit the Rust installation page . The latest stable version of the DuckDB Rust client is 2.0.0. The DuckDB Rust client, duckdb-rs , is an ergonomic wrapper over the DuckDB C API that exposes an i
...tures bundled The equivalent Cargo.toml entry pins the version. Starting with DuckDB 1.5.0 the crate version has the form 1.⟨major_minor_patch⟩.x . A tilde requirement receives patch releases without changing the bundled DuckDB version: [dependenci... - https://man.mtool.work/duckdb/2.0/clients/rust/overview.html
- S3 API Support 7472
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...st-1⟩' ); Tip If you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitly via ENDPOINT 's3.⟨your-region⟩.amazonaws.com' . Now, to query using the above secret, simply query any s3:// prefixed file: SELECT * FROM 's3...es/a/gcs/secret⟩.parquet'); Reading Reading files from S3 is now as simple as: SELECT * FROM 's3://⟨your-bucket⟩/⟨filename⟩.⟨extension⟩'; Partial Reading The httpfs extension supports partial reading from S3 buckets. Pinning Object Versions By defa...upload files at high speed. Writing to S3 works for both CSV and Parquet: COPY table_name TO 's3://⟨your-bucket⟩/⟨filename⟩.⟨extension⟩'; Partitioned copy to S3 also works: COPY table TO 's3://⟨your-bucket⟩/partitioned' ( FORMAT parquet, PARTITION_... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- Metrics 7472
- DuckDB provides a set of metrics that can be used to monitor the performance and health of the database. Metrics are named ⟨group⟩.⟨metric⟩ , e.g., query.total_time or operator.timing . The set of collected metrics is controlled with the tr
...pent in all optimizers combined Additionally, each optimizer has a corresponding metric that follows the template optimizer.⟨optimizer_name⟩ and measures the time (in seconds) spent in that optimizer. These metrics are only collected when the speci... - https://man.mtool.work/duckdb/2.0/dev/metrics.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work