Results of 1 - 9 of about 9 for ⟩'; (0.001 sec.)
- HTTP(S) Support 12097
- With the httpfs extension, it is possible to directly query files over the HTTP(S) protocol. This works for all files supported by DuckDB or its various extensions, and provides read-only access. SELECT * FROM 'https://domain.tld/file.exten
..._PROXY_PASSWORD '⟨password⟩' ); Alternatively, you can add it via configuration options : SET http_proxy = '⟨http_proxy_url⟩'; SET http_proxy_username = '⟨username⟩'; SET http_proxy_password = '⟨password⟩'; Note: You cannot set a proxy scope using t...set the following configuration options prior to loading the extension: LOAD httpfs; SET ca_cert_file = '⟨certificate_file⟩'; SET enable_server_cert_verification = true; If you would like to disable SSL verification for all HTTP requests using an H... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/https.html
- Legacy Authentication Scheme for S3 API 12097
- Prior to version 0.10.0, DuckDB did not have a Secrets manager . Hence, the configuration of and authentication to S3 endpoints was handled via variables. This page documents the legacy authentication scheme for the S3 API. Warning This pag
...ly, the endpoint can be configured in case a non-AWS object storage server is used: SET s3_endpoint = '⟨domain⟩.⟨tld⟩:⟨port⟩'; If the endpoint is not SSL-enabled then run: SET s3_use_ssl = false; Switching between path-style and vhost-style URLs is...an be read. To also read private files, authentication credentials can be added: SET s3_access_key_id = '⟨aws_access_key_id⟩'; SET s3_secret_access_key = '⟨aws_secret_access_key⟩'; Alternatively, temporary S3 credentials are also supported. They req...uire setting an additional session token: SET s3_session_token = '⟨aws_session_token⟩'; The aws extension allows for loading AWS credentials. Per-Request Configuration Deprecated Per-request configuration throu... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api_legacy_authentica...
- Azure Extension 9796
- The azure extension lets DuckDB read and write files in Azure Blob Storage and Azure Data Lake Storage (ADLS) Gen2. Installing and Loading The azure extension will be transparently autoloaded on first use from the official extension reposit
...re Blob Storage Allowed URI schemes: az or azure SELECT count(*) FROM 'az://⟨my_container⟩/⟨path⟩/⟨my_file⟩.⟨parquet_or_csv⟩'; Globs are also supported: SELECT * FROM 'az://⟨my_container⟩/⟨path⟩/*.csv'; SELECT * FROM 'az://⟨my_container⟩/⟨path⟩/**';...ntax: SELECT count(*) FROM 'az://⟨my_storage_account⟩.blob.core.windows.net/⟨my_container⟩/⟨path⟩/⟨my_file⟩.⟨parquet_or_csv⟩'; SELECT * FROM 'az://⟨my_storage_account⟩.blob.core.windows.net/⟨my_container⟩/⟨path⟩/*.csv'; Azure Data Lake Storage (ADLS...mes: abfss or abfs (both connect over HTTPS) SELECT count(*) FROM 'abfss://⟨my_filesystem⟩/⟨path⟩/⟨my_file⟩.⟨parquet_or_csv⟩'; Globs are also supported: SELECT * FROM 'abfss://⟨my_filesystem⟩/⟨path⟩/*.csv'; SELECT * FROM 'abfss://⟨my_filesystem⟩/⟨pa... - https://man.mtool.work/duckdb/2.0/core_extensions/azure.html
- Versioning of Extensions 8322
- Extension Versioning Most software has some sort of version number. Version numbers serve a few important goals: Tie a binary to a specific state of the source code Allow determining the expected feature set Allow determining the state of t
...specific version of an extension, add a VERSION clause to the INSTALL statement: INSTALL ⟨extension_name⟩ VERSION '⟨version⟩'; The VERSION clause can be combined with a FROM clause that selects a repository , and with FORCE INSTALL to replace an alr...eady installed version: FORCE INSTALL ⟨extension_name⟩ FROM core VERSION '⟨version⟩'; Pinning a version is mainly useful for extensions that publish their own versioned releases, i.e., pre-release and stable... - https://man.mtool.work/duckdb/2.0/extensions/versioning_of_extensions.html
- S3 API Support 8160
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...cret⟩.parquet'); Reading Reading files from S3 is now as simple as: SELECT * FROM 's3://⟨your-bucket⟩/⟨filename⟩.⟨extension⟩'; Partial Reading The httpfs extension supports partial reading from S3 buckets. Pinning Object Versions By default, a long-...s at high speed. Writing to S3 works for both CSV and Parquet: COPY table_name TO 's3://⟨your-bucket⟩/⟨filename⟩.⟨extension⟩'; Partitioned copy to S3 also works: COPY table TO 's3://⟨your-bucket⟩/partitioned' ( FORMAT parquet, PARTITION_BY (⟨part_co... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- Lance Extension 7657
- The lance extension adds support for reading and writing Lance tables. Lance is a modern lakehouse format optimized for ML/AI workloads, with native cloud storage support. Installing and Loading You can install the lance extension from Duck
...' ( FORMAT lance, MODE 'overwrite' ); -- Read it back via the replacement scan SELECT count(*) FROM '⟨path/to/dataset.lance⟩'; -- Append more rows to an existing dataset COPY ( SELECT 3::BIGINT AS id, 'c'::VARCHAR AS s ) TO '⟨path/to/dataset.lance⟩'... - https://man.mtool.work/duckdb/2.0/core_extensions/lance.html
- Extension Distribution 7657
- Platforms Extension binaries are distributed for several platforms (see below). For platforms where packages for certain extensions are not available, users can build them from source and install the resulting binaries manually . Most offic
...epository, DuckDB will search for both a gzipped and non-gzipped version. For example: INSTALL icu FROM '⟨custom_repository⟩'; The execution of this statement will first look for icu.duckdb_extension.gz , then icu.duckdb_extension in the repository'... - https://man.mtool.work/duckdb/2.0/extensions/extension_distribution.html
- Deploy 7495
- Overview Deploying DuckDB-Wasm means serving its components so that the browser can fetch and instantiate them. This page describes each component a deployment needs to serve, how the worker and WebAssembly variants relate, how extensions a
...ir-tight deployments on internal networks. SET custom_extension_repository = '⟨https://some.endpoint.org/path/to/repository⟩'; Changes the default extension repository from the public https://extensions.duckdb.org to the one specified. Note that ext... - https://man.mtool.work/duckdb/2.0/clients/wasm/deploying_duckdb_wasm.html
- PostgreSQL Extension and the Secret Manager 7495
- User credentials and other PostgreSQL database connection details can be stored using the DuckDB Secrets Manager . The following syntax can be used to create a secret: CREATE SECRET ( TYPE postgres, HOST '127.0.0.1', PORT 5432, DATABASE pos
...tached database can be listed using the following query: FROM duckdb_secrets() WHERE storage = 'postgres_⟨attached_database⟩'; To disable the PostgreSQL Secret Storage completely pass the empty string '' in the SECRET_STORAGE_TABLE parameter.... - https://man.mtool.work/duckdb/2.0/core_extensions/postgres/secrets.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work