Results of 1 - 8 of about 8 for providers (0.002 sec.)
- Secrets Manager 11911
- The Secrets manager provides a unified user interface for secrets across all backends that use them. Secrets can be scoped, so different storage prefixes can have different secrets, allowing for example to join data across organizations in
...stgres quack Quack quack r2 Cloudflare R2 httpfs s3 AWS S3 httpfs aws AWS aws For each type, there are one or more “secret providers” that specify how the secret is created. Secrets can also have an optional scope, which is a file path prefix that the sec..._secrets directory. On startup of DuckDB, persistent secrets are read from this directory and automatically loaded. Secret Providers To create a secret, a Secret Provider needs to be used. A Secret Provider is a mechanism through which a secret is generat...ed. To illustrate this, for the S3 , GCS , R2 , and AZURE secret types, DuckDB currently supports two providers: CONFIG and credential_chain . The CONFIG provider requires the user to pass all configuration information into the CREATE... - https://man.mtool.work/duckdb/2.0/configuration/secrets_manager.html
- S3 API Support 11224
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
.... DuckDB conforms to the S3 API, that is now common among industry storage providers. Platforms The httpfs filesystem is tested with AWS S3 , Minio , Google Cloud and lakeFS . Other services that implement t...S Authentication page. The preferred way to configure and authenticate to S3 endpoints is to use secrets . Multiple secret providers are available. To migrate from the deprecated S3 API , use a defined secret with a profile. See Selecting a Profile . conf...Parameters Below is a complete list of the supported parameters that can be used for both the config and credential_chain providers: Name Description Secret Type Default ENDPOINT Specify a custom S3 endpoint S3 , GCS , R2 STRING s3.amazonaws.com for S3 ,... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- S3 and AWS Authentication 9633
- This page is the entry point for authenticating to S3 and other AWS services from DuckDB. Authentication is configured using secrets , and the detailed reference material lives on the S3 API Support and AWS Extension pages. The sections bel
...explain which method to use and link to the relevant reference. Choosing an Authentication Method There are two S3 secret providers. Use the config provider when you have static credentials, and the credential_chain provider when you want DuckDB to fetch...er is AWS-specific and is provided by the aws extension , which is autoloaded on first use. Static Credentials: the config Provider Supply the key and secret directly: CREATE OR REPLACE SECRET secret ( TYPE s3, PROVIDER config, KEY_ID '⟨AKIAIOSFODNN7EXAMP...on Resolution , Validation , and Auto-Refresh . Secret Parameters The full list of S3 secret parameters that apply to both providers ( ENDPOINT , REGION , URL_STYLE , USE_SSL , KMS_KEY_ID , REQUESTER_PAYS , and more) is documented in the Overview of S3 Se... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/authentication.html
- AWS Extension 9163
- The aws extension adds functionality, e.g., authentication, on top of the httpfs extension's S3 capabilities , using the AWS SDK. Installing and Loading The aws extension will be transparently autoloaded on first use from the official exten
...tion page. The preferred way to configure and authenticate to AWS S3 endpoints is to use secrets . There are two S3 secret providers: The config provider, where you supply the access key and secret manually. It is part of the httpfs extension and is docum...SSO, assumed roles, web identities (IRSA), and instance metadata. The full list of S3 secret parameters that apply to both providers ( ENDPOINT , REGION , URL_STYLE , USE_SSL , KMS_KEY_ID , REQUESTER_PAYS , …) is documented in the S3 API page . credential...DuckDB also allows specifying a specific chain using the CHAIN keyword. This takes a semicolon-separated list ( a;b;c ) of providers that will be tried in order. For example: CREATE OR REPLACE SECRET secret ( TYPE s3, PROVIDER credential_chain, CHAIN 'env... - https://man.mtool.work/duckdb/2.0/core_extensions/aws.html
- Azure Extension 8946
- The azure extension lets DuckDB read and write files in Azure Blob Storage and Azure Data Lake Storage (ADLS) Gen2. Installing and Loading The azure extension will be transparently autoloaded on first use from the official extension reposit
...he SET variables in Authentication with Variables still work but are deprecated. Authentication with Secret Several Secret Providers are available, described below. These rules apply to every provider: If you need to define different secrets for different...DuckDB also allows specifying a specific chain using the CHAIN keyword. This takes a semicolon-separated list ( a;b;c ) of providers that will be tried in order. For example: CREATE SECRET secret4 ( TYPE azure, PROVIDER credential_chain, CHAIN 'cli;env',...der allows connecting using an Azure Service Principal (SPN) . With a client secret: CREATE SECRET azure_spn ( TYPE azure, PROVIDER service_principal, TENANT_ID '⟨tenant_id⟩', CLIENT_ID '⟨client_id⟩', CLIENT_SECRET '⟨client_secret⟩', ACCOUNT_NAME '⟨storag... - https://man.mtool.work/duckdb/2.0/core_extensions/azure.html
- PostgreSQL Extension and the Secret Manager 8025
- User credentials and other PostgreSQL database connection details can be stored using the DuckDB Secrets Manager . The following syntax can be used to create a secret: CREATE SECRET ( TYPE postgres, HOST '127.0.0.1', PORT 5432, DATABASE pos
...rts IAM authentication, when the password is not specified in the secret, but instead one of the configured AWS Credential Providers is used to generate the password, that is refreshed by the postgres extension automatically. Connecting with IAM Authentic...S extension documentation . Storing Secrets inside a PostgreSQL Database DuckDB Secrets Manager supports pluggable Storage Providers. The postgres extension implements storing the secrets (of any type) as records in the PostgreSQL database table. The foll... - https://man.mtool.work/duckdb/2.0/core_extensions/postgres/secrets.html
- Hugging Face Support 7121
- The httpfs extension introduces support for the hf:// protocol to access datasets hosted in Hugging Face repositories. See the announcement blog post for details. Usage Hugging Face repositories can be queried using the following URL patter
...ns to obtain your access token. Second, set it in your DuckDB session using DuckDB's Secrets Manager . DuckDB supports two providers for managing secrets: CONFIG The user must pass all configuration information into the CREATE SECRET statement . To create... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/hugging_face.html
- Iceberg Options 6199
- This page lists the options of the iceberg extension: the parameters accepted by the Iceberg functions , the options of the ATTACH and CREATE SECRET statements used to connect to a catalog , and the global settings. ATTACH Options To make a
...g Catalog to attach to. Use NONE for catalogs that need no authentication. Endpoint Type For commonly used Iceberg Catalog providers, the ENDPOINT_TYPE parameter can be used to set certain parameters to default values. Acting as a shorthand for connecting... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/iceberg_options.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work