Results of 1 - 10 of about 17 for credential (0.002 sec.)
- AWS Extension 12242
- The aws extension adds functionality, e.g., authentication, on top of the httpfs extension's S3 capabilities , using the AWS SDK. Installing and Loading The aws extension will be transparently autoloaded on first use from the official exten
...et manually. It is part of the httpfs extension and is documented in the S3 API page . Use it when you already have static credentials. The credential_chain provider, described below, which fetches credentials automatically using the AWS SDK. It is provide...providers ( ENDPOINT , REGION , URL_STYLE , USE_SSL , KMS_KEY_ID , REQUESTER_PAYS , …) is documented in the S3 API page . credential_chain Provider The credential_chain provider allows automatically fetching credentials using mechanisms provided by the AW...S SDK. For example, to use the AWS SDK default provider: CREATE OR REPLACE SECRET secret ( TYPE s3, PROVIDER credential_chain ); To query a file using the above secret, simply query any s3:// prefixed file. DuckDB also allows specifying a spe... - https://man.mtool.work/duckdb/2.0/core_extensions/aws.html
- S3 and AWS Authentication 12242
- This page is the entry point for authenticating to S3 and other AWS services from DuckDB. Authentication is configured using secrets , and the detailed reference material lives on the S3 API Support and AWS Extension pages. The sections bel
...ference. Choosing an Authentication Method There are two S3 secret providers. Use the config provider when you have static credentials, and the credential_chain provider when you want DuckDB to fetch credentials automatically through the AWS SDK. Situation...Method Reference You have a static access key and secret config provider config provider Credentials come from ~/.aws/credentials or ~/.aws/config profiles credential_chain with a profile Selecting a Profile You sign in wi...th AWS IAM Identity Center (SSO) credential_chain with the sso chain Single Sign-On (SSO) You assume an IAM role via STS credential_chain with the sts chain Assuming... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/authentication.html
- S3 API Support 11880
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...uery using the above secret, simply query any s3:// prefixed file: SELECT * FROM 's3://⟨your-bucket⟩/⟨your_file⟩.parquet'; credential_chain Provider The credential_chain provider automatically fetches credentials using the AWS SDK (profiles, SSO, assumed r...the aws extension . For example, to use the AWS SDK default provider: CREATE OR REPLACE SECRET secret ( TYPE s3, PROVIDER credential_chain ); For the full set of credential_chain options — CHAIN values, profile selection, assuming roles, SSO, web identity...view of S3 Secret Parameters Below is a complete list of the supported parameters that can be used for both the config and credential_chain providers: Name Description Secret Type Default ENDPOINT Specify a custom S3 endpoint S3 , GCS , R2 STRING s3.amazon... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- Azure Extension 9190
- The azure extension lets DuckDB read and write files in Azure Blob Storage and Azure Data Lake Storage (ADLS) Gen2. Installing and Loading The azure extension will be transparently autoloaded on first use from the official extension reposit
...ve the storage account name: CREATE SECRET secret2 ( TYPE azure, PROVIDER config, ACCOUNT_NAME '⟨storage_account_name⟩' ); credential_chain Provider The credential_chain provider allows connecting using credentials automatically fetched by the Azure SDK vi...a the Azure credential chain. By default, the provider uses the Azure SDK's DefaultAzureCredential chain. The token is fetched at query time, not...when the secret is created. For example: CREATE SECRET secret3 ( TYPE azure, PROVIDER credential_chain, ACCOUNT_NAME '⟨storage_account_name⟩' ); DuckDB also allows specifying a specific chain using the CHAIN keyword. Th... - https://man.mtool.work/duckdb/2.0/core_extensions/azure.html
- Amazon RDS with IAM Authentication 9138
- Managed PostgreSQL databases on Amazon RDS and Aurora can authenticate with short-lived IAM tokens instead of a static password. DuckDB supports this through the postgres and aws extensions: the aws extension generates the token from an AWS
...credential chain, and the postgres extension uses it as the connection password, refreshing it automatically. Installation and Loadin...postgres; INSTALL aws; LOAD postgres; LOAD aws; Creating the Secrets First, create a secret of type rds . It uses the AWS credential chain to mint the IAM token: CREATE SECRET aws_rds_secret ( TYPE rds, PROVIDER credential_chain, CHAIN 'env;sso', REGION '...rets — AWS RDS IAM Authentication — the full reference, including verifying the setup with psql first. AWS extension — the credential chain options available to the rds secret.... - https://man.mtool.work/duckdb/2.0/guides/database_integration/rds_iam.html
- Delta Extension 8345
- The delta extension adds support for the Delta Lake open-source storage format . It is built using the Delta Kernel . The extension reads Delta tables, local and remote, and writes them: it can create tables and append to them. For implemen
...SELECT * FROM delta_scan('s3://⟨my_bucket⟩/⟨path⟩'); To authenticate, create a secret : CREATE SECRET ( TYPE s3, PROVIDER credential_chain ); SELECT * FROM delta_scan('s3://⟨my_bucket⟩/⟨path⟩'); For a public bucket, you may need to set its region in a sec...T * FROM delta_scan('az://⟨my_container⟩/⟨path⟩'); To authenticate, create a secret : CREATE SECRET ( TYPE azure, PROVIDER credential_chain, ACCOUNT_NAME '⟨storage_account_name⟩' ); SELECT * FROM delta_scan('az://⟨my_container⟩/⟨path⟩'); Reading from Googl...with an error. Attach its catalog instead, for example with the unity_catalog extension , and query the table through it. Credential Chains in Delta For some network operations, the delta extension uses delta-kernel-rs and object_store , which try credent... - https://man.mtool.work/duckdb/2.0/core_extensions/delta.html
- Hugging Face Support 8121
- The httpfs extension introduces support for the hf:// protocol to access datasets hosted in Hugging Face repositories. See the announcement blog post for details. Usage Hugging Face repositories can be queried using the following URL patter
...using the CONFIG provider, use the following command: CREATE SECRET hf_token ( TYPE huggingface, TOKEN 'your_hf_token' ); credential_chain Automatically tries to fetch credentials. For the Hugging Face token, it will try to get it from ~/.cache/huggingfac...e/token . To create a secret using the credential_chain provider, use the following command: CREATE SECRET hf_token ( TYPE huggingface, PROVIDER credential_chain );... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/hugging_face.html
- PostgreSQL Extension and the Secret Manager 8121
- User credentials and other PostgreSQL database connection details can be stored using the DuckDB Secrets Manager . The following syntax can be used to create a secret: CREATE SECRET ( TYPE postgres, HOST '127.0.0.1', PORT 5432, DATABASE pos
...nnection string to override individual options. For example, to connect to a different database while still using the same credentials, we can override only the database name in the following manner. ATTACH 'dbname=my_other_db' AS postgres_db (TYPE postgre...arameter in the ATTACH . ATTACH '' AS postgres_db_one (TYPE postgres, SECRET postgres_secret_one); Warning Avoid including credentials, such as a password, directly in the connection string. If a connection error occurs, the full connection string, includi...ng your credentials, may appear in the resulting error message. For better security, store credentials using DuckDB-managed secrets. Secret C... - https://man.mtool.work/duckdb/2.0/core_extensions/postgres/secrets.html
- Catalogs 7655
- The iceberg extension supports attaching Iceberg REST Catalogs. Attaching a catalog is required for writing to Iceberg . Before attaching an Iceberg REST Catalog, you must install the iceberg extension by following the instructions located
...Catalog Most Iceberg REST Catalogs authenticate via OAuth2. You can use the existing DuckDB secret workflow to store login credentials for the OAuth2 service. CREATE SECRET iceberg_secret ( TYPE iceberg, CLIENT_ID '⟨admin⟩', CLIENT_SECRET '⟨password⟩', OAU...bles The iceberg extension supports reading Iceberg tables stored in Amazon S3 Tables . You can let DuckDB detect your AWS credentials and configuration based on the default profile in your ~/.aws directory by creating the following secret using the Secret...s Manager : CREATE SECRET ( TYPE s3, PROVIDER credential_chain ); Alternatively, you can set the values manually: CREATE SECRET ( TYPE s3, KEY_ID '⟨key_id⟩', SECRET '⟨secret⟩', RE... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/catalogs.html
- Lance Extension 7655
- The lance extension adds support for reading and writing Lance tables. Lance is a modern lakehouse format optimized for ML/AI workloads, with native cloud storage support. Installing and Loading You can install the lance extension from Duck
...ore URIs (e.g., s3://... ), configure a TYPE lance secret using the Secrets Manager : CREATE SECRET ( TYPE lance, PROVIDER credential_chain, SCOPE 's3://bucket/' ); SELECT * FROM 's3://⟨bucket/path/to/out.lance⟩' LIMIT 10; Write a Lance Dataset Use the COP...//... paths, configure a TYPE lance secret for that scope using the Secrets Manager : CREATE SECRET ( TYPE lance, PROVIDER credential_chain, SCOPE 's3://⟨bucket⟩/' ); COPY (SELECT 1 AS id) TO 's3://⟨bucket/path/to/out.lance⟩' (FORMAT lance, MODE 'overwrite... - https://man.mtool.work/duckdb/2.0/core_extensions/lance.html
DuckDB 2.0 Documentation / man.mtool.work