Results of 1 - 10 of about 39 for region (0.002 sec.)
- AWS Extension 14472
- The aws extension adds functionality, e.g., authentication, on top of the httpfs extension's S3 capabilities , using the AWS SDK. Installing and Loading The aws extension will be transparently autoloaded on first use from the official exten
...identities (IRSA), and instance metadata. The full list of S3 secret parameters that apply to both providers ( ENDPOINT , REGION , URL_STYLE , USE_SSL , KMS_KEY_ID , REQUESTER_PAYS , …) is documented in the S3 API page . credential_chain Provider The...allows overriding the automatically fetched config. For example, to automatically load credentials, and then override the region, run: CREATE OR REPLACE SECRET secret ( TYPE s3, PROVIDER credential_chain, CHAIN config, REGION '⟨eu-west-1⟩' ); Selectin...VIDER credential_chain, CHAIN 'sts', ASSUME_ROLE_ARN 'arn:aws:iam::⟨account_id⟩:role/⟨role⟩', EXTERNAL_ID '⟨external_id⟩', REGION '⟨us-east-1⟩' ); The sts chain value requires an ASSUME_ROLE_ARN value. If the selected profile itself uses STS, use CHAIN... - https://man.mtool.work/duckdb/2.0/core_extensions/aws.html
- Legacy Authentication Scheme for S3 API 10932
- Prior to version 0.10.0, DuckDB did not have a Secrets manager . Hence, the configuration of and authentication to S3 endpoints was handled via variables. This page documents the legacy authentication scheme for the S3 API. Warning This pag
...enticate of S3 endpoints is to use secrets . Legacy Authentication Scheme To be able to read or write from S3, the correct region should be set: SET s3_region = 'us-east-1'; Optionally, the endpoint can be configured in case a non-AWS object storage se...note that this may also require updating the endpoint. For example for AWS S3 it is required to change the endpoint to s3.⟨region⟩.amazonaws.com . After configuring the correct endpoint and region, public files can be read. To also read private files,...ve, specific configuration values can be used on a per-request basis. This allows for use of multiple sets of credentials, regions, etc. These are used by including them on the S3 URI as query parameters. All the individual configuration values listed... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api_legacy_authentica...
- Catalogs 9632
- The iceberg extension supports attaching Iceberg REST Catalogs. Attaching a catalog is required for writing to Iceberg . Before attaching an Iceberg REST Catalog, you must install the iceberg extension by following the instructions located
...al_chain ); Alternatively, you can set the values manually: CREATE SECRET ( TYPE s3, KEY_ID '⟨key_id⟩', SECRET '⟨secret⟩', REGION '⟨region⟩' ); For the full range of credential options (assumed roles, SSO, web identity, and more), see the aws extension...( TYPE iceberg, ENDPOINT_TYPE s3_tables ); Warning ENDPOINT_TYPE s3_tables always builds an endpoint of the form s3tables.⟨region⟩.amazonaws.com/iceberg . This is incorrect for any region whose endpoint does not use the plain amazonaws.com suffix — mos...t notably the AWS China regions ( cn-north-1 , cn-northwest-1 ), which use amazonaws.com.cn . For such regions, attach the catalog by passing an explicit... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/catalogs.html
- Quack on WebAssembly 9632
- CloudFormation Stack We provide an example template for initializing a CloudFormation stack, based on pre-baked public AMI, based on Ubuntu, which will: via DuckDB, install and load Quack, create a randomized token, and do quack_serve on th
...able at https://duckdb-quack-ami.s3.us-east-1.amazonaws.com/quack.yaml , and is backed by images for (at the moment) eight regions: us-east-1 us-east-2 us-west-1 us-west-2 eu-central-1 eu-west-1 ap-northeast-1 ap-southeast-1 Only inputs are the type of...the instance (default t3.micro) and the name of the stack (needs to be unique on the same org/region). Template is maintained at https://github.com/duckdb/duckdb-quack-infra Deploy via Web UI Visit https://console.aws.amazo...te the non-relevant anymore stacks. Deploy via aws CLI To deploy a Quack demo with the name my-quack-demo in the us-east-2 region, run: aws cloudformation create-stack \ --stack-name my-quack-demo \ --template-url https://duckdb-quack-ami.s3.us-east-1.... - https://man.mtool.work/duckdb/2.0/quack/setup/quack_wasm.html
- Fastly Object Storage Import 9366
- Prerequisites For Fastly Object Storage, the S3 Compatibility API allows you to use DuckDB's S3 support to read and write from Fastly buckets. This requires the httpfs extension , which can be installed using the INSTALL SQL command. This o
..._secret ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', URL_STYLE 'path', REGION '⟨us-east⟩', ENDPOINT '⟨us-east⟩.object.fastlystorage.app' -- see note below ); The ENDPOINT needs to point to the Fastly...endpoint for the region you want to use (e.g., eu-central.object.fastlystorage.app ). REGION must use the same region mentioned in ENDPOINT . URL_... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/fastly_object_sto...
- Tigris Import 9162
- Prerequisites For Tigris , the S3-compatible API allows you to use DuckDB's S3 support to read and write from Tigris buckets. This requires the httpfs extension , which can be installed using the INSTALL SQL command. This only needs to be r
...ecret in DuckDB: CREATE SECRET my_secret ( TYPE s3, KEY_ID '⟨tid_xxxxxxxxxxxx⟩', SECRET '⟨tsec_xxxxxxxxxxxxxxxxxxxxxxxx⟩', REGION 'auto', ENDPOINT 'fly.storage.tigris.dev' ); A single endpoint ( fly.storage.tigris.dev ) serves all regions; requests are...routed to the Tigris region nearest the caller. REGION is required for request signing but is not used for routing — set it to auto . URL_STYLE does n...B runs on a Fly.io Machine, requests to fly.storage.tigris.dev stay on Fly's internal network and are served from the same region as the Machine when possible. Querying After setting up the Tigris credentials, you can query the data using DuckDB's buil... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/tigris_import.htm...
- S3 Parquet Export 9037
- To write a Parquet file to S3, the httpfs extension is required. This can be installed using the INSTALL SQL command. This only needs to be run once. INSTALL httpfs; To load the httpfs extension for usage, use the LOAD SQL command: LOAD htt
...pfs; After loading the httpfs extension, set up the credentials to write data. Note that the region parameter should match the region of the bucket you want to access. CREATE SECRET ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE...⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩' ); Tip If you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitly via ENDP...OINT 's3.⟨your-region⟩.amazonaws.com' . To fetch credentials automatically instead — or to use a named profile, SSO, or an assumed role — see th... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_export.html
- Iceberg Options 8708
- This page lists the options of the iceberg extension: the parameters accepted by the Iceberg functions , the options of the ATTACH and CREATE SECRET statements used to connect to a catalog , and the global settings. ATTACH Options To make a
...ogs. S3 Tables The parameters set by using the S3_TABLES ENDPOINT_TYPE are: Parameter Value AUTHORIZATION_TYPE SIGV4 SIGV4_REGION The REGION section of the ARN provided as the ATTACH path. URI s3tables.⟨region⟩.amazonaws.com/iceberg REMOVE_FILES_ON_DEL...S3/AWS SECRET . The parameters set by using the GLUE ENDPOINT_TYPE are: Parameter Value AUTHORIZATION_TYPE SIGV4 URI glue.⟨region⟩.amazonaws.com/iceberg using the region from the found SECRET REMOVE_FILES_ON_DELETE false (unless explicitly set) STAGE_C...rver to contact. OAUTH2_GRANT_TYPE VARCHAR NULL The grant_type to use. OAUTH2_SCOPE VARCHAR NULL The scope to use. DEFAULT_REGION VARCHAR NULL The region to add to vended credentials if none is provided by the Catalog. TOKEN VARCHAR NULL The Bearer Tok... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/iceberg_options.html
- S3 API Support 8645
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...T secret ( TYPE s3, PROVIDER config, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩' ); Tip If you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitly via ENDP...OINT 's3.⟨your-region⟩.amazonaws.com' . Now, to query using the above secret, simply query any s3:// prefixed file: SELECT * FROM 's3://⟨your-bu...For the full set of credential_chain options — CHAIN values, profile selection, assuming roles, SSO, web identity (IRSA), region resolution, validation, and auto-refresh — see the AWS extension page . Overview of S3 Secret Parameters Below is a comple... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- S3 Express One 8583
- In late 2023, AWS announced the S3 Express One Zone , a high-speed variant of traditional S3 buckets. DuckDB can read S3 Express One buckets using the httpfs extension . Credentials and Configuration The configuration of S3 Express One buck
...ckets with one exception: you must specify the endpoint according to the following pattern: s3express-⟨availability_zone⟩.⟨region⟩.amazonaws.com where the ⟨availability_zone⟩ (e.g., use-az5 ) can be obtained from the S3 Express One bucket's configurati...on page and the ⟨region⟩ is the AWS region (e.g., us-east-1 ). For example, to allow DuckDB to use an S3 Express One bucket, configure the Secrets...as follows: CREATE SECRET ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩', ENDPOINT 's3express-⟨use1-az5⟩.⟨us-east-1⟩.amazonaws.com' ); Instance Location For best performance, ensure... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_express_one.ht...
DuckDB 2.0 Documentation / man.mtool.work