Results of 1 - 10 of about 12 for amazonaws (0.001 sec.)
- Catalogs 12965
- The iceberg extension supports attaching Iceberg REST Catalogs. Attaching a catalog is required for writing to Iceberg . Before attaching an Iceberg REST Catalog, you must install the iceberg extension by following the instructions located
...ceberg, ENDPOINT_TYPE s3_tables ); Warning ENDPOINT_TYPE s3_tables always builds an endpoint of the form s3tables.⟨region⟩.amazonaws.com/iceberg . This is incorrect for any region whose endpoint does not use the plain amazonaws.com suffix — most notably t...he AWS China regions ( cn-north-1 , cn-northwest-1 ), which use amazonaws.com.cn . For such regions, attach the catalog by passing an explicit URI (with the correct host for your region) together...ods are supported . Then, connect to the catalog: ATTACH '⟨account_id⟩' AS glue_catalog ( TYPE iceberg, URI 'glue.⟨region⟩.amazonaws.com/iceberg', AUTHORIZATION_TYPE 'sigv4' ); Or alternatively: ATTACH '⟨account_id⟩' AS glue_catalog ( TYPE iceberg, ENDPOI... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/catalogs.html
- Quack on WebAssembly 11249
- CloudFormation Stack We provide an example template for initializing a CloudFormation stack, based on pre-baked public AMI, based on Ubuntu, which will: via DuckDB, install and load Quack, create a randomized token, and do quack_serve on th
....0.0:1294 port to the public EC2 instance IP via HTTPS. The template is reachable at https://duckdb-quack-ami.s3.us-east-1.amazonaws.com/quack.yaml , and is backed by images for (at the moment) eight regions: us-east-1 us-east-2 us-west-1 us-west-2 eu-cen...t https://console.aws.amazon.com/cloudformation/home#/stacks/quickcreate?templateURL=https://duckdb-quack-ami.s3.us-east-1.amazonaws.com/quack.yaml&stackName=my-duckdb-quack-demo Log-in, select a name, possibly an instance class, and click Launch Stack ...., run: aws cloudformation create-stack \ --stack-name my-quack-demo \ --template-url https://duckdb-quack-ami.s3.us-east-1.amazonaws.com/quack.yaml \ --region us-east-2 Wait approx. 2 minutes for the deployment to complete (this command is blocking): aws... - https://man.mtool.work/duckdb/2.0/quack/setup/quack_wasm.html
- Amazon RDS with IAM Authentication 10170
- Managed PostgreSQL databases on Amazon RDS and Aurora can authenticate with short-lived IAM tokens instead of a static password. DuckDB supports this through the postgres and aws extensions: the aws extension generates the token from an AWS
...ential_chain, CHAIN 'env;sso', REGION '⟨eu-west-1⟩', RDS_USER '⟨postgres⟩', RDS_HOST '⟨instance⟩.⟨identifier⟩.⟨region⟩.rds.amazonaws.com', RDS_PORT '5432' ); Then create a secret of type postgres that references it via AWS_RDS_SECRET . Because no password...sed (and refreshed) automatically: CREATE SECRET pg_rds_secret ( TYPE postgres, HOST '⟨instance⟩.⟨identifier⟩.⟨region⟩.rds.amazonaws.com', PORT '5432', USER '⟨postgres⟩', DATABASE '⟨postgres⟩', SSLMODE require, AWS_RDS_SECRET aws_rds_secret ); Connecting... - https://man.mtool.work/duckdb/2.0/guides/database_integration/rds_iam.html
- S3 Express One 9533
- In late 2023, AWS announced the S3 Express One Zone , a high-speed variant of traditional S3 buckets. DuckDB can read S3 Express One buckets using the httpfs extension . Credentials and Configuration The configuration of S3 Express One buck
...th one exception: you must specify the endpoint according to the following pattern: s3express-⟨availability_zone⟩.⟨region⟩.amazonaws.com where the ⟨availability_zone⟩ (e.g., use-az5 ) can be obtained from the S3 Express One bucket's configuration page and...E⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩', ENDPOINT 's3express-⟨use1-az5⟩.⟨us-east-1⟩.amazonaws.com' ); Instance Location For best performance, ensure the EC2 instance is in the same availability zone as the S3 Express... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_express_one.ht...
- PostgreSQL Extension and the Secret Manager 9109
- User credentials and other PostgreSQL database connection details can be stored using the DuckDB Secrets Manager . The following syntax can be used to create a secret: CREATE SECRET ( TYPE postgres, HOST '127.0.0.1', PORT 5432, DATABASE pos
...ing aws CLI. Pass this token as a password connection option: bash export RDSHOST="database-1-instance-1.xxx.eu-west-1.rds.amazonaws.com" psql "host=$RDSHOST port=5432 dbname=postgres user=postgres sslmode=require password=$(aws rds generate-db-auth-token...ain, CHAIN 'env;sso;', REGION 'eu-west-1', RDS_USER 'postgres', RDS_HOST 'database-1-instance-1.xxxxxxxxxxxx.eu-west-1.rds.amazonaws.com', RDS_PORT '5432' ); The secret of type postgres is used to create the remaining of the connection string. It takes th...r as a password : sql CREATE SECRET pg_rds_secret1 ( TYPE postgres, HOST 'database-1-instance-1.xxxxxxxxxxxx.eu-west-1.rds.amazonaws.com', PORT '5432', USER 'postgres', DATABASE 'postgres', SSLMODE require, AWS_RDS_SECRET aws_rds_secret1 ); The secret of... - https://man.mtool.work/duckdb/2.0/core_extensions/postgres/secrets.html
- Troubleshooting 8030
- Curl Request Fails Problem When trying to attach to an Iceberg REST Catalog endpoint, DuckDB returns the following error: IO Error: Curl Request to '/v1/oauth/tokens' failed with error: 'URL using bad/illegal format or missing URL' Solution
...a remote-attached catalog, DuckDB returns the following error: SHOW ALL TABLES; Failed to query https://s3tables.us-east-2.amazonaws.com/iceberg/v1/arn:aws:s3tables:... http error 403 thrown. Message: {"message":"The security token included in the request... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/troubleshooting.html
- S3 Parquet Import 8030
- Prerequisites To load a Parquet file from S3, the httpfs extension is required. This can be installed using the INSTALL SQL command. This only needs to be run once. INSTALL httpfs; To load the httpfs extension for usage, use the LOAD SQL co
...f you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitly via ENDPOINT 's3.⟨your-region⟩.amazonaws.com' . To fetch credentials automatically instead — or to use a named profile, SSO, or an assumed role — see the aws exten... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_import.html
- S3 Parquet Export 7818
- To write a Parquet file to S3, the httpfs extension is required. This can be installed using the INSTALL SQL command. This only needs to be run once. INSTALL httpfs; To load the httpfs extension for usage, use the LOAD SQL command: LOAD htt
...f you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitly via ENDPOINT 's3.⟨your-region⟩.amazonaws.com' . To fetch credentials automatically instead — or to use a named profile, SSO, or an assumed role — see the aws exten... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_export.html
- AWS Extension 7605
- The aws extension adds functionality, e.g., authentication, on top of the httpfs extension's S3 capabilities , using the AWS SDK. Installing and Loading The aws extension will be transparently autoloaded on first use from the official exten
...IN 'web_identity', ASSUME_ROLE_ARN 'arn:aws:iam::⟨account_id⟩:role/⟨role⟩', WEB_IDENTITY_TOKEN_FILE '⟨/var/run/secrets/eks.amazonaws.com/serviceaccount/token⟩' ); Single Sign-On (SSO) DuckDB can use credentials obtained through AWS IAM Identity Center (fo...dential_chain, CHAIN 'env;sso', REGION '⟨eu-west-1⟩', RDS_USER '⟨db_user⟩', RDS_HOST '⟨instance⟩.⟨identifier⟩.⟨region⟩.rds.amazonaws.com', RDS_PORT '5432' ); The rds secret type is registered by the postgres extension , not by aws , so the postgres extens... - https://man.mtool.work/duckdb/2.0/core_extensions/aws.html
- S3 API Support 7393
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...f you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitly via ENDPOINT 's3.⟨your-region⟩.amazonaws.com' . Now, to query using the above secret, simply query any s3:// prefixed file: SELECT * FROM 's3://⟨your-bucket⟩/⟨your...ential_chain providers: Name Description Secret Type Default ENDPOINT Specify a custom S3 endpoint S3 , GCS , R2 STRING s3.amazonaws.com for S3 , KEY_ID The ID of the key to use S3 , GCS , R2 STRING - REGION The region for which to authenticate (should ma... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
DuckDB 2.0 Documentation / man.mtool.work