Results of 1 - 10 of about 10 for bPxRfiCYEXAMPLEKEY (0.001 sec.)
- S3 Parquet Export 13622
- To write a Parquet file to S3, the httpfs extension is required. This can be installed using the INSTALL SQL command. This only needs to be run once. INSTALL httpfs; To load the httpfs extension for usage, use the LOAD SQL command: LOAD htt
...of the bucket you want to access. CREATE SECRET ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩' ); Tip If you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitl...vide the credentials as follows: CREATE SECRET ( TYPE gcs, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩' ); After setting up the GCS credentials, you can export using: COPY ⟨table_name⟩ TO 'gs://⟨gcs_bucket⟩/⟨filename⟩.parque... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_export.html
- Cloudflare R2 Import 9671
- Prerequisites For Cloudflare R2, the S3 Compatibility API allows you to use DuckDB's S3 support to read and write from R2 buckets. This requires the httpfs extension , which can be installed using the INSTALL SQL command. This only needs to
...nd create an R2 secret in DuckDB: CREATE SECRET ( TYPE r2, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', ACCOUNT_ID '⟨your-32-character-hexadecimal-account-ID⟩' ); Querying After setting up the R2 credentials, you can query... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/cloudflare_r2_imp...
- Google Cloud Storage Import 9671
- Prerequisites The Google Cloud Storage (GCS) can be used via the httpfs extension . This can be installed with the INSTALL httpfs SQL command. This only needs to be run once. Credentials and Configuration You need to create HMAC keys and de
...clare them: CREATE SECRET ( TYPE gcs, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩' ); Querying After setting up the GCS credentials, you can query the GCS data using: SELECT * FROM read_parquet('gs://⟨gc... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/gcs_import.html
- Troubleshooting 8795
- Curl Request Fails Problem When trying to attach to an Iceberg REST Catalog endpoint, DuckDB returns the following error: IO Error: Curl Request to '/v1/oauth/tokens' failed with error: 'URL using bad/illegal format or missing URL' Solution
...ually using the following secret: CREATE SECRET ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩' );... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/troubleshooting.html
- Fastly Object Storage Import 8795
- Prerequisites For Fastly Object Storage, the S3 Compatibility API allows you to use DuckDB's S3 support to read and write from Fastly buckets. This requires the httpfs extension , which can be installed using the INSTALL SQL command. This o
...an S3 secret in DuckDB: CREATE SECRET my_secret ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', URL_STYLE 'path', REGION '⟨us-east⟩', ENDPOINT '⟨us-east⟩.object.fastlystorage.app' -- see note below ); The ENDPOINT n... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/fastly_object_sto...
- S3 Parquet Import 8795
- Prerequisites To load a Parquet file from S3, the httpfs extension is required. This can be installed using the INSTALL SQL command. This only needs to be run once. INSTALL httpfs; To load the httpfs extension for usage, use the LOAD SQL co
...tials and S3 region to read data: CREATE SECRET ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩' ); Tip If you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitl... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_import.html
- S3 Iceberg Import 7919
- Prerequisites Loading an Iceberg file from S3 requires both the httpfs and iceberg extensions. Install them using the INSTALL SQL command. You only need to install extensions once. INSTALL httpfs; INSTALL iceberg; To load the extensions, us
...ccess key and secret, or a token. CREATE SECRET ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩' ); To fetch credentials automatically instead — or to use a named profile, SSO, or an assumed role... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_iceberg_import...
- S3 API Support 7490
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...REATE OR REPLACE SECRET secret ( TYPE s3, PROVIDER config, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩' ); Tip If you get an IO Error ( Connection error for HTTP HEAD ), configure the endpoint explicitl...a bit simpler: CREATE OR REPLACE SECRET secret ( TYPE r2, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', ACCOUNT_ID '⟨my_account_id⟩' ); Note the addition of the ACCOUNT_ID which is used to generate the correct endpoint URL... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- S3 Express One 7490
- In late 2023, AWS announced the S3 Express One Zone , a high-speed variant of traditional S3 buckets. DuckDB can read S3 Express One buckets using the httpfs extension . Credentials and Configuration The configuration of S3 Express One buck
...e the Secrets manager as follows: CREATE SECRET ( TYPE s3, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩', ENDPOINT 's3express-⟨use1-az5⟩.⟨us-east-1⟩.amazonaws.com' ); Instance Location For best performan... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_express_one.ht...
- S3 and AWS Authentication 7043
- This page is the entry point for authenticating to S3 and other AWS services from DuckDB. Authentication is configured using secrets , and the detailed reference material lives on the S3 API Support and AWS Extension pages. The sections bel
...REATE OR REPLACE SECRET secret ( TYPE s3, PROVIDER config, KEY_ID '⟨AKIAIOSFODNN7EXAMPLE⟩', SECRET '⟨wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY⟩', REGION '⟨us-east-1⟩' ); See the config provider documentation for the full details, including how to set an explicit EN... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/authentication.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work