Results of 1 - 10 of about 21 for requests (0.002 sec.)
- Azure Extension 12346
- The azure extension lets DuckDB read and write files in Azure Blob Storage and Azure Data Lake Storage (ADLS) Gen2. Installing and Loading The azure extension will be transparently autoloaded on first use from the official extension reposit
...Include HTTP info from Azure Storage in the EXPLAIN ANALYZE statement . BOOLEAN false azure_http_logging Write Azure HTTP requests to the DuckDB HTTP log when it is enabled. See Logging . BOOLEAN true azure_http_logging_redact_query_params Semicolon-sep...ct_headers Semicolon-separated list of header names (case-insensitive) whose values are redacted in the HTTP log, for both requests and responses. VARCHAR Authorization azure_read_transfer_concurrency Maximum number of threads the Azure client can use fo...r a single parallel read. Values above 1 let the client fill one buffer with parallel requests, when the chunk size is smaller than the buffer. INTEGER 5 azure_read_transfer_chunk_size Maximum size in bytes that the A... - https://man.mtool.work/duckdb/2.0/core_extensions/azure.html
- Troubleshoot 11788
- Overview This page collects common issues encountered when using DuckDB-Wasm, together with their workarounds. If you run into a problem that is not covered here, search the duckdb-wasm issue tracker on GitHub. Network Error When Querying R
...'XMLHttpRequest' For example, when querying files from Amazon S3, configure the bucket's CORS policy to allow GET and HEAD requests: [ { "AllowedHeaders": ["*"], "AllowedMethods": ["GET", "HEAD"], "AllowedOrigins": ["*"], "ExposeHeaders": [], "MaxAgeSeco...tp//… ), which breaks reads against local or non-TLS endpoints (see duckdb-wasm issue #2118 ). DuckDB relies on HTTP range requests to read only part of a file. Range requests can fail on Firefox (see issue #1932 ) and are not detected correctly for some...If you serve extensions from a custom repository with SET custom_extension_repository = '⟨https://some.url.com⟩' , the GET requests for the extension files must be CORS enabled for the browser to allow the connection, exactly as for remote data files abo... - https://man.mtool.work/duckdb/2.0/clients/wasm/troubleshoot.html
- HTTP(S) Support 10469
- With the httpfs extension, it is possible to directly query files over the HTTP(S) protocol. This works for all files supported by DuckDB or its various extensions, and provides read-only access. SELECT * FROM 'https://domain.tld/file.exten
...For Parquet files, DuckDB supports partial reading , i.e., it can use a combination of the Parquet metadata and HTTP range requests to only download the parts of the file that are actually required by the query. For example, the following query will only...l as Parquet. Because the format is block-based and stores per-column and per-row-group statistics, DuckDB uses HTTP range requests to fetch only the blocks required by a query when a remote database file is attached read-only: ATTACH 'https://domain.tld...certificate_file⟩'; SET enable_server_cert_verification = true; If you would like to disable SSL verification for all HTTP requests using an HTTP secret you can do so with the following statement: CREATE SECRET disable_ssl ( TYPE HTTP, VERIFY_SSL 0 ); To... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/https.html
- Tigris Import 10283
- Prerequisites For Tigris , the S3-compatible API allows you to use DuckDB's S3 support to read and write from Tigris buckets. This requires the httpfs extension , which can be installed using the INSTALL SQL command. This only needs to be r
...xx⟩', REGION 'auto', ENDPOINT 'fly.storage.tigris.dev' ); A single endpoint ( fly.storage.tigris.dev ) serves all regions; requests are routed to the Tigris region nearest the caller. REGION is required for request signing but is not used for routing — s.... Tigris uses virtual-hosted-style URLs, which is DuckDB's default for TYPE s3 . Tip When DuckDB runs on a Fly.io Machine, requests to fly.storage.tigris.dev stay on Fly's internal network and are served from the same region as the Machine when possible.... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/tigris_import.htm...
- Iceberg Options 10097
- This page lists the options of the iceberg extension: the parameters accepted by the Iceberg functions , the options of the ATTACH and CREATE SECRET statements used to connect to a catalog , and the global settings. ATTACH Options To make a
...-encode the entire path prefix when communicating with the catalog. MAX_TABLE_STALENESS INTERVAL NULL Prevents unnecessary requests to the Iceberg REST Catalog. Accepts human-readable interval strings such as 10 minutes , 30 seconds , or 1 year . EXTRA_H...TTP_HEADERS MAP(VARCHAR, VARCHAR) NULL Extra headers (key-value) sent along with the requests to the REST Catalog. DEFAULT_TABLE_LOCATION_FROM_NAMESPACE BOOLEAN false If enabled, a CREATE TABLE without an explicit WI...ESPACE_SEPARATOR VARCHAR 0x1F Separator used to join the levels of a nested namespace into a single path component in REST requests. It is URL-decoded before use and cannot be empty. Defaults to the ASCII unit separator ( 0x1F ). USE_METADATA_LOCATION BO... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/iceberg_options.html
- I/O 9336
- Warning DuckDB ships with safe defaults. The configuration options described on this page are advanced options, so proceed with caution when changing them. Asynchronous I/O New Asynchronous I/O was introduced in DuckDB 2.0. Starting with v2
...Instead of blocking a worker thread until requested data arrives, DuckDB issues reads in the background and keeps multiple requests in flight while worker threads process data that has already arrived. This can significantly speed up queries when synchro...ol contains threads dedicated to blocking I/O. As these threads spend most of their time waiting for responses (e.g., HTTP requests), there are more of them than CPU cores: by default, four times the number of system threads, capped at 256. Its size is c...have at least as many row groups as the number of threads. Files with only a few very large row groups cannot keep enough requests in flight to saturate the network. New As of DuckDB 2.0, the size of the HTTP client pool can be tuned with the http_clien... - https://man.mtool.work/duckdb/2.0/data/io.html
- Overview 8778
- How is DuckDB Tested? Testing is vital to make sure that DuckDB works properly and keeps working properly. For that reason, we put a large emphasis on thorough and frequent testing: * We run a batch of small tests on every commit using GitH
...ub Actions , and run a more exhaustive batch of tests on pull requests and commits in the main branch. * We use a fuzzer , which automatically reports issues found through fuzzing DuckDB. * We... - https://man.mtool.work/duckdb/2.0/dev/sqllogictest/overview.html
- Quack Remote Protocol 8778
- The Quack extension turns a DuckDB instance into a server that other DuckDB instances (clients) can connect to over HTTP. This page covers the protocol at a glance and walks through basic usage on both sides of the wire. For the full list o
...ction is initiated by the client. The server does not initiate interactions via pushing. application/duckdb serialization. Requests and responses are encoded with DuckDB's internal serialization primitives (the same code path used by the Write-Ahead Log...onnection handshake, a query needs only one request–response pair. Large results stream back in chunks via follow-up FETCH requests, optionally parallelized on multiple threads. Default port: 9494 . All URIs use the quack: scheme, e.g., quack:hostname:po...'quack:localhost' AS remote_db ( TOKEN '⟨MY_QUACK_TOKEN_01234567890ABCDEF⟩' ); HTTP Connection Caching Quack clients send requests through the httpfs HTTP client, which caches connections by default ( httpfs_connection_caching = true ). Reusing connecti... - https://man.mtool.work/duckdb/2.0/quack/overview.html
- Tuning Workloads 8592
- DuckDB aims to perform well out of the box, so most workloads do not require any tuning. When tuning is worthwhile, there is no single configuration or magic number that is optimal for every workload: the right settings depend on what you a
...s when Parquet and CSV files are read through data lake formats such as DuckLake. For these formats, DuckDB keeps multiple requests in flight automatically, so there is no need to raise the number of threads. If the defaults do not saturate your network...hronous I/O: each DuckDB thread can make at most one HTTP request at a time. If a query on such files must make many small requests over the network, increasing DuckDB's threads setting to larger than the total number of CPU cores (approx. 2-5 times CPU.... To inspect how much remote data is transferred for a query, EXPLAIN ANALYZE can be used to print out the total number of requests and total data transferred for queries on remote files. Caching Starting with version 1.3.0, DuckDB supports caching remot... - https://man.mtool.work/duckdb/2.0/guides/performance/how_to_tune_workloads.html
- Reference 8405
- This page lists the functions, settings, and log types exposed by the quack extension . For a tour of the protocol, start with the Overview . Function Reference Server Management Function Description quack_serve(⟨listen_uri⟩, ...) Start a s
...to FETCH . Drains whole batches, so it may overshoot to a batch boundary. quack_fetch_read_ahead UBIGINT 0 Number of FETCH requests the client keeps in flight ahead of the scan. 0 uses the number of async threads. quack_rebalance_buffer_bytes UBIGINT 0 P...e_type Request type: PREPARE_REQUEST , FETCH_REQUEST , etc. quack_connection_id Server-issued connection id (stable across requests in one ATTACH ). client_query_id Monotonic id assigned by the client, correlates client / server logs. query SQL payload f...or PREPARE_REQUEST s. server HTTP URL on client-side logs, NULL on server-side logs. duration_ms Round-trip time (client) or handling time (se... - https://man.mtool.work/duckdb/2.0/quack/reference.html
DuckDB 2.0 Documentation / man.mtool.work