Results of 1 - 10 of about 48 for http (0.002 sec.)
- HTTP(S) Support 13419
- With the httpfs extension, it is possible to directly query files over the HTTP(S) protocol. This works for all files supported by DuckDB or its various extensions, and provides read-only access. SELECT * FROM 'https://domain.tld/file.exten
...he format. For Parquet files, DuckDB supports partial reading , i.e., it can use a combination of the Parquet metadata and HTTP range requests to only download the parts of the file that are actually required by the query. For example, the following...query will only read the Parquet metadata and the data for the column_a column: SELECT column_a FROM 'https://domain.tld/file.parquet'; In some cases, no actual data needs to be read at all as they only require reading the metada...ta: SELECT count(*) FROM 'https://domain.tld/file.parquet'; DuckDB's own database format supports partial reading just as well as Parquet. Because the fo... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/https.html
- Azure Extension 11269
- The azure extension lets DuckDB read and write files in Azure Blob Storage and Azure Data Lake Storage (ADLS) Gen2. Installing and Loading The azure extension will be transparently autoloaded on first use from the official extension reposit
...ows.net/⟨my_container⟩/⟨path⟩/*.csv'; Azure Data Lake Storage (ADLS) Allowed URI schemes: abfss or abfs (both connect over HTTPS) SELECT count(*) FROM 'abfss://⟨my_filesystem⟩/⟨path⟩/⟨my_file⟩.⟨parquet_or_csv⟩'; Globs are also supported: SELECT * FRO...wing configuration options to control how the extension reads and writes remote files: Name Description Type Default azure_http_stats Include HTTP info from Azure Storage in the EXPLAIN ANALYZE statement . BOOLEAN false azure_http_logging Write Azure...HTTP requests to the DuckDB HTTP log when it is enabled. See Logging . BOOLEAN true azure_http_logging_redact_query_params Semi... - https://man.mtool.work/duckdb/2.0/core_extensions/azure.html
- Configuration 10799
- DuckDB has a number of configuration options that can be used to change the behavior of the system. The configuration options can be set using either the SET statement or the PRAGMA statement . They can be reset to their original values usi
...tings control the size of the asynchronous thread pool and the read-ahead budget used when reading from object storage and HTTP servers. They are listed in the reference below and documented in more detail on the I/O page , together with the related...d Peak allocation threshold at which to flush the allocator after completing a task. VARCHAR 134217728B allow_asterisks_in_http_paths Allow '*' character in URLs users can query BOOLEAN false allow_community_extensions Allow loading extensions build...ARD_POLICY custom_extension_repository Overrides the custom endpoint for extension installation. VARCHAR custom_user_agent HTTP request metadata that can be set by callers/wrappers to tag their own traffic when DuckDB makes a request. VARCHAR default... - https://man.mtool.work/duckdb/2.0/configuration/overview.html
- Logging 10239
- DuckDB implements a logging mechanism that provides users with detailed information about events such as query execution, performance metrics and system events. Warning Logs may contain sensitive information, including secrets and credentia
...ration Support for structured logging Logging-Specific Types To log only messages of a specific type: CALL enable_logging('HTTP'); The above function will automatically set the correct log level and will add the HTTP type to the enabled_log_types set...tings. This ensures only log messages of the HTTP type will be written to the log. New As of DuckDB 2.0, the dedicated enable_http_logging and http_logging_output settings...have been removed. Use the unified logging framework shown here ( CALL enable_logging('HTTP') together with duckdb_logs_parsed('HTTP') ) instead. The redact_http_logs setting (default true ) controls whether HTTP h... - https://man.mtool.work/duckdb/2.0/operations_manual/logging/overview.html
- Troubleshooting of Extensions 9602
- You might be visiting this page directed via a DuckDB error message, similar to: INSTALL non_existing; HTTP Error: Failed to download extension "non_existing" at URL "http://extensions.duckdb.org/v2.0.0/osx_arm64/non_existing.duckdb_extensi
...on.gz" (HTTP 404) Candidate extensions: "inet", "encodings", "core_functions", "vortex", "odbc_scanner" For more info, visit https://du...not be available anymore on the default extension repository. When in doubt, consider raising an issue in duckdb/duckdb . HTTP 451 Errors An HTTP 451 (“Unavailable For Legal Reasons”) error when installing an extension means that the extension repos...itory is not served to your location: HTTP Error: Failed to download extension "..." at URL "https://extensions.duckdb.org/..." (HTTP 451) The default extension repo... - https://man.mtool.work/duckdb/2.0/extensions/troubleshooting.html
- Backup Extension Repositories 9057
- The core and community extension repositories have backup servers (see duckdb-backup.org ): Repository Primary server Backup server core http://extensions.duckdb.org http://extensions.duckdb-backup.org community http://community-extensions.
...duckdb.org http://community-extensions.duckdb-backup.org The backup servers serve byte-identical binaries, so signature checks are unaffec...e Backup Server Manually To always install core extensions from the backup server, run: SET custom_extension_repository = 'http://extensions.duckdb-backup.org';... - https://man.mtool.work/duckdb/2.0/operations_manual/backup_extension_repositorie...
- Quack Remote Protocol 9012
- The Quack extension turns a DuckDB instance into a server that other DuckDB instances (clients) can connect to over HTTP. This page covers the protocol at a glance and walks through basic usage on both sides of the wire. For the full list o
...ity . For user guides, see Guides . Quack in a Nutshell In short, the Quack protocol and its interactions work as follows: HTTP-based. Quack messages travel over plain HTTP or HTTPS via a reverse proxy (see Security ). This means standard load balanc...ers, firewalls, and reverse proxies handle Quack traffic the same way they handle any other HTTP service. There is no custom wire transport to operate. Client-driven request and response. Every interaction is initiated...nt is optional: calling quack_serve() without it also listens on quack:localhost . quack_serve returns the listen URI, the HTTP URL, and, when the default authentication function is in use, the auth_token that clients need to connect. To choose the t... - https://man.mtool.work/duckdb/2.0/quack/overview.html
- Installing Extensions 8921
- To install core DuckDB extensions, use the INSTALL command. For example: INSTALL httpfs; This installs the extension from the default repository ( core ). Extension Repositories By default, DuckDB extensions are installed from a single repo
...tability and security of the core set of extensions. These extensions live in the default core repository, which points to http://extensions.duckdb.org . Besides the core repository, DuckDB also supports installing extensions from other repositories....Installing Extensions from Different Repositories To install extensions from the default repository ( core ), run: INSTALL httpfs; To explicitly install an extension from the core repository, run: INSTALL httpfs FROM core; -- or INSTALL httpfs FROM '...; To install an extension from the core nightly repository: INSTALL spatial FROM core_nightly; -- or INSTALL spatial FROM 'http://nightly-extensions.duckdb.org'; To install an extension from a custom repository: INSTALL ⟨custom_extension⟩ FROM 'https... - https://man.mtool.work/duckdb/2.0/extensions/installing_extensions.html
- I/O 8754
- Warning DuckDB ships with safe defaults. The configuration options described on this page are advanced options, so proceed with caution when changing them. Asynchronous I/O New Asynchronous I/O was introduced in DuckDB 2.0. Starting with v2
...us pool contains threads dedicated to blocking I/O. As these threads spend most of their time waiting for responses (e.g., HTTP requests), there are more of them than CPU cores: by default, four times the number of system threads, capped at 256. Its...ou can further increase throughput by fixing the read-ahead depth and adjusting the number of asynchronous threads and the HTTP retry settings. For example, the following configuration saturated a 25 Gbit/s network on a 64-core EC2 instance reading P...arquet files from S3: SET read_ahead_depth = 64; SET async_threads = 48; SET http_retries = 8; SET http_retry_wait_ms = 50; SET http_retry_backoff = 2; As the row group is the unit of parallelism for Parq... - https://man.mtool.work/duckdb/2.0/data/io.html
- Reference 8754
- This page lists the functions, settings, and log types exposed by the quack extension . For a tour of the protocol, start with the Overview . Function Reference Server Management Function Description quack_serve(⟨listen_uri⟩, ...) Start a s
...tent default quack secret, so that subsequent servers reuse it. disable_ssl BOOLEAN true for local, else false Serve plain HTTP. Local URIs default to plain HTTP, other URIs to HTTPS. ssl_cert_file VARCHAR (generated) Certificate file used when servi...on the client side. DISABLE_SSL BOOLEAN true for local, else false Force the client transport. Local URIs default to plain HTTP. TYPE VARCHAR inferred Pin the secret type used for token resolution (e.g., quack ). SSL_FINGERPRINT VARCHAR (unset) Expec...ion_ms response_type error 60 CONNECTION 2 18 18 NULL 2026-05-10 09:06:19.841623+02 Quack DEBUG CONNECTION_REQUEST 18 NULL http://localhost:9494 41 CONNECTION_RESPONSE NULL 60 CONNECTION 2 18 18 NULL 2026-05-10 09:06:19.842407+02 Quack DEBUG PREPARE_... - https://man.mtool.work/duckdb/2.0/quack/reference.html
DuckDB 2.0 Documentation / man.mtool.work