Results of 1 - 10 of about 25 for Network (0.001 sec.)
- Environment 13549
- The environment where DuckDB is run has an obvious impact on performance. This page focuses on the effects of the hardware configuration and the operating system used. Hardware Configuration CPU DuckDB's officially supported architectures a
...B databases have built-in checksums, so integrity checks from the file system are not required to prevent data corruption. Network-Attached Disks Special care needs to be taken when using network-attached disks: If you are writing to disk, it is importa...elated considerations when you are using DuckDB's native database format : Block storage in the cloud. DuckDB runs well on network-backed cloud disks such as AWS EBS for both read-only and read-write workloads. Network-attached storage. Network-attached...B for read-only workloads. However, it is recommended to avoid using DuckDB's native database format in read-write mode on network-attached storage (NAS). These setups include NFS , network drives such as SMB and Samba . Based on user reports, running r... - https://man.mtool.work/duckdb/2.0/guides/performance/environment.html
- inet Extension 12271
- The inet extension defines the INET data type for storing IPv4 and IPv6 Internet addresses. It supports the CIDR notation for subnet masks (e.g., 198.51.100.0/22 , 2001:db8:3c4d::/48 ). Installing and Loading The inet extension will be tran
...6 192.168.0.0 127.0.0.1 127.0.0.1 2001:db8:3c4d:15::1a2f:1a2b/96 2001:db8:3c4d:15::1a2f:1a2b netmask Function Computes the network mask for the address's network. CREATE TABLE tbl (cidr INET); INSERT INTO tbl VALUES ('192.168.1.5/24'), ('127.0.0.1'), ('...92.168.1.5/24 255.255.255.0/24 127.0.0.1 255.255.255.255 2001:db8:3c4d:15::1a2f:1a2b/96 ffff:ffff:ffff:ffff:ffff:ffff::/96 network Function Returns the network part of the address, zeroing out whatever is to the right of the netmask. CREATE TABLE tbl (c...idr INET); INSERT INTO tbl VALUES ('192.168.1.5/24'), ('127.0.0.1'), ('2001:db8:3c4d:15::1a2f:1a2b/96'); SELECT cidr, network(cidr) AS network FROM tbl; cidr network 192.168.1.5/24 192.168.1.0/24 127.0.0.1 127.0.0.1 2001:db8:3c4d:15::1a2f:1a2b/96 2... - https://man.mtool.work/duckdb/2.0/core_extensions/inet.html
- Graph Queries 10992
- DuckDB supports graph queries via the DuckPGQ community extension , which implements the SQL/PGQ syntax from the SQL:2023 standard. Warning DuckPGQ is a community extension and is still under active development. It may not be available for
...uckPGQ website for the latest status. Graph queries allow you to find patterns and paths in connected data, such as social networks, financial transactions, or knowledge graphs, using a visual, intuitive syntax. Installing DuckPGQ INSTALL duckpgq FROM c...'Bob'), (3, 'Charlie'); INSERT INTO Knows VALUES (1, 2, '2020-01-01'), (2, 3, '2021-06-15'); CREATE PROPERTY GRAPH social_network VERTEX TABLES ( Person ) EDGE TABLES ( Knows SOURCE KEY (person1_id) REFERENCES Person (id) DESTINATION KEY (person2_id) R...GRAPH_TABLE function with MATCH to find patterns. The syntax uses () for nodes and [] for edges: FROM GRAPH_TABLE (social_network MATCH (a:Person)-[k:Knows]->(b:Person) COLUMNS (a.name AS person1, b.name AS person2, k.since) ); person1 person2 since Al... - https://man.mtool.work/duckdb/2.0/guides/sql_features/graph_queries.html
- Troubleshooting of Extensions 9182
- You might be visiting this page directed via a DuckDB error message, similar to: INSTALL non_existing; HTTP Error: Failed to download extension "non_existing" at URL "http://extensions.duckdb.org/v2.0.0/osx_arm64/non_existing.duckdb_extensi
...FROM core; or INSTALL ⟨name⟩ FROM community; or INSTALL ⟨name⟩ FROM core_nightly; (see the Installing Extensions page ). * networking issues, so extension exists at the endpoint but it's not reachable from your local DuckDB. Here you can try visiting th..."https://extensions.duckdb.org/..." (HTTP 451) The default extension repository is distributed through a content delivery network that restricts access from certain regions for legal reasons, so the same INSTALL command can succeed from one network and...fail from another. To work around this, you can: Connect from a network in a non-restricted region (for example, through a VPN). Download the extension manually from an allowed location and inst... - https://man.mtool.work/duckdb/2.0/extensions/troubleshooting.html
- Securing DuckDB 9066
- DuckDB is a powerful analytical database engine. It can read and write files, access the network, load extensions, and use system resources. Like any powerful tool, these capabilities require appropriate configuration when working with sens
...apabilities) Use a virtual machine or separate process with minimal privileges Apply operating system-level sandboxing Use network isolation to prevent data exfiltration Implement strict query timeouts at the application level The settings described on...rvice (DoS) attacks: malicious inputs can easily cause DuckDB to consume excessive resources such as memory, disk, CPU, or network. Untrusted Non-SQL Input Warning Even non-SQL input into DuckDB can easily have unintended consequences. When building sec...xpressions. While they don't execute raw SQL strings, they still trigger DuckDB operations that can read files, access the network, and use system resources. Example considerations for non-SQL APIs: File paths: Functions like duckdb.read_csv(path) or du... - https://man.mtool.work/duckdb/2.0/operations_manual/securing_duckdb/overview.htm...
- Troubleshoot 8867
- Overview This page collects common issues encountered when using DuckDB-Wasm, together with their workarounds. If you run into a problem that is not covered here, search the duckdb-wasm issue tracker on GitHub. Network Error When Querying R
...n that hosts the DuckDB-Wasm instance to read it. If the server does not send the required headers, the query fails with a network error such as: Failed to execute 'send' on 'XMLHttpRequest' For example, when querying files from Amazon S3, configure the...directly (see issue #1967 ). Extension Fails to Load from a Custom Repository DuckDB-Wasm fetches each extension over the network when it is loaded. If you serve extensions from a custom repository with SET custom_extension_repository = '⟨https://some.... - https://man.mtool.work/duckdb/2.0/clients/wasm/troubleshoot.html
- Share a DuckDB Database That Only Stores Views 8535
- A DuckDB database file does not have to contain any data: it can store only view definitions that point at remote data such as Parquet files on object storage. The resulting file is only a few hundred kilobytes, yet it behaves like a shared
...referenced datasets are. Hosting the Catalog Upload the catalog.duckdb file to any location that DuckDB can read over the network, for example an s3:// bucket or an https:// endpoint. Querying the Catalog Consumers attach the catalog read-only and quer...ons over HTTPS and the S3 API are read-only , so the catalog cannot be modified in place. Query performance depends on the network and the layout of the referenced files . The tips for querying remote files apply.... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/duckdb_views_only...
- Tuning Workloads 8535
- DuckDB aims to perform well out of the box, so most workloads do not require any tuning. When tuning is worthwhile, there is no single configuration or magic number that is optimal for every workload: the right settings depend on what you a
...query many times with different parameters Prepared statements Prepared statements Reading files over a slow or unreliable network Tuning asynchronous I/O and minimizing IO Querying remote files Running many small queries Reusing a single connection Bes...requests in flight automatically, so there is no need to raise the number of threads. If the defaults do not saturate your network bandwidth, tune the async_threads and read_ahead_depth settings instead. Other formats, such as JSON files and compressed...DuckDB thread can make at most one HTTP request at a time. If a query on such files must make many small requests over the network, increasing DuckDB's threads setting to larger than the total number of CPU cores (approx. 2-5 times CPU cores) can improv... - https://man.mtool.work/duckdb/2.0/guides/performance/how_to_tune_workloads.html
- I/O 8435
- Warning DuckDB ships with safe defaults. The configuration options described on this page are advanced options, so proceed with caution when changing them. Asynchronous I/O New Asynchronous I/O was introduced in DuckDB 2.0. Starting with v2
...used by DuckDB, use the memory_limit setting . Tuning The default settings work well in most cases. On machines with high network bandwidth, you can further increase throughput by fixing the read-ahead depth and adjusting the number of asynchronous thr...eads and the HTTP retry settings. For example, the following configuration saturated a 25 Gbit/s network on a 64-core EC2 instance reading Parquet files from S3: SET read_ahead_depth = 64; SET async_threads = 48; SET http_retri...s the number of threads. Files with only a few very large row groups cannot keep enough requests in flight to saturate the network. New As of DuckDB 2.0, the size of the HTTP client pool can be tuned with the http_client_pool_capacity setting. By defaul... - https://man.mtool.work/duckdb/2.0/data/io.html
- Data Sources 8335
- DuckDB supports several data sources, including file formats, network protocols, and database systems: AWS S3 buckets and storage with S3-compatible API Azure Blob Storage Blob files Cloudflare R2 CSV Delta Lake DuckLake Excel httpfs Iceber
... - https://man.mtool.work/duckdb/2.0/data/data_sources.html
DuckDB 2.0 Documentation / man.mtool.work