Results of 1 - 10 of about 34 for consider (0.001 sec.)
- Troubleshooting of Extensions 13485
- You might be visiting this page directed via a DuckDB error message, similar to: INSTALL non_existing; HTTP Error: Failed to download extension "non_existing" at URL "http://extensions.duckdb.org/v2.0.0/osx_arm64/non_existing.duckdb_extensi
...at a given time: * the extension has not been uploaded yet, here some delay after a given release date might be expected. Consider checking the issues at duckdb/duckdb or duckdb/community-extensions , or creating one yourself. * the extension is availab...not starting with a v , then extensions might not be available anymore on the default extension repository. When in doubt, consider raising an issue in duckdb/duckdb . HTTP 451 Errors An HTTP 451 (“Unavailable For Legal Reasons”) error when installing an...such as a self-hosted mirror. Manual Process to Download Extensions via the Browser To check if an extension is available, consider trying to download the relevant extension resource, for example via your browser visiting https://extensions.duckdb.org/v2... - https://man.mtool.work/duckdb/2.0/extensions/troubleshooting.html
- Environment 11935
- The environment where DuckDB is run has an obvious impact on performance. This page focuses on the effects of the hardware configuration and the operating system used. Hardware Configuration CPU DuckDB's officially supported architectures a
...r example, if you use 8 threads, you need at least 1 GB of memory. If you are working in a memory-constrained environment, consider limiting the number of threads , e.g., by issuing: SET threads = 4; Memory for Ideal Performance The amount of memory requ...isks, preferably SSD or NVMe with a fast connection. With these in mind, here are two common architectures and the related considerations when you are using DuckDB's native database format : Block storage in the cloud. DuckDB runs well on network-backed...as spurious errors caused by the underlying file system. Instead of using DuckDB's native database format in this setting, consider using the DuckLake lakehouse format . DuckLake keeps the data in immutable Parquet files on object storage and the transac... - https://man.mtool.work/duckdb/2.0/guides/performance/environment.html
- Combining Schemas 10385
- Examples Read a set of CSV files combining columns by position: SELECT * FROM read_csv('flights*.csv'); Read a set of CSV files combining columns by name: SELECT * FROM read_csv('flights*.csv', union_by_name = true); Combining Schemas When
...n By default, DuckDB uses the schema of the first file and reads the columns of the subsequent files into it. For example, consider the following two files. flights1.csv : FlightDate|UniqueCarrier|OriginCityName|DestCityName 1988-01-01|AA|New York, NY|Lo...unify the columns of different files by name instead. This can be done by providing the union_by_name option. For example, consider the following two files, where flights4.csv has an extra column ( UniqueCarrier ). flights3.csv : FlightDate|OriginCityNam... - https://man.mtool.work/duckdb/2.0/data/multiple_files/combining_schemas.html
- Internal Errors 9458
- Internal errors signal an assertion failure within DuckDB. They usually occur due to unexpected conditions or errors in the program's logic. For example, running issue 17002 on DuckDB 1.2.1 results in an internal error. INTERNAL Error: Atte
...e by definition bugs that should never happen so the code path is never tested. If you encounter an internal error, please consider creating a minimal reproducible example and submitting an issue to the DuckDB issue tracker .... - https://man.mtool.work/duckdb/2.0/dev/internal_errors.html
- Crashes 9458
- DuckDB is thoroughly tested via an extensive test suite. However, bugs can still occur and these can sometimes lead to crashes. This page contains practical information on how to troubleshoot DuckDB crashes. Types of Crashes There are a few
...erstanding of what is causing the issue and potentially also a workaround that you can use right away. In any case, please consider submitting an issue with your findings. Submitting an Issue If you found a crash in DuckDB, please consider submitting an... - https://man.mtool.work/duckdb/2.0/guides/troubleshooting/crashes.html
- Execution Format 9458
- Vector is the container format used to store in-memory data during execution. DataChunk is a collection of Vectors, used for instance to represent a column list in a PhysicalProjection operator. Data Flow DuckDB uses a vectorized query exec
...ectors can be stored recursively. For nested list vectors, the child of a list vector is again a list vector. For example, consider this mock representation of a Vector of type BIGINT[][] : { "type": "list", "data": "list_entry_t", "child": { "type": "li...rs, array vectors can be nested: the child of an array vector can itself be an array vector or a list vector. For example, consider this mock representation of a Vector of type INTEGER[3] : { "type": "array", "array_size": 3, "child": { "type": "integer"... - https://man.mtool.work/duckdb/2.0/internals/vector.html
- Data Import 9155
- Recommended Import Methods When importing data from other systems to DuckDB, there are several considerations to take into account. We recommend importing using the following order: For systems which are supported by a DuckDB scanner extens
...to Parquet or CSV format, then load it using DuckDB's Parquet or CSV loader . If the approaches above are not applicable, consider using the DuckDB appender , currently available in the C, C++, Go, Java, Julia, Node.js, Python and Rust APIs. Methods to... - https://man.mtool.work/duckdb/2.0/guides/performance/import.html
- Working with Huge Databases 9155
- This page contains information for working with huge DuckDB database files. While most DuckDB databases are well below 1 TB, in our 2024 user survey , 1% of respondents used DuckDB files of 2 TB or more (corresponding to roughly 10 TB of CS
...when working with large files. On Linux, DuckDB performs best with XFS on large files. For storing large amounts of data, consider using the DuckLake lakehouse format . Because DuckLake spreads the data across many immutable Parquet files instead of a s... - https://man.mtool.work/duckdb/2.0/guides/performance/working_with_huge_databases...
- Out-of-Memory Issues 8531
- Configuration Options If you are experiencing out-of-memory issues with DuckDB, try tweaking the following configuration options: Reduce the number of threads using the SET threads = ... command. Setting the memory limit lower than the defa
...they are currently not buffer-managed . Avoid using indexes if possible. If your workload requires indexing large tables, consider reducing the memory limit to accommodate this.... - https://man.mtool.work/duckdb/2.0/guides/performance/oom.html
- Boolean Type 8531
- Name Aliases Description BOOLEAN BOOL Logical Boolean ( true / false ) The BOOLEAN type represents a statement of truth (“true” or “false”). In SQL, the BOOLEAN field can also have a third state “unknown” which is represented by the SQL NUL
...valuates to true will pass the filter, and tuples for which the predicate evaluates to false or NULL will be filtered out. Consider the following example: Create a table with the values 5, 15 and NULL : CREATE TABLE integers (i INTEGER); INSERT INTO inte... - https://man.mtool.work/duckdb/2.0/sql/data_types/boolean.html
DuckDB 2.0 Documentation / man.mtool.work