Results of 1 - 10 of about 94 for size (0.003 sec.)
- Array Functions 12248
- All LIST functions work with the ARRAY data type . Additionally, several ARRAY -native functions are also supported. Array-Native Functions Function Description array_cosine_distance(array1, array2) Computes the cosine distance between two
...arrays of the same size. The array elements cannot be NULL . The arrays can have any size as long as the size is the same for both arguments. arra...y_cosine_similarity(array1, array2) Computes the cosine similarity between two arrays of the same size. The array elements cannot be NULL . The arrays can have any size as long as the size is the same for both arguments. arra...y_cross_product(array, array) Computes the cross product of two arrays of size 3. The array elements cannot be NULL . array_distance(array1, array2) Computes the distance between two arrays of the same... - https://man.mtool.work/duckdb/2.0/sql/functions/array.html
- Limits 10004
- This page contains DuckDB's built-in limit values. To check the value of a setting on your system, use the current_setting function. Limit Values Limit Default value Configuration option Comment Array size 100000 - BLOB size 4 GB - Expressi
...ation for a vector 128 GB - Memory use 80% of RAM memory_limit Note: This limit only applies to the buffer manager. String size 4 GB - Temporary directory size 90% of available disk space max_temp_directory_size Size of Database Files DuckDB doesn't...have a practical limit for the size of a single DuckDB database file. We have database files using 15 TB+ of disk space and they work fine. However, connectin... - https://man.mtool.work/duckdb/2.0/operations_manual/limits.html
- Data Chunks 9872
- Data chunks represent a horizontal slice of a table. They hold a number of vectors , that can each hold up to the VECTOR_SIZE rows. The vector size can be obtained through the duckdb_vector_size function and is configurable, but is usually
...unk ); duckdb_vector duckdb_data_chunk_get_vector ( duckdb_data_chunk chunk , idx_t col_idx ); idx_t duckdb_data_chunk_get_size ( duckdb_data_chunk chunk ); void duckdb_data_chunk_set_size ( duckdb_data_chunk chunk , idx_t size ); duckdb_create_data_...nk , idx_t col_idx ); Parameters chunk : The data chunk to get the data from Return Value The vector duckdb_data_chunk_get_size Retrieves the current number of tuples in a data chunk. Syntax idx_t duckdb_data_chunk_get_size ( duckdb_data_chunk chunk...ters chunk : The data chunk to get the data from Return Value The number of tuples in the data chunk duckdb_data_chunk_set_size Sets the current number of tuples in a data chunk. Syntax void duckdb_data_chunk_set_size ( duckdb_data_chunk chunk , idx_... - https://man.mtool.work/duckdb/2.0/clients/c/data_chunk.html
- Vectors 9780
- Vectors represent a horizontal slice of a column. They hold a number of values of a specific type, similar to an array. Vectors are the core data representation used in DuckDB. Vectors are typically stored within data chunks . The vector an
...lumn_type . The type id of the logical type can then be obtained using duckdb_get_type_id . Vectors themselves do not have sizes. Instead, the parent data chunk has a size (that can be obtained through duckdb_data_chunk_get_size ). All vectors that b...elong to a data chunk have the same size. Primitive Types For primitive types, the underlying array can be obtained using the duckdb_vector_get_data method. The ar...propriate power-of-ten. Enums Enums are stored as unsigned integer values internally. The exact native type depends on the size of the enum dictionary, as shown in the following table: Dictionary size NativeType <= 255 uint8_t <= 65535 uint16_t <= 42... - https://man.mtool.work/duckdb/2.0/clients/c/vector.html
- Configuration 9780
- DuckDB has a number of configuration options that can be used to change the behavior of the system. The configuration options can be set using either the SET statement or the PRAGMA statement . They can be reset to their original values usi
...with the settings that tune it, was introduced in DuckDB 2.0. The async_threads and read_ahead_depth settings control the size of the asynchronous thread pool and the read-ahead budget used when reading from object storage and HTTP servers. They are...er of tables in a join to determine the optimal join order approximately instead of exactly. UBIGINT 12 arrow_large_buffer_size Whether Arrow buffers for strings, blobs, UUIDs and bits should be exported using large buffers. BOOLEAN false arrow_lossl...he system for tasks like I/O. BIGINT 4 × # CPU cores (max. 256) auto_checkpoint_skip_wal_threshold The estimated WAL write size at which point we will skip writing to the WAL and only checkpoint. Skipping writing to the WAL means concurrent commits a... - https://man.mtool.work/duckdb/2.0/configuration/overview.html
- Complete API 9146
- This page contains the reference for DuckDB's C API. The reference contains several deprecation notices. These concern methods whose long-term availability is not guaranteed as they may be removed in the future. That said, DuckDB's develope
...n , const char * query , bool qualified ); Configuration duckdb_state duckdb_create_config ( duckdb_config * out_config ); size_t duckdb_config_count (); duckdb_state duckdb_get_config_flag ( size_t index , const char ** out_name , const char ** out_...idx_t row ); bool duckdb_value_is_null ( duckdb_result * result , idx_t col , idx_t row ); Helpers void * duckdb_malloc ( size_t size ); void duckdb_free ( void * ptr ); idx_t duckdb_vector_size (); bool duckdb_string_is_inlined ( duckdb_string_t st...duckdb_create_union_value ( duckdb_logical_type union_type , idx_t tag_index , duckdb_value value ); idx_t duckdb_get_map_size ( duckdb_value value ); duckdb_value duckdb_get_map_key ( duckdb_value value , idx_t index ); duckdb_value duckdb_get_map_... - https://man.mtool.work/duckdb/2.0/clients/c/api.html
- Directly Reading Files 9146
- DuckDB allows directly reading files via the read_text and read_blob functions. These functions accept a filename, a list of filenames, or a glob pattern. They output the content of each file as a VARCHAR or BLOB , respectively, along with
...metadata such as the file size and last modified time. read_text The read_text table function reads from the selected source(s) to a VARCHAR . Each file...results in a single row with the content field holding the entire content of the respective file. SELECT size, parse_path(filename), content FROM read_text('test/sql/table_function/files/*.txt'); size parse_path(filename) content 12...gesting to use read_blob instead. read_text also supports reading from pipes (e.g., /dev/stdin ). The maximum allowed file size for read_text is 3.9 GiB. read_blob The read_blob table function reads from the selected source(s) to a BLOB : SELECT size... - https://man.mtool.work/duckdb/2.0/guides/file_formats/read_file.html
- COPY Statement 8909
- Examples Read a CSV file into the lineitem table, using auto-detected CSV options: COPY lineitem FROM 'lineitem.csv'; Read a CSV file into the lineitem table, using manually specified CSV options: COPY lineitem FROM 'lineitem.csv' (DELIMITE
...tatement: COPY (SELECT l_orderkey, l_comment FROM lineitem) TO 'lineitem_part.parquet' (RETURN_STATS); filename count file_size_bytes footer_size_bytes column_statistics partition_keys lineitem_part.parquet 600572 8579141 1445 {'"l_comment"'={column_...size_bytes=7642227, max=zzle. slyly, min=' Tiresias above the blit', null_count=0}, '"l_orderkey"'={column_size_bytes=935457, max=600000, min=1, null_count=0}} NULL Note: for nested columns (e.g., structs) the column statistics are de...ist. Only has an effect when used with options that write multiple files, such as PARTITION_BY , PER_THREAD_OUTPUT or FILE_SIZE_BYTES . BOOL false OVERWRITE When true , all existing files inside targeted directories will be removed (not supported on... - https://man.mtool.work/duckdb/2.0/sql/statements/copy.html
- Parquet Tips 8724
- Below is a collection of tips to help when dealing with Parquet files. Tips for Reading Parquet Files Use union_by_name When Loading Files with Different Schemas The union_by_name option can be used to unify the schema of files that have di
...ance: COPY (FROM generate_series(10_000_000)) TO 'test.parquet' (FORMAT parquet, PER_THREAD_OUTPUT); Selecting a ROW_GROUP_SIZE The ROW_GROUP_SIZE parameter specifies the minimum number of rows in a Parquet row group, with a minimum value equal to Du...ckDB's vector size, 2,048, and a default of 122,880. A Parquet row group is a partition of rows, consisting of a column chunk for each column...in the dataset. Compression algorithms are only applied per row group, so the larger the row group size, the more opportunities to compress the data. On the other hand, larger row group sizes mean that each thread keeps more d... - https://man.mtool.work/duckdb/2.0/data/parquet/tips.html
- Execution Format 8460
- Vector is the container format used to store in-memory data during execution. DataChunk is a collection of Vectors, used for instance to represent a column list in a PhysicalProjection operator. Data Flow DuckDB uses a vectorized query exec
...ution model. All operators in DuckDB are optimized to work on Vectors of a fixed size. This fixed size is commonly referred to in the code as STANDARD_VECTOR_SIZE . The default STANDARD_VECTOR_SIZE is 2048 tu...y_t { idx_t offset; idx_t length; }; The offset refers to the start row in the child Vector, the length keeps track of the size of the list of this row. List vectors can be stored recursively. For nested list vectors, the child of a list vector is ag...ist", "data": "list_entry_t", "child": { "type": "bigint", "data": "int64_t" } } } Array Vectors Array vectors store fixed-size lists. Unlike list vectors, they do not use per-row list_entry_t entries, because every row has the same, fixed number of... - https://man.mtool.work/duckdb/2.0/internals/vector.html
DuckDB 2.0 Documentation / man.mtool.work