Results of 1 - 5 of about 5 for Shredding (0.002 sec.)
- Variant Type 12023
- The VARIANT type stores typed, binary data where each row is self-contained with its own type information. This differs from the JSON type , which is physically stored as text. Because type metadata is embedded per-value, VARIANT provides b
..., 'name') AS name FROM events WHERE id = 4; ┌─────────┐ │ name │ │ variant │ ├─────────┤ │ Alice │ └─────────┘ Storage New Shredding VARIANT columns in DuckDB's storage was introduced in DuckDB 2.0. When storing VARIANT columns in a DuckDB database file,...res the fields that share a type as separate, typed columns. Shredded data compresses well and can be scanned efficiently. Shredding is only applied to row groups with at least variant_minimum_shredding_size rows (by default, 30,000 rows, roughly one four...th of the default row group size). Setting it to -1 disables shredding: SET variant_minimum_shredding_size = -1; Parquet Support DuckDB supports reading and writing VARIANT types from Parquet f... - https://man.mtool.work/duckdb/2.0/sql/data_types/variant.html
- Geometry Data Type 10663
- Name Description GEOMETRY Geospatial entity The GEOMETRY data type is used to store and manipulate geometric objects, such as points, lines, and polygons. The GEOMETRY type was part of the spatial extension but became a built-in data type i
...ut this conversion is performed automatically at the storage layer and is not visible to the execution engine or the user. Shredding and Compression The GEOMETRY type supports a storage optimization called "shredding", which improves compression for geome...(default: ~25% of the maximum row group size, i.e., 30,000 rows). This threshold is configurable via the geometry_minimum_shredding_size setting. Set it to 0 to always shred, or -1 to disable shredding entirely. -- Disable shredding for geometry columns...SET geometry_minimum_shredding_size = -1; -- Always shred geometry columns regardless of row group size SET geometry_minimum_shredding_size = 0; The prim... - https://man.mtool.work/duckdb/2.0/sql/data_types/geometry.html
- Configuration 8291
- DuckDB has a number of configuration options that can be used to change the behavior of the system. The configuration options can be set using either the SET statement or the PRAGMA statement . They can be reset to their original values usi
...se corruption after an operating system or hardware crash. FULL uses fullfsync on macOS. VARCHAR STANDARD geometry_minimum_shredding_size Minimum size of a row group to enable GEOMETRY shredding. Set to -1 to disable shredding entirely. Defaults to 1/4th..._REMOTE only validates remote cache entries. NO_VALIDATION disables cache validation. VARCHAR VALIDATE_ALL variant_minimum_shredding_size Minimum size of a row group to have VARIANT shredding enabled. Set to -1 to disable shredding entirely. Defaults to 1... - https://man.mtool.work/duckdb/2.0/configuration/overview.html
- Loading JSON 7519
- The DuckDB JSON reader can automatically infer which configuration flags to use by analyzing the JSON file. This will work correctly in most situations, and should be the first option attempted. In rare situations where the JSON reader cann
...': 42, 'goose': [1,2,3]} {'duck': 43, 'goose': [4,5,6]} For additional examples reading more complex data, please see the “Shredding Deeply Nested JSON, One Vector at a Time” blog post . Loading with the COPY Statement Using FORMAT json When the json exte... - https://man.mtool.work/duckdb/2.0/data/json/loading_json.html
- COPY Statement 7427
- Examples Read a CSV file into the lineitem table, using auto-detected CSV options: COPY lineitem FROM 'lineitem.csv'; Read a CSV file into the lineitem table, using manually specified CSV options: COPY lineitem FROM 'lineitem.csv' (DELIMITE
...plied as a STRUCT of keys to values. BLOB values are written as raw bytes; other values are cast to string. STRUCT (empty) SHREDDING A STRUCT mapping VARIANT column names to the type they should be shredded into, e.g., {variant_col: 'STRUCT(name VARCHAR,... - https://man.mtool.work/duckdb/2.0/sql/statements/copy.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work