Results of 1 - 5 of about 5 for shredded (0.002 sec.)
- Geometry Data Type 12262
- Name Description GEOMETRY Geospatial entity The GEOMETRY data type is used to store and manipulate geometric objects, such as points, lines, and polygons. The GEOMETRY type was part of the spatial extension but became a built-in data type i
...compressed independently using lightweight algorithms - far more efficiently than storing variable-size binary blobs. The shredded layout depends on the geometry type: POINT - STRUCT(X DOUBLE, Y DOUBLE) (and/or Z, M) LINESTRING - STRUCT(X DOUBLE, Y DOUB...MULTIPOINT , MULTILINESTRING , MULTIPOLYGON - same as above, with one additional level of list nesting Row groups are not shredded if they contain GEOMETRYCOLLECTION s, any EMPTY geometries, or multiple geometry sub-types. Additionally, row groups are n...ot shredded if they fall below the minimum size threshold (default: ~25% of the maximum row group size, i.e., 30,000 rows). This thres... - https://man.mtool.work/duckdb/2.0/sql/data_types/geometry.html
- Variant Type 10332
- The VARIANT type stores typed, binary data where each row is self-contained with its own type information. This differs from the JSON type , which is physically stored as text. Because type metadata is embedded per-value, VARIANT provides b
...the common structure of the values and shreds them, i.e., stores the fields that share a type as separate, typed columns. Shredded data compresses well and can be scanned efficiently. Shredding is only applied to row groups with at least variant_minimum...parquet, SHREDDING {'data': 'STRUCT(name VARCHAR, age INTEGER)'} ); Reading Snowflake VARIANT from Parquet DuckDB can read shredded VARIANT Parquet files produced by Snowflake, automatically reconstructing the variant values from the shredded columns. Fu... - https://man.mtool.work/duckdb/2.0/sql/data_types/variant.html
- Unity Catalog Extension 8126
- The unity_catalog extension attaches a Unity Catalog catalog, on Databricks or Unity Catalog OSS, as a DuckDB database. You can list, read, insert into and create its Delta Lake tables. It uses the delta extension to access the tables. For
...as introduced in DuckDB 2.0. Unity Catalog's variant maps to VARIANT . VARIANT columns can be read whether their files are shredded or not. Inserts write shredded variants if the table sets delta.enableVariantShredding . An INSERT into a table with a VAR... - https://man.mtool.work/duckdb/2.0/core_extensions/unity_catalog.html
- Delta Extension 7684
- The delta extension adds support for the Delta Lake open-source storage format . It is built using the Delta Kernel . The extension reads Delta tables, local and remote, and writes them: it can create tables and append to them. For implemen
...n_mapping_policy = 'lenient'; . VARIANT Columns Delta variant columns are read as DuckDB VARIANT , whether their files are shredded or not, and top-level VARIANT columns can be appended to. New The following were introduced in DuckDB 2.0. A query that re...ads one field of a VARIANT or STRUCT column, such as SELECT v.a , reads only that field from the Parquet files, so on a shredded table it skips the columns of the other fields. This does not apply to a column with a TIMESTAMP WITH TIME ZONE field at a...ly if the table sets 'delta.enableVariantShredding' to 'true' , as the Delta protocol requires; otherwise it writes them unshredded. Because CREATE TABLE cannot set this property, a table created by DuckDB holds unshredded files. Catalog-Managed Tables A... - https://man.mtool.work/duckdb/2.0/core_extensions/delta.html
- COPY Statement 7537
- Examples Read a CSV file into the lineitem table, using auto-detected CSV options: COPY lineitem FROM 'lineitem.csv'; Read a CSV file into the lineitem table, using manually specified CSV options: COPY lineitem FROM 'lineitem.csv' (DELIMITE
...other values are cast to string. STRUCT (empty) SHREDDING A STRUCT mapping VARIANT column names to the type they should be shredded into, e.g., {variant_col: 'STRUCT(name VARCHAR, age INTEGER)'} . Enables typed (shredded) storage of VARIANT columns. STRU... - https://man.mtool.work/duckdb/2.0/sql/statements/copy.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work