Results of 1 - 10 of about 24 for Encoding (0.003 sec.)
- Encodings Extension 11943
- The encodings extension adds support for reading CSVs using more than 1,000 character encodings. For a complete list of supported encodings, see All Supported Encodings . For detailed information on character encoding, see the ICU data repo
...sitory . Installing and Loading INSTALL AND LOAD encodings; Usage Refer to the encoding while reading from files. To read a .csv file with shift_jis encoding: FROM read_csv('my_shi...ft_jis.csv', encoding = 'shift_jis'); To read a .csv file with windows-1251-2000 encoding: FROM read_csv('my_windows_1251_2000.csv', encoding =...'windows-1251-2000'); To read a .csv file with windows-1252-2000 encoding: FROM read_csv('my_windows_1252_2000.csv', encoding = 'windows-1252-2000'); To read a .csv file with EUC_CN encoding: FROM... - https://man.mtool.work/duckdb/2.0/core_extensions/encodings.html
- Information Schema 11609
- The views in the information_schema are SQL-standard views that describe the catalog entries of the database. These views can be filtered to obtain information about a specific column or table. DuckDB's implementation is based on PostgreSQL
...ULL . VARCHAR NULL character_set_name Name of the character set, currently implemented as showing the name of the database encoding. VARCHAR 'UTF8' character_repertoire Character repertoire, showing UCS if the encoding is UTF8 , else just the encoding na...me. VARCHAR 'UCS' form_of_use Character encoding form, same as the database encoding. VARCHAR 'UTF8' default_collate_catalog Name of the database containing the default co...other data types. The maximum octet length depends on the declared character maximum length (see above) and the character encoding. INTEGER 1073741824 numeric_precision If data_type identifies a numeric type, this column contains the (declared or implic... - https://man.mtool.work/duckdb/2.0/sql/meta/information_schema.html
- Querying Parquet Metadata 11275
- Parquet Metadata The parquet_metadata function can be used to query the metadata contained within a Parquet file, which reveals various internal details of the Parquet file such as the statistics of the different columns. This can be useful
...AR stats_null_count BIGINT stats_distinct_count BIGINT stats_min_value VARCHAR stats_max_value VARCHAR compression VARCHAR encodings VARCHAR index_page_offset BIGINT dictionary_page_offset BIGINT data_page_offset BIGINT total_compressed_size BIGINT total...key BLOB value BLOB GeoParquet Metadata GeoParquet files store their geospatial metadata (the primary geometry column, its encoding, the coordinate reference system, and more) under the geo key of the Parquet key-value metadata. Because parquet_kv_metada...value)->>'$.version' AS version, decode(value)->>'$.primary_column' AS primary_column, decode(value)->>'$.columns.geometry.encoding' AS encoding FROM parquet_kv_metadata('file.parquet') WHERE decode(key) = 'geo'; version primary_column encoding 1.0.0 geo... - https://man.mtool.work/duckdb/2.0/data/parquet/metadata.html
- Schema 11109
- Types It is important to use the correct type for encoding columns (e.g., BIGINT , DATE , DATETIME ). While it is always possible to use string types ( VARCHAR , etc.) to encode more specific values, this is not recommended. Strings use mor
...s below show that joining on BIGINT columns is approx. 1.8× faster than performing the same join on VARCHAR -typed columns encoding the same value. Join column payload type Join column schema type Example value Query time BIGINT BIGINT 70368755640078 1.2...tpractice Avoid representing numeric values as strings, especially if you intend to perform e.g., join operations on them. Encoding Repeated Strings as a Dimension Table When a wide string column has only a few distinct values that repeat across many row...rollup.* EXCLUDE (field_pk), field_name FROM rollup NATURAL JOIN dim_table; Bestpractice DuckDB already applies dictionary encoding to string columns in storage, so this technique mainly pays off for query-heavy workloads that repeatedly group or join on... - https://man.mtool.work/duckdb/2.0/guides/performance/schema.html
- Blob Functions 11109
- This section describes functions and operators for examining and manipulating BLOB values . Function Description arg1 || arg2 Concatenates two strings, lists, or blobs. Any NULL input results in NULL . See also concat(arg1, arg2, ...) and l
...'ignore' (removes invalid characters). encode(string) Converts the string to BLOB . Converts UTF-8 characters into literal encoding. from_base64(string) Converts a base64 encoded string to a character string ( BLOB ). from_binary(value) Alias for unbin ....from_hex(value) Alias for unhex . hex(blob) Converts blob to VARCHAR using hexadecimal encoding. md5(blob) Returns the MD5 hash of the blob as a VARCHAR . md5_number(blob) Returns the MD5 hash of the blob as a HUGEINT...ace') | | Result | ? | encode(string) | Description | Converts the string to BLOB . Converts UTF-8 characters into literal encoding. | | Example | encode('my_string_with_ü') | | Result | my_string_with_\xC3\xBC | from_base64(string) | Description | Conve... - https://man.mtool.work/duckdb/2.0/sql/functions/blob.html
- Storage Versions and Format 8940
- Compatibility Backward Compatibility Backward compatibility refers to the ability of a newer DuckDB version to read storage files created by an older DuckDB version. Version 0.10 is the first release of DuckDB that supports backward compati
...pression algorithms. Compression Algorithms The compression algorithms supported by DuckDB include the following: Constant Encoding Run-Length Encoding (RLE) Bit Packing Frame of Reference (FOR) Dictionary Encoding Fast Static Symbol Table (FSST) – VLDB... - https://man.mtool.work/duckdb/2.0/internals/storage.html
- Bitstring Type 8607
- Name Aliases Description BITSTRING BIT Variable-length strings of 1s and 0s Bitstrings are strings of 1s and 0s. The bit type data is of variable length. A bitstring value requires 1 byte for each group of 8 bits, plus a fixed amount to sto
...dded with zeroes. Bitstrings can be very large, having the same size restrictions as BLOB s. Creating a Bitstring A string encoding a bitstring can be cast to a BITSTRING : SELECT '101010'::BITSTRING AS b; b 101010 A bitstring can also be created using a... - https://man.mtool.work/duckdb/2.0/sql/data_types/bitstring.html
- Text Functions 8106
- Text Functions and Operators This section describes functions and operators for examining and manipulating STRING values . Function Description string[index] Extracts a single character using a (1-based) index . string[begin:end] Extracts a
...string . upper(string) Converts string to upper case. url_decode(string) Decodes a URL from a representation using Percent-Encoding . url_encode(string) Encodes a URL to a representation using Percent-Encoding . string[index] | Description | Extracts a s...| Result | HELLO | | Alias | ucase | url_decode(string) | Description | Decodes a URL from a representation using Percent-Encoding . | | Example | url_decode('https%3A%2F%2Fduckdb.org%2Fwhy_duckdb%23portable') | | Result | https://duckdb.org/why_duckdb#...portable | url_encode(string) | Description | Encodes a URL to a representation using Percent-Encoding . | | Example | url_encode('this string has/ special+ characters>') | | Result | this%20string%20has%2F%20special%2B%20cha... - https://man.mtool.work/duckdb/2.0/sql/functions/text.html
- PostgreSQL Extension 7939
- The postgres extension allows DuckDB to directly read and write data from a running PostgreSQL database instance. The data can be queried directly from the underlying PostgreSQL database. Data can be loaded from PostgreSQL tables into DuckD
...COPY postgres_db.tbl TO 'data.parquet'; COPY postgres_db.tbl FROM 'data.parquet'; These copies use PostgreSQL binary wire encoding . DuckDB can also write data using this encoding to a file which you can then load into PostgreSQL using a client of your... - https://man.mtool.work/duckdb/2.0/core_extensions/postgres/overview.html
- CSV Import 7939
- Examples The following examples use the flights.csv file. Read a CSV file from disk, auto-infer options: SELECT * FROM 'flights.csv'; Use the read_csv function with custom options: SELECT * FROM read_csv('flights.csv', delim = '|', header =
...vailable in the COPY statement. VARCHAR , escape String used to escape the quote character within quoted values. VARCHAR " encoding Encoding used by the CSV file. Options are utf-8 , utf-16 , latin-1 . Not available in the COPY statement (which always us...this option increases memory consumption. BOOL false Tip DuckDB's CSV reader supports UTF-8 (default), UTF-16 and Latin-1 encodings. For other encodings, you can either use the encodings extension or convert them e.g. using the iconv command-line tool :... - https://man.mtool.work/duckdb/2.0/data/csv/overview.html
DuckDB 2.0 Documentation / man.mtool.work