Results of 1 - 10 of about 25 for glob (0.002 sec.)
- Pattern Matching 14114
- There are four separate approaches to pattern matching provided by DuckDB: the traditional SQL LIKE operator , the more recent SIMILAR TO operator (added in SQL:1999), a GLOB operator , and POSIX-style regular expressions . LIKE The LIKE ex
...IMILAR TO matching. DuckDB follows the same partial-matching semantics by default, see the PostgreSQL compatibility page . Globbing DuckDB supports file name expansion, also known as globbing, for discovering files. DuckDB's glob syntax uses the ques...ed inside the first bracket to search for a character that is not contained within the brackets. To learn more, visit the “glob (programming)” Wikipedia page . GLOB The GLOB operator returns true or false if the string matches the GLOB pattern. The G...ing for filenames that follow a specific pattern (for example a specific file extension). Some examples: SELECT 'best.txt' GLOB '*.txt'; -- true SELECT 'best.txt' GLOB '????.txt'; -- true SELECT 'best.txt' GLOB '?.txt'; -- false SELECT 'best.txt' GLO... - https://man.mtool.work/duckdb/2.0/sql/functions/pattern_matching.html
- Reading Multiple Files 13516
- DuckDB can read multiple files of different types (CSV, Parquet, JSON files) at the same time using either the glob syntax, or by providing a list of files to read. See the combining schemas page for tips on reading files with different sch
...M read_csv(['flights1.csv', 'flights2.csv'], union_by_name = true, filename = true); Parquet Read all files that match the glob pattern: SELECT * FROM 'test/*.parquet'; Read three Parquet files and treat them as a single table: SELECT * FROM read_par...fic folders: SELECT * FROM read_parquet(['folder1/*.parquet', 'folder2/*.parquet']); Read all Parquet files that match the glob pattern at any depth: SELECT * FROM read_parquet('dir/**/*.parquet'); Multi-File Reads and Globs DuckDB can also read a se...ks if the Parquet files have the same schema. You can specify which Parquet files you want to read using a list parameter, glob pattern matching syntax, or a combination of both. Directory Paths The read_parquet function accepts a local directory pat... - https://man.mtool.work/duckdb/2.0/data/multiple_files/overview.html
- Utility Functions 8817
- Scalar Utility Functions The functions below are difficult to categorize into specific function types and are broadly useful. Name Description alias(column) Return the name of the column. can_cast_implicitly(source_value, target_value) Whet
...uses UNION ALL BY NAME semantics. read_blob(source) Returns the content from source (a filename, a list of filenames, or a glob pattern) as a BLOB . See the read_blob guide for more details. read_text(source) Returns the content from source (a filena...me, a list of filenames, or a glob pattern) as a VARCHAR . The file content is first validated to be valid UTF-8. If read_text attempts to read a file with i...the two tables) | read_blob(source) | Description | Returns the content from source (a filename, a list of filenames, or a glob pattern) as a BLOB . See the read_blob guide for more details. | | Example | read_blob('hello.bin') | | Result | hello\x0A... - https://man.mtool.work/duckdb/2.0/sql/functions/utility.html
- SQL Quirks 8369
- Like all programming languages and libraries, DuckDB has its share of idiosyncrasies and inconsistencies. Some are vestiges of our feathered friend's evolution; others are inevitable because we strive to adhere to the SQL Standard and speci
...re, unbound identifier to be used as a table function argument, implicitly converting it to a string literal. For example, glob(no_such_file.csv) was treated as glob('no_such_file.csv') . Deprecated As of DuckDB 2.0, this implicit conversion is depre...d. By default DuckDB still converts the identifier but logs a warning; use an explicit string literal instead, for example glob('no_such_file.csv') . The behavior is controlled by the table_function_identifier_conversion setting: DEFAULT : convert th... - https://man.mtool.work/duckdb/2.0/sql/dialect/sql_quirks.html
- Hugging Face Support 8119
- The httpfs extension introduces support for the hf:// protocol to access datasets hosted in Hugging Face repositories. See the announcement blog post for details. Usage Hugging Face repositories can be queried using the following URL patter
...the data table as follows: SELECT * FROM data; Multiple Files To query all files under a specific directory, you can use a glob pattern . For example: SELECT count(*) AS count FROM 'hf://datasets/cais/mmlu/astronomy/*.parquet'; count 173 By using glo... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/hugging_face.html
- Directly Reading Files 8119
- DuckDB allows directly reading files via the read_text and read_blob functions. These functions accept a filename, a list of filenames, or a glob pattern. They output the content of each file as a VARCHAR or BLOB , respectively, along with
...hdown These table functions also use projection pushdown to avoid computing properties unnecessarily. For example, you can glob a directory of large files to get file sizes in the size column. As long as you omit the content column, DuckDB won't read... - https://man.mtool.work/duckdb/2.0/guides/file_formats/read_file.html
- Loading JSON 8020
- The DuckDB JSON reader can automatically infer which configuration flags to use by analyzing the JSON file. This will work correctly in most situations, and should be the first option attempted. In rare situations where the JSON reader cann
...lumns are shown: userId completed 1 false 1 false 1 false 1 true 1 false Multiple files can be read at once by providing a glob or a list of files. Refer to the multiple files section for more information. Functions for Reading JSON Objects The follo...Description read_json_objects(filename) Read a JSON object from filename , where filename can also be a list of files or a glob pattern. read_ndjson_objects(filename) Alias for read_json_objects with the parameter format set to newline_delimited . re...tions: Function Description read_json(filename) Read JSON from filename , where filename can also be a list of files, or a glob pattern. read_json_auto(filename) Alias for read_json . read_ndjson(filename) Alias for read_json with parameter format se... - https://man.mtool.work/duckdb/2.0/data/json/loading_json.html
- Reading and Writing Parquet Files 7970
- Examples Read a single Parquet file: SELECT * FROM 'test.parquet'; Figure out which columns/types are in a Parquet file: DESCRIBE SELECT * FROM 'test.parquet'; Create a table from a Parquet file: CREATE TABLE test AS SELECT * FROM 'test.par
...directly inside the directory, use test/*.parquet instead. See directory paths for details. Read all files that match the glob pattern: SELECT * FROM 'test/*.parquet'; Read all files that match the glob pattern, and include the filename virtual colu...without a configuration options since DuckDB 1.3.0): SELECT *, filename FROM read_parquet('test/*.parquet'); Use a list of globs to read all Parquet files from two specific folders: SELECT * FROM read_parquet(['folder1/*.parquet', 'folder2/*.parquet'...infer that you are reading a Parquet file: SELECT * FROM 'test.parquet'; Multiple files can be read at once by providing a glob or a list of files. Refer to the multiple files section for more information. Parameters There are a number of options exp... - https://man.mtool.work/duckdb/2.0/data/parquet/overview.html
- Profiling 7970
- Profiling is essential to help understand why certain queries exhibit specific performance characteristics. DuckDB contains several built-in features to enable query profiling, which this page covers. For a high-level example of using EXPLA
...ct standard standard , detailed , all tracked_metrics Select which metrics to collect ['*'] (all metrics) A list of metric glob patterns, e.g. ['query.*', 'optimizer.*'] . ( List of all available metrics ) disable_profiling , disable_profile Turn off...w In DuckDB 2.0, the set of collected metrics is controlled with the tracked_metrics setting, which takes a list of metric glob patterns such as ['query.*', 'optimizer.*'] . This replaces the custom_profiling_settings PRAGMA used in earlier versions.... - https://man.mtool.work/duckdb/2.0/dev/profiling.html
- Blob Functions 7970
- This section describes functions and operators for examining and manipulating BLOB values . Function Description arg1 || arg2 Concatenates two strings, lists, or blobs. Any NULL input results in NULL . See also concat(arg1, arg2, ...) and l
...h(blob) Number of bytes in blob . read_blob(source) Returns the content from source (a filename, a list of filenames, or a glob pattern) as a BLOB . See the read_blob guide for more details. repeat(blob, count) Repeats the blob count number of times....| | Result | 2 | read_blob(source) | Description | Returns the content from source (a filename, a list of filenames, or a glob pattern) as a BLOB . See the read_blob guide for more details. | | Example | read_blob('hello.bin') | | Result | hello\x0A... - https://man.mtool.work/duckdb/2.0/sql/functions/blob.html
DuckDB 2.0 Documentation / man.mtool.work