Results of 1 - 10 of about 20 for patterns (0.001 sec.)
- Graph Queries 14716
- DuckDB supports graph queries via the DuckPGQ community extension , which implements the SQL/PGQ syntax from the SQL:2023 standard. Warning DuckPGQ is a community extension and is still under active development. It may not be available for
...Moreover, some features may be incomplete. See the DuckPGQ website for the latest status. Graph queries allow you to find patterns and paths in connected data, such as social networks, financial transactions, or knowledge graphs, using a visual, intuiti...d) DESTINATION KEY (person2_id) REFERENCES Person (id) ); Pattern Matching Use the GRAPH_TABLE function with MATCH to find patterns. The syntax uses () for nodes and [] for edges: FROM GRAPH_TABLE (social_network MATCH (a:Person)-[k:Knows]->(b:Person) CO...gerank('social_network', 'Person', 'Knows'); Use Case: Financial Fraud Detection Graph queries excel at finding suspicious patterns in financial data. See the "Uncovering Financial Crime with DuckDB and Graph Queries" blog post for a detailed example of... - https://man.mtool.work/duckdb/2.0/guides/sql_features/graph_queries.html
- Reading Multiple Files 11453
- DuckDB can read multiple files of different types (CSV, Parquet, JSON files) at the same time using either the glob syntax, or by providing a list of files to read. See the combining schemas page for tips on reading files with different sch
...ted in the test folder: Read all files that match the glob pattern: SELECT * FROM read_parquet('test/*.parquet'); Handling Patterns That Match No Files If a glob pattern does not match any files, the read functions raise an error: SELECT * FROM read_parq...is 0 . List of Globs The glob syntax and the list input parameter can be combined to scan files that meet one of multiple patterns. Read all Parquet files from 2 specific folders. SELECT * FROM read_parquet(['folder1/*.parquet', 'folder2/*.parquet']); D...o search for filenames using the glob table function. It accepts one parameter: the path to search (which may include glob patterns). Search the current directory for all files. SELECT * FROM glob('*'); file test.csv test.json test.parquet test2.csv test... - https://man.mtool.work/duckdb/2.0/data/multiple_files/overview.html
- Profiling 9822
- Profiling is essential to help understand why certain queries exhibit specific performance characteristics. DuckDB contains several built-in features to enable query profiling, which this page covers. For a high-level example of using EXPLA
...andard standard , detailed , all tracked_metrics Select which metrics to collect ['*'] (all metrics) A list of metric glob patterns, e.g. ['query.*', 'optimizer.*'] . ( List of all available metrics ) disable_profiling , disable_profile Turn off profilin...DuckDB 2.0, the set of collected metrics is controlled with the tracked_metrics setting, which takes a list of metric glob patterns such as ['query.*', 'optimizer.*'] . This replaces the custom_profiling_settings PRAGMA used in earlier versions. The avai... - https://man.mtool.work/duckdb/2.0/dev/profiling.html
- Pragmas 8428
- The PRAGMA statement is a SQL extension adopted by DuckDB from SQLite. PRAGMA statements can be issued in a similar manner to regular SQL statements. PRAGMA commands may alter the internal state of the database engine, and can influence the
...iling collects all metrics. To collect only a subset, use the tracked_metrics setting, which accepts a list of metric glob patterns. A metric is collected if its name matches any of the patterns. The default value, ['*'] , matches all metrics. Note This... - https://man.mtool.work/duckdb/2.0/configuration/pragmas.html
- Hugging Face Support 8428
- The httpfs extension introduces support for the hf:// protocol to access datasets hosted in Hugging Face repositories. See the announcement blog post for details. Usage Hugging Face repositories can be queried using the following URL patter
...attern . For example: SELECT count(*) AS count FROM 'hf://datasets/cais/mmlu/astronomy/*.parquet'; count 173 By using glob patterns, you can efficiently handle large datasets and perform comprehensive queries across multiple files, simplifying your data... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/hugging_face.html
- DuckDB Wasm Client 8190
- Installation To use the DuckDB Wasm client, visit the duckdb-wasm GitHub repository . The latest stable version of the DuckDB WebAssembly client is 2.0.0. DuckDB-Wasm is a version of DuckDB that has been compiled to WebAssembly , the portab
...imits. See Troubleshoot for workarounds when you run into these limits. Further Reading Instantiate — the bundle-selection patterns for jsDelivr, webpack, Vite, and statically served files. Import Data — registering files and inserting Apache Arrow, CSV,... - https://man.mtool.work/duckdb/2.0/clients/wasm/overview.html
- Querying Parquet Metadata 8190
- Parquet Metadata The parquet_metadata function can be used to query the metadata contained within a Parquet file, which reveals various internal details of the Parquet file such as the statistics of the different columns. This can be useful
...ble in Parquet files, or even to obtain a quick overview of what the different columns contain. The function supports glob patterns to query metadata across multiple files in parallel: SELECT * FROM parquet_metadata('test.parquet'); SELECT * FROM parquet... - https://man.mtool.work/duckdb/2.0/data/parquet/metadata.html
- Environment 8190
- The environment where DuckDB is run has an obvious impact on performance. This page focuses on the effects of the hardware configuration and the operating system used. Hardware Configuration CPU DuckDB's officially supported architectures a
...bject storage and the transactional metadata in a separate catalog database, which avoids the concurrent read-write access patterns on a single large file that network-attached storage handles poorly. Operating System We recommend using the latest stable... - https://man.mtool.work/duckdb/2.0/guides/performance/environment.html
- Full-Text Search Extension 7970
- Full-Text Search is an extension to DuckDB that allows for search through strings, similar to SQLite's FTS5 extension . Installing and Loading The fts extension will be transparently autoloaded on first use from the official extension repos
...are to be used. Defaults to 'english' for a pre-defined list of 571 English stopwords ignore VARCHAR Regular expression of patterns to be ignored. Defaults to '(\\.|[^a-z])+' , ignoring all escaped and non-alphabetic lowercase characters strip_accents BO... - https://man.mtool.work/duckdb/2.0/core_extensions/full_text_search.html
- Star Expression 7970
- Syntax The * expression can be used in a SELECT statement to select all columns that are projected in the FROM clause. SELECT * FROM tbl; TABLE.* and STRUCT.* The * expression can be prepended by a table name to select only columns from tha
...tern matching operators LIKE , GLOB , SIMILAR TO and their variants allow you to select columns by matching their names to patterns. SELECT * LIKE 'col%' FROM tbl; SELECT * GLOB 'col*' FROM tbl; SELECT * SIMILAR TO 'col.' FROM tbl; The NOT variants of th... - https://man.mtool.work/duckdb/2.0/sql/expressions/star.html
DuckDB 2.0 Documentation / man.mtool.work