Results of 1 - 10 of about 49 for Data Source (0.004 sec.)
data (258), source (83)
- Merge Statement for SCD Type 2 18914
- This is a practical, step-by-step guide to using DuckDB's MERGE statement (introduced in v1.4.0) to perform upserts and build Slowly Changing Dimension Type 2 (SCD Type 2) tables . Type 2 SCDs let you keep full historical versions of record
...s while clearly identifying the current version, perfect for audit trails, data warehousing, and analytical workloads. Type 2 SCDs are practical when you want to know previous values of your primary key...data, when it changed and for how long it was in a particular state. Why Use MERGE in DuckDB? Single SQL statement for INSERT ,...Basic SQL knowledge Key Terminology Term Meaning Target table The main/master table you are updating (e.g., master_ducks ) Source table The incoming/new data (e.g., incoming_ducks ) MERGE INTO Specifies the target table USING Specifies the source table... - https://man.mtool.work/duckdb/2.0/guides/sql_features/merge.html
- ODBC Extension Functions 17815
- odbc_begin_transaction odbc_bind_params odbc_close odbc_commit odbc_connect odbc_copy odbc_create_params odbc_list_data_sources odbc_list_drivers odbc_query odbc_rollback odbc_begin_transaction odbc_begin_transaction(conn_handle BIGINT) ->
...new ODBC connection will be opened and will be closed automatically after the query is complete Optional named parameters (source): Source query is executed using a separate DB instance from the instance on which odbc_copy is being called. Thus source_...cannot refer to pre-existing in-memory tables and cannot open currently opened DuckDB files. As a workaround, for complex source queries it is suggested to export the query result into a local Parquet file first and then run odbc_copy on that file. so...ons.csv , equivalent to source_query='SELECT * FROM '<source_file>' source_query ( VARCHAR ): DuckDB SQL query to read the data, example: FROM nl_train_stations source_queries ( LIST(VARCHAR) ): multiple DuckDB SQL queries executed one by one, last q... - https://man.mtool.work/duckdb/2.0/core_extensions/odbc/functions.html
- Iceberg Functions 17559
- The iceberg extension provides the following functions: Function Description iceberg_scan(source) Reads an Iceberg table from a path. iceberg_metadata(source) Returns the manifest entries of an Iceberg table. iceberg_snapshots(source) Retur
...ns the snapshots of an Iceberg table. iceberg_column_stats(source) Returns per-data-file, per-column statistics of an Iceberg table. iceberg_partition_stats(source) Returns per-partition-f...an Iceberg table. iceberg_load_table_response(table) Returns the raw LoadTable response of the REST Catalog. iceberg_files(source) Returns the data and delete files of an Iceberg table snapshot. iceberg_manifests(source) Returns the manifest files of a...berg table. iceberg_scan_plan(table) Returns the scan tasks (files to read) planned for an Iceberg table. iceberg_view_metadata(view) Returns the raw LoadView response of the REST Catalog. iceberg_table_properties(table) Returns all properties of the... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/iceberg_functions.html
- MERGE INTO Statement 16238
- The MERGE INTO statement is an alternative to INSERT INTO ... ON CONFLICT that doesn't need a primary key since it allows for a custom match condition. This is a very useful alternative for upserting use cases ( INSERT + UPDATE ) when the d
...eys and the changed value. This is a good use for SET . If the match condition uses a column that has the same name in the source and destination, the keyword USING can be used in the match condition. MERGE INTO people USING ( SELECT 1 AS id, 98_000.0...PDATE 3 Sarah 89000.0 DELETE 1 John 105000.0 In some cases, you may want to perform a different action specifically if the source doesn't meet a condition. For example, if we expect that data that is not present on the source shouldn't be present in th... - https://man.mtool.work/duckdb/2.0/sql/statements/merge_into.html
- ODBC 101: A Duck Themed Guide to ODBC 15982
- What is ODBC? ODBC which stands for Open Database Connectivity, is a standard that allows different programs to talk to different databases including, of course, DuckDB. This makes it easier to build programs that work with many different data
...atabases, which saves time as developers don't have to write custom code to connect to each database. Instead, they can use the standardized ODBC interface, which reduces development time and costs, and programs are eas...ier to maintain. However, ODBC can be slower than other methods of connecting to a database, such as using a native driver, as it adds an extra layer of abstraction between the application and the database. Fur...g ODBC with DuckDB. There are links throughout this page to the official Microsoft ODBC documentation , which is a great resource for learning more about ODBC. General Concepts Handles Connecting Error Handling and Diagnostics Buffers and Binding Handl... - https://man.mtool.work/duckdb/2.0/guides/odbc/general.html
- Complete API 15265
- This page contains the reference for DuckDB's C API. The reference contains several deprecation notices. These concern methods whose long-term availability is not guaranteed as they may be removed in the future. That said, DuckDB's develope
...cache (); duckdb_state duckdb_get_or_create_from_cache ( duckdb_instance_cache instance_cache , const char * path , duckdb_database * out_database , duckdb_config config , char ** out_error ); void duckdb_destroy_instance_cache ( duckdb_instance_cach...e * instance_cache ); duckdb_state duckdb_open ( const char * path , duckdb_database * out_database ); duckdb_state duckdb_open_ext ( const char * path , duckdb_database * out_database , duckdb_config co...duckdb_result result ); Cast Functions duckdb_cast_function duckdb_create_cast_function (); void duckdb_cast_function_set_source_type ( duckdb_cast_function cast_function , duckdb_logical_type source_type ); void duckdb_cast_function_set_target_type (... - https://man.mtool.work/duckdb/2.0/clients/c/api.html
- Utility Functions 13512
- Scalar Utility Functions The functions below are difficult to categorize into specific function types and are broadly useful. Name Description alias(column) Return the name of the column. can_cast_implicitly(source_value, target_value) Whet
...her or not we can implicitly cast from the types of the source value to the target value. checkpoint(database) Synchronize WAL with file for (optional) database without interrupting tra...ameters and sort qualifiers. current_catalog() Return the name of the currently active catalog. Default is memory. current_database() Return the name of the currently active database. current_query() Return the current query as a string. current_quer...nice = true , then min , max and bincount may be adjusted to produce more aesthetically pleasing results. force_checkpoint(database) Synchronize WAL with file for (optional) database interrupting transactions. gen_random_uuid() Return a random UUID s... - https://man.mtool.work/duckdb/2.0/sql/functions/utility.html
- Share a DuckDB Database That Only Stores Views 13160
- A DuckDB database file does not have to contain any data: it can store only view definitions that point at remote data such as Parquet files on object storage. The resulting file is only a few hundred kilobytes, yet it behaves like a shared
...catalog: anyone who attaches it sees a set of named, ready-to-query relations, while the underlying data stays in its original location and format. This is useful for publishing a curated “semantic layer” over a data lake, wher...the view definitions encode the joins, filters, and column names that consumers should use, without copying or moving the data itself. Prerequisites This guide requires the httpfs extension , which can be installed using the INSTALL httpfs SQL comma...log (READ_ONLY); SELECT count(*) AS num_stations FROM catalog.stations; Consumers need the httpfs extension and, for s3:// sources, credentials that grant access to the underlying data. Limitations Consumers must be able to access both the catalog file... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/duckdb_views_only...
- Rust Client 12672
- Installation To use the DuckDB Rust client, visit the Rust installation page . The latest stable version of the DuckDB Rust client is 2.0.0. The DuckDB Rust client, duckdb-rs , is an ergonomic wrapper over the DuckDB C API that exposes an i
...I is documented on docs.rs . Add it to a project with cargo , enabling the bundled feature so that DuckDB is compiled from source and no system library is required: cargo add duckdb --features bundled The equivalent Cargo.toml entry pins the version. S...size down. Basic API Usage To use DuckDB, first initialize a Connection with Connection::open_in_memory() for an in-memory database, or Connection::open(path) for a database file. Queries are sent with execute() and execute_batch() , and results are...value with query_map() : use duckdb::{params, Connection, Result}; #[derive(Debug)] struct Person { id: i32, name: String, data: Option<Vec<u8>>, } fn main() -> Result<()> { let conn = Connection::open_in_memory()?; conn.execute_batch( r"CREATE SEQUE... - https://man.mtool.work/duckdb/2.0/clients/rust/overview.html
- COPY Statement 12266
- Examples Read a CSV file into the lineitem table, using auto-detected CSV options: COPY lineitem FROM 'lineitem.csv'; Read a CSV file into the lineitem table, using manually specified CSV options: COPY lineitem FROM 'lineitem.csv' (DELIMITE
...le: COPY (SELECT l_orderkey, l_partkey FROM lineitem) TO 'lineitem.parquet' (COMPRESSION zstd); Copy the entire content of database db1 to database db2 : COPY FROM DATABASE db1 TO db2; Copy only the schema (catalog elements) but not any data: COPY FR...OM DATABASE db1 TO db2 (SCHEMA); Overview COPY moves data between DuckDB and external files. COPY ... FROM imports data into DuckD...on into the lineitem table: COPY lineitem FROM 'lineitem.json' (FORMAT json, ARRAY true); An expression may be used as the source of a COPY ... FROM command if it is placed within parentheses. Read the contents of a file whose path is stored in a varia... - https://man.mtool.work/duckdb/2.0/sql/statements/copy.html
DuckDB 2.0 Documentation / man.mtool.work