Results of 1 - 10 of about 77 for stored (0.002 sec.)
- Secrets Manager 13054
- The Secrets manager provides a unified user interface for secrets across all backends that use them. Secrets can be scoped, so different storage prefixes can have different secrets, allowing for example to join data across organizations in
...can also be persisted, so that they do not need to be specified every time DuckDB is launched. Note Persistent secrets are stored in unencrypted binary format in the ~/.duckdb/stored_secrets directory. They are protected by file system permissions (mod...e 600 ), similar to how SSH private keys are stored: only the user running the DuckDB process can read and write them. Types of Secrets Secrets are typed, their type identifi...the CREATE SECRET SQL statement . Secrets can be temporary or persistent . Temporary secrets are used by default – and are stored in-memory for the life span of the DuckDB instance similar to how settings worked previously. Persistent secrets are store... - https://man.mtool.work/duckdb/2.0/configuration/secrets_manager.html
- Execution Format 12791
- Vector is the container format used to store in-memory data during execution. DataChunk is a collection of Vectors, used for instance to represent a column list in a PhysicalProjection operator. Data Flow DuckDB uses a vectorized query exec
...ution throughout the system. Below the list of supported vector formats is shown. Flat Vectors Flat vectors are physically stored as a contiguous array, this is the standard uncompressed vector format. For flat vectors the logical and physical represen...tations are identical. Constant Vectors Constant vectors are physically stored as a single constant value. Constant vectors are useful when data elements are repeated – for example, when representing t...emitted by the storage when decompressing from constant compression. Dictionary Vectors Dictionary vectors are physically stored as a child vector, and a selection vector that contains indexes into the child vector. Dictionary vectors are emitted by t... - https://man.mtool.work/duckdb/2.0/internals/vector.html
- Reading Faulty CSV Files 10042
- CSV files can come in all shapes and forms, with some presenting many errors that make the process of cleanly reading them inherently difficult. To help users read these files, DuckDB supports detailed error messages, the ability to skip fa
...line and in which CSV Scanner they happened. Note that any of the errors described in our Structural Error section will be stored in the rejects tables. Also, if a line has multiple errors, multiple entries will be stored for the same line, one for eac...CSV Rejects Table. Name Description Type Default store_rejects If set to true, any errors in the file will be skipped and stored in the default rejects temporary tables. BOOLEAN False rejects_scan Name of a temporary table where the information of the...scan information of faulty CSV file are stored. VARCHAR reject_scans rejects_table Name of a temporary table where the information of the faulty lines of a CSV file are... - https://man.mtool.work/duckdb/2.0/data/csv/reading_faulty_csv_files.html
- PostgreSQL Extension and the Secret Manager 9379
- User credentials and other PostgreSQL database connection details can be stored using the DuckDB Secrets Manager . The following syntax can be used to create a secret: CREATE SECRET ( TYPE postgres, HOST '127.0.0.1', PORT 5432, DATABASE pos
...cret will be used when ATTACH is called. We can leave the PostgreSQL connection string empty to use all of the information stored in the secret. ATTACH '' AS postgres_db (TYPE postgres); We can use the PostgreSQL connection string to override individua...probed automatically. If it exists then the Secret Storage instance is registerd for this attached database making all the stored secrets available in the current session. This allows to use such persistent secrets with “direct attach” scenarios, when...:5432/db1 This method can also be used with DuckLake (with PostgreSQL catalog), when an S3/object storage access secret is stored in the catalog database: duckdb ducklake:postgres:postgresql://username:password@127.0.0.1:5432/db1 Secrets the are stored... - https://man.mtool.work/duckdb/2.0/core_extensions/postgres/secrets.html
- Interval Type 9379
- INTERVAL s represent periods of time that can be added to or subtracted from DATE , TIMESTAMP , TIMESTAMPTZ , or TIME values. Name Description INTERVAL Period of time An INTERVAL can be constructed by providing amounts together with units.
...ivalent amounts in the next smaller of these three basis units. SELECT INTERVAL 1 YEAR, -- single unit using YEAR keyword; stored as 12 months INTERVAL (random() * 10) YEAR, -- parentheses necessary for variable amounts; -- stored as integer number of...months INTERVAL '1 month 1 day', -- string type necessary for multiple units; stored as (1 month, 1 day) '16 months'::INTERVAL, -- string cast supported; stored as 16 months '48:00:00'::INTERVAL, -- HH::MM::...SS string supported; stored as (48 * 60 * 60 * 1e6 microseconds) ; Warning Decimal values are truncated to integers when used with unit keywords (unle... - https://man.mtool.work/duckdb/2.0/sql/data_types/interval.html
- CREATE TABLE Statement 9117
- The CREATE TABLE statement creates a table in the catalog. Examples Create a table with two integer columns ( i and j ): CREATE TABLE t1 (i INTEGER, j INTEGER); Create a table with a primary key: CREATE TABLE t1 (id INTEGER PRIMARY KEY, j V
...cause key "..." does not exist in the referenced table. Generated Columns The [type] [GENERATED ALWAYS] AS (expr) [VIRTUAL|STORED] syntax will create a generated column. The data in this kind of column is generated from its expression, which can refere...fail if the type cannot be cast to the type of the generated column. Generated columns come in two varieties: VIRTUAL and STORED . The data of virtual generated columns is not stored on disk, instead it is computed from the expression every time the c...olumn is referenced (through a select statement). The data of stored generated columns is stored on disk and is computed every time the data of their dependencies change (through an INSERT /... - https://man.mtool.work/duckdb/2.0/sql/statements/create_table.html
- Vectors 8730
- Vectors represent a horizontal slice of a column. They hold a number of values of a specific type, similar to an array. Vectors are the core data representation used in DuckDB. Vectors are typically stored within data chunks . The vector an
...this function might return nullptr in which case the validity mask does not need to be checked. Strings String values are stored as a duckdb_string_t . This is a special struct that stores the string inline (if it is short, i.e., <= 12 bytes ) or a po...r be accessed directly, or the duckdb_string_is_inlined can be used to check if a string is inlined. Decimals Decimals are stored as integer values internally. The exact native type depends on the width of the decimal type, as shown in the following ta...<= 38 duckdb_hugeint The duckdb_decimal_internal_type can be used to obtain the internal type of the decimal. Decimals are stored as integer values multiplied by 10^scale . The scale of a decimal can be obtained using duckdb_decimal_scale . For example... - https://man.mtool.work/duckdb/2.0/clients/c/vector.html
- PostgreSQL Import 8592
- To run a query directly on a running PostgreSQL database, the postgres extension is required. Installation and Loading The extension can be installed using the INSTALL SQL command. This only needs to be run once. INSTALL postgres; To load t
...xtension is installed, you can attach a PostgreSQL database using the ATTACH command . This allows you to query all tables stored within the PostgreSQL database as if it was a regular database. The first parameter of ATTACH is the PostgreSQL connection...eSQL user name [OS user name] password PostgreSQL password dbname Database name [user] passfile Name of file passwords are stored in ~/.pgpass -- Attach the PostgreSQL database using the given connection string ATTACH 'host=localhost port=5432 dbname=m... - https://man.mtool.work/duckdb/2.0/guides/database_integration/postgres.html
- SQL on Apache Arrow 8343
- DuckDB can query multiple different types of Apache Arrow objects. DuckDB pushes the filters of a query that it can translate, such as comparisons, into the scan of an Arrow dataset. Arrow tables, record batches, scanners and RecordBatchRea
...on row order, such as first(i) without ORDER BY , can return a different row on each run. Apache Arrow Tables Arrow Tables stored in local variables can be queried as if they are regular tables within DuckDB. import duckdb import pyarrow as pa # connec...Table results = con.sql("SELECT * FROM my_arrow_table WHERE i = 2").to_arrow_table() Apache Arrow Datasets Arrow Datasets stored as variables can also be queried as if they were regular tables. Datasets are useful to point towards directories of Parqu...able results = con.sql("SELECT * FROM my_arrow_dataset WHERE i = 2").to_arrow_table() Apache Arrow Scanners Arrow Scanners stored as variables can also be queried as if they were regular tables. Scanners read over a dataset and select specific columns... - https://man.mtool.work/duckdb/2.0/guides/python/sql_on_arrow.html
- DuckLake 8205
- DuckLake 1.1 was released together with DuckDB 2.0. Read the announcement blog post . The ducklake extension adds support for attaching to databases stored in the DuckLake format . The complete documentation of this extension is available a
...──────┴──────────────────────────┴─────────┴────────────────┴───────────────────┘ ducklake_snapshots Returns the snapshots stored in the DuckLake catalog name catalog . Parameter name Parameter type Named parameter Description catalog VARCHAR no The in...e VARCHAR commit_extra_info VARCHAR ducklake_table_info The ducklake_table_info function returns information on the tables stored in the DuckLake catalog named catalog . Parameter name Parameter type Named parameter Description catalog VARCHAR no The i... - https://man.mtool.work/duckdb/2.0/core_extensions/ducklake.html
DuckDB 2.0 Documentation / man.mtool.work