Results of 1 - 10 of about 16 for wal (0.001 sec.)
- Crashes 12545
- DuckDB is thoroughly tested via an extensive test suite. However, bugs can still occur and these can sometimes lead to crashes. This page contains practical information on how to troubleshoot DuckDB crashes. Types of Crashes There are a few
...om running out of memory. If your DuckDB session runs out of memory, consult the “OOM errors” page . Corrupted database or WAL file: DuckDB displays the following error: console Corrupt database file: computed checksum [...] does not match stored ch...ecksum [...] in block at location [...] If the WAL file gets corrupted, DuckDB will display: console Failure while replaying WAL file "[...].wal": Corrupt WAL file: entry at...ker . Recovering Data If your DuckDB session was writing to a persistent database file prior to crashing, there might be a WAL ( write-ahead log ) file next to your database named ⟨database_filename⟩.wal . To recover data from the WAL file, simply s... - https://man.mtool.work/duckdb/2.0/guides/troubleshooting/crashes.html
- Files Created by DuckDB 11038
- DuckDB creates several files and directories on disk. This page lists both the global and the local ones. Global Files and Directories DuckDB creates the following global files and directories in the user's home directory (denoted with ~ ):
....tmp/ ⟨database_filename⟩.tmp/ Temporary directory. Only created in on-disk mode. weather.duckdb.tmp/ ⟨database_filename⟩.wal Write-ahead log file. If DuckDB exits normally, the WAL file is deleted upon exit. If DuckDB crashes, the WAL file is requ...ired to recover data. weather.duckdb.wal If you are working in a Git repository and would like to disable tracking these files by Git, see the instructions on usin... - https://man.mtool.work/duckdb/2.0/operations_manual/footprint_of_duckdb/files_cr...
- Persistent Testing 10813
- By default, all tests are run in in-memory mode (unless --force-storage is enabled). In certain cases, we want to force the usage of a persistent database. We can initiate a persistent database using the load command, and trigger a reload o
...) # ... restart query I SELECT * FROM test ORDER BY a ---- NULL 11 12 13 14 15 Note that by default the tests run with SET wal_autocheckpoint = '0KB' – meaning a checkpoint is triggered after every statement. WAL tests typically run with the followi...ng settings to disable this behavior: statement ok PRAGMA disable_checkpoint_on_shutdown statement ok SET wal_autocheckpoint = '1TB'... - https://man.mtool.work/duckdb/2.0/dev/sqllogictest/persistent_testing.html
- Metrics 10483
- DuckDB provides a set of metrics that can be used to monitor the performance and health of the database. Metrics are named ⟨group⟩.⟨metric⟩ , e.g., query.total_time or operator.timing . The set of collected metrics is controlled with the tr
...unt of bytes written to storage storage Metrics Metrics on storage operations, such as attaching databases, writing to the WAL and checkpointing. Name Type Unit Description storage.attach_load_storage_latency double seconds Time spent loading from s...torage storage.attach_replay_wal_latency double seconds Time spent replaying the WAL file storage.checkpoint_latency double seconds Time spent running chec...um tasks during checkpointing storage.waiting_to_attach_latency double seconds Time spent waiting to ATTACH a file storage.wal_replay_entry_count uint64 rows The total number of entries to replay in the WAL storage.write_to_wal_latency double second... - https://man.mtool.work/duckdb/2.0/dev/metrics.html
- Gitignore for DuckDB 9305
- If you work in a Git repository, you may want to configure your Gitignore to disable tracking files created by DuckDB . These potentially include the DuckDB database, write-ahead log, and temporary files. Sample Gitignore Files In the follo
...ut Keep Database This configuration is useful if you would like to keep the database file in the version control system: *.wal *.tmp/ Ignore Database and Temporary Files If you would like to ignore both the database and the temporary files, extend t...For example, if your DuckDB files use the .duckdb extension, add the following lines to your .gitignore file: *.duckdb* *.wal *.tmp/... - https://man.mtool.work/duckdb/2.0/operations_manual/footprint_of_duckdb/gitignor...
- Configuration 8872
- DuckDB has a number of configuration options that can be used to change the behavior of the system. The configuration options can be set using either the SET statement or the PRAGMA statement . They can be reset to their original values usi
...reads'; name value description input_type scope threads 1 The number of total threads used by the system. BIGINT GLOBAL Show a list of all available settings: SELECT * FROM duckdb_settings(); Reset the memory limit of the system back to the default:...umber of total async threads used by the system for tasks like I/O. BIGINT 4 × # CPU cores (max. 256) auto_checkpoint_skip_wal_threshold The estimated WAL write size at which point we will skip writing to the WAL and only checkpoint. Skipping writin...g to the WAL means concurrent commits are blocked while the checkpoint is happening. UBIGINT 100000 auto_fallback_to_full_download Allo... - https://man.mtool.work/duckdb/2.0/configuration/overview.html
- ATTACH and DETACH Statements 8646
- DuckDB allows attaching to and detaching from database files. Examples Attach the database file.db with the alias inferred from the name ( file ): ATTACH 'file.db'; Attach the database file.db with an explicit alias ( file_db ): ATTACH 'fil
...abase file.db with a row group size of 2048 rows: ATTACH 'file.db' (ROW_GROUP_SIZE 2048); Attach the database file.db with WAL writes disabled for improved performance: ATTACH 'file.db' (RECOVERY_MODE no_wal_writes); Attach a SQLite database for rea...database with alias file : CREATE TABLE file.new_table (i INTEGER); Detach the database with alias file : DETACH file; Show a list of all attached databases: SHOW DATABASES; Change the default database that is used to the database file : USE file;...key length of 256 bits using the recommended GCM mode. The encryption covers the main database file, the write-ahead-log (WAL) file, and even temporary files. To attach to an encrypted database, use the ATTACH statement with an ENCRYPTION_KEY . ATT... - https://man.mtool.work/duckdb/2.0/sql/statements/attach.html
- CHECKPOINT Statement 8646
- The CHECKPOINT statement synchronizes data in the write-ahead log (WAL) to the database data file. Examples Synchronize data in the default database: CHECKPOINT; Synchronize data in the specified database: CHECKPOINT file_db; Synchronize da
...s, allowing space to be reclaimed after deletes/truncation. Syntax Checkpoint operations happen automatically based on the WAL size (see Configuration ). This statement is for manual checkpoint actions. Behavior The default CHECKPOINT command will f... - https://man.mtool.work/duckdb/2.0/sql/statements/checkpoint.html
- Unit Tester Configuration 8317
- There are three ways of setting options for the unit tester: Command Line Arguments Configuration File Environment Variables Configuration Options List See the Configuration Options List for the full list of available options. Command Line
...ons. # booleans unittest --checkpoint-on-shutdown unittest --no-checkpoint-on-shutdown # other types unittest --checkpoint-wal-size 100000 Command line options --settings , --on-init and --init-script can be used to specify DuckDB configuration . Co...--test-config . See the Configuration Options List for all available options, replacing - with _ . Example: { "checkpoint_wal_size": 100000, "checkpoint_on_shutdown": "false" } The following additional options can also be used in the configuration...of 2 --checkpoint-on-shutdown , --no-checkpoint-on-shutdown Whether or not to checkpoint on database shutdown --checkpoint-wal-size <num> Size in bytes after which to trigger automatic checkpointing --comment <string> Extra free form comment line --... - https://man.mtool.work/duckdb/2.0/dev/sqllogictest/test_configuration.html
- SQLite Extension 8109
- The SQLite extension allows DuckDB to directly read and write data from a SQLite database file. The data can be queried directly from the underlying SQLite tables. Data can be loaded from SQLite tables into DuckDB tables, or vice versa. Ins
...from different processes, SQLite uses file system locks. The locking mechanisms also depend on SQLite configuration, like WAL mode. Refer to the SQLite documentation on locking for more information. Warning Linking multiple copies of the SQLite lib...fore returning a database is locked error. Set to 0 to fail immediately. 5000 JOURNAL_MODE SQLite journaling mode , e.g., 'WAL' . (SQLite default) ATTACH 'file.db' AS f (TYPE sqlite, BUSY_TIMEOUT 0); ATTACH 'file.db' AS f (TYPE sqlite, JOURNAL_MODE...'WAL'); Settings The extension exposes the following configuration parameters. Name Description Default sqlite_debug_show_queri... - https://man.mtool.work/duckdb/2.0/core_extensions/sqlite.html
DuckDB 2.0 Documentation / man.mtool.work