Results of 1 - 5 of about 5 for parallelize (0.001 sec.)
- R 12464
- This page contains instructions for building the R client library. Parallelizing the Build Problem: By default, R compiles packages using a single thread, which causes the build to be slow. Solution: To parallelize the compilation, create o
...r edit the ~/.R/Makevars file, and add a line like the following: MAKEFLAGS = -j8 The above will parallelize the compilation using 8 threads. On Linux/macOS, you can add the following to use all of the machine's threads: MAKEFLAGS... - https://man.mtool.work/duckdb/2.0/dev/building/r.html
- Tuning Workloads 9541
- DuckDB aims to perform well out of the box, so most workloads do not require any tuning. When tuning is worthwhile, there is no single configuration or magic number that is optimal for every workload: the right settings depend on what you a
...not, see the Order Preservation page . Parallelism (Multi-Core Processing) The Effect of Row Groups on Parallelism DuckDB parallelizes the workload based on row groups , i.e., groups of rows that are stored together at the storage level. The default row gr...ed. Frequently, a single connection will work best, but a connection pool may also be used. Using multiple connections can parallelize some operations, although it is typically not necessary. DuckDB does attempt to parallelize as much as possible within eac...h individual query, but it is not possible to parallelize in all cases. Making multiple connections can process more operations concurrently. This can be more helpful if DuckDB is... - https://man.mtool.work/duckdb/2.0/guides/performance/how_to_tune_workloads.html
- File Formats 8953
- Handling Parquet Files DuckDB has advanced support for Parquet files, which includes directly querying Parquet files . When deciding on whether to query these files directly or to first load them to the database, you need to consider severa
...Sizes DuckDB works best on Parquet files with row groups of 100K-1M rows each. The reason for this is that DuckDB can only parallelize over row groups – so if a Parquet file has a single giant row group it can only be processed by a single thread. You can u...the differences are small: the gap is about 10% between the best and the worst runtime. Parquet File Sizes DuckDB can also parallelize across multiple Parquet files. It is advisable to have at least as many total row groups across all files as there are CPU... - https://man.mtool.work/duckdb/2.0/guides/performance/file_formats.html
- Linux 7776
- Prerequisites On Linux, install the required packages with the package manager of your distribution. Ubuntu and Debian CLI Client On Ubuntu and Debian (and also MX Linux, Linux Mint, etc.), the requirements for building the DuckDB CLI clien
...recompile with -fPIC Solution: Create or edit the ~/.R/Makevars file. This example also contains the MAKEFLAGS setting to parallelize the build : ALL_CXXFLAGS = $(PKG_CXXFLAGS) -fPIC $(SHLIB_CXXFLAGS) $(CXXFLAGS) MAKEFLAGS = -j$(nproc) Building the httpfs... - https://man.mtool.work/duckdb/2.0/dev/building/linux.html
- PostgreSQL Extension 7188
- The postgres extension allows DuckDB to directly read and write data from a running PostgreSQL database instance. The data can be queried directly from the underlying PostgreSQL database. Data can be loaded from PostgreSQL tables into DuckD
...connections NULL pg_use_binary_copy Whether or not to use BINARY copy to read data true pg_use_ctid_scan Whether or not to parallelize scanning using table ctids true pg_use_information_schema_introspection Use the SQL-standard information_schema views inst... - https://man.mtool.work/duckdb/2.0/core_extensions/postgres/overview.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work