Results of 1 - 8 of about 8 for globbing (0.002 sec.)
- S3 API Support 11802
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...ple: SELECT * FROM read_parquet([ 's3://⟨your-bucket⟩/⟨filename-1⟩.parquet', 's3://⟨your-bucket⟩/⟨filename-2⟩.parquet' ]); Globbing File globbing is implemented using the ListObjectsV2 API call and allows using filesystem-like glob patterns to match mult...onfiguration reference , including enable_global_s3_configuration , merge_http_secret_into_s3_request , s3_allow_recursive_globbing , httpfs_enable_credential_refresh , s3_version_id_pinning , and unsafe_disable_etag_checks .... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- Pattern Matching 11206
- There are four separate approaches to pattern matching provided by DuckDB: the traditional SQL LIKE operator , the more recent SIMILAR TO operator (added in SQL:1999), a GLOB operator , and POSIX-style regular expressions . LIKE The LIKE ex
...IMILAR TO matching. DuckDB follows the same partial-matching semantics by default, see the PostgreSQL compatibility page . Globbing DuckDB supports file name expansion, also known as globbing, for discovering files. DuckDB's glob syntax uses the question...for all files: SELECT * FROM glob('*'); file duckdb.exe test.csv test.json test.parquet test2.csv test2.parquet todos.json Globbing Semantics The ** wildcard matches any number of subdirectories, including none, so **/⟨filename⟩ also returns a file named... - https://man.mtool.work/duckdb/2.0/sql/functions/pattern_matching.html
- httpfs Extension for HTTP and S3 Support 10320
- The httpfs extension is an autoloadable extension implementing a file system that allows reading remote/writing remote files. For plain HTTP(S), only file reading is supported. For object storage using the S3 API, the httpfs extension suppo
...rts reading/writing/ globbing files. Installation and Loading The httpfs extension will be, by default, autoloaded on first use of any functionality exp... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/overview.html
- Directly Read DuckDB Databases 8838
- DuckDB allows directly reading DuckDB files through the read_duckdb function: read_duckdb(⟨'path_to_database'⟩, table_name = ⟨'table_to_read'⟩); Using this function is equivalent to performing the following steps: Attaching to the database
...│ 2 │ ASIA │ │ 3 │ EUROPE │ │ 4 │ MIDDLE EAST │ └─────────────┴─────────────┘ Reading from Multiple Databases You can use globbing to read from multiple databases. To illustrate this, let's create two databases: duckdb my-1.duckdb \ -c "CREATE TABLE num... - https://man.mtool.work/duckdb/2.0/guides/file_formats/read_duckdb.html
- S3 Iceberg Import 8838
- Prerequisites Loading an Iceberg file from S3 requires both the httpfs and iceberg extensions. Install them using the INSTALL SQL command. You only need to install extensions once. INSTALL httpfs; INSTALL iceberg; To load the extensions, us
...is: Invalid Configuration Error: Failed to read iceberg table. No version was provided and no version-hint could be found, globbing the filesystem to locate the latest version is disabled by default as this is considered unsafe and could result in readin... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/s3_iceberg_import...
- File Formats 7374
- Handling Parquet Files DuckDB has advanced support for Parquet files, which includes directly querying Parquet files . When deciding on whether to query these files directly or to first load them to the database, you need to consider severa
...mns={'hello': 'BIGINT', 'world': 'VARCHAR'}); Then, you can adjust read_csv command, by e.g., applying filename expansion (globbing) , and run with the rest of the options detected by the sniffer: FROM read_csv('part-*.csv', auto_detect=false, delim=',',... - https://man.mtool.work/duckdb/2.0/guides/performance/file_formats.html
- Friendly SQL 7374
- DuckDB offers several advanced SQL features and syntactic sugar to make SQL queries more concise. We refer to these colloquially as “friendly SQL”. Several of these features were first introduced by DuckDB, while some are inspired by other
...OM 'my.csv.gz' , FROM 'my.parquet' , etc. In Python, you can access Pandas data frames using FROM df . Filename expansion (globbing) , e.g.: FROM 'my-data/part-*.parquet' Functions and Expressions Dot operator for function chaining : SELECT ('hello').upp... - https://man.mtool.work/duckdb/2.0/sql/dialect/friendly_sql.html
- Configuration 6488
- DuckDB has a number of configuration options that can be used to change the behavior of the system. The configuration options can be set using either the SET statement or the PRAGMA statement . They can be reset to their original values usi
...semantics Configures whether regex match operators use partial or full string matching. VARCHAR partial s3_allow_recursive_globbing Whether globs on S3-like storage are optimized with recursive strategy (alternative is listing) BOOLEAN true s3_enable_dep... - https://man.mtool.work/duckdb/2.0/configuration/overview.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work