Results of 1 - 10 of about 35 for filename (0.005 sec.)
- Loading JSON – DuckDB 13143
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...tions for Reading JSON Objects The following table functions are used to read JSON: Function Description read_json_objects(filename) Read a JSON object from filename , where filename can also be a list of files or a glob pattern. read_ndjson_objects(file...name) Alias for read_json_objects with the parameter format set to newline_delimited . read_json_objects_auto(filename) Alias for read_json_objects with the parameter format set to auto . Parameters These functions have the following paramet...e.g., t.json.gz will use gzip, t.json will use none). Options are none , gzip , zstd and auto_detect . VARCHAR auto_detect filename Whether or not an extra filename column should be included in the result. Since DuckDB v1.3.0, the filename column is adde... - https://man.mtool.work/duckdb/1.3/data/json/loading_json.html
- Reading Multiple Files – DuckDB 11775
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...ts1.csv' , 'flights2.csv' ]); Read the CSV files flights1.csv and flights2.csv , unifying schemas by name and outputting a filename column: SELECT * FROM read_csv ([ 'flights1.csv' , 'flights2.csv' ], union_by_name = true , filename = true ); Parquet Rea...ter, glob pattern matching syntax, or a combination of both. List Parameter The read_parquet function can accept a list of filenames as the input parameter. Read three Parquet files and treat them as a single table: SELECT * FROM read_parquet ([ 'file1.p...arquet' , 'file2.parquet' , 'file3.parquet' ]); Glob Syntax Any file name input to the read_parquet function can either be an exact filename, or use a glob syntax to read multiple files that matc... - https://man.mtool.work/duckdb/1.3/data/multiple_files/overview.html
- Directly Reading Files – DuckDB 10391
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...tly Reading Files DuckDB allows directly reading files via the read_text and read_blob functions. These functions accept a filename, a list of filenames or a glob pattern, and output the content of each file as a VARCHAR or BLOB , respectively, as well a...sults in a single row with the content field holding the entire content of the respective file. SELECT size , parse_path ( filename ), content FROM read_text ( 'test/sql/table_function/files/*.txt' ); size parse_path(filename) content 12 [test, sql, tabl...blob instead. read_blob The read_blob table function reads from the selected source(s) to a BLOB : SELECT size , content , filename FROM read_blob ( 'test/sql/table_function/files/*' ); size content filename 178 PK\x03\x04\x0A\x00\x00\x00\x00\x00\xACi=X\... - https://man.mtool.work/duckdb/1.3/guides/file_formats/read_file.html
- Importing Data – DuckDB 10295
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...ore details, see the page on CSV loading . Parquet Loading Parquet files can be efficiently loaded and queried using their filename: SELECT * FROM 'test.parquet' ; Alternatively, use the read_parquet function : SELECT * FROM read_parquet ( 'test.parquet'...more details, see the page on Parquet loading . JSON Loading JSON files can be efficiently loaded and queried using their filename: SELECT * FROM 'test.json' ; Alternatively, use the read_json_auto function : SELECT * FROM read_json_auto ( 'test.json' )...; Or use the COPY statement : COPY tbl FROM 'test.json' ; For more details, see the page on JSON loading . Returning the Filename Since DuckDB v1.3.0, the CSV, JSON and Parquet readers support the filename virtual column: COPY ( FROM ( VALUES ( 42 ), (... - https://man.mtool.work/duckdb/1.3/data/overview.html
- Partitioned Writes – DuckDB 10200
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...g data into many small partitions is expensive. It is generally recommended to have at least 100 MB of data per partition. Filename Pattern By default, files will be named data_0.parquet or data_0.csv . With the flag FILENAME_PATTERN a pattern with {i} o...r {uuid} can be defined to create specific filenames: {i} will be replaced by an index {uuid} will be replaced by a 128 bits long UUID Write a table to a Hive partitioned dat...a set of .parquet files, with an index in the filename: COPY orders TO 'orders' ( FORMAT parquet , PARTITION_BY ( year , month ), OVERWRITE_OR_IGNORE , FILENAME_PATTERN 'orders_... - https://man.mtool.work/duckdb/1.3/data/partitioning/partitioned_writes.html
- S3 API Support – DuckDB 9611
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
.../that/uses/a/gcs/secret .parquet' ); Reading Reading files from S3 is now as simple as: SELECT * FROM 's3:// your-bucket / filename . extension ' ; Partial Reading The httpfs extension supports partial reading from S3 buckets. Reading Multiple Files Mult...iple files are also possible, for example: SELECT * FROM read_parquet ([ 's3:// your-bucket / filename-1 .parquet' , 's3:// your-bucket / filename-2 .parquet' ]); Globbing File globbing is implemented using the ListObjectsV2...unt ( * ) FROM read_parquet ( 's3:// your-bucket /folder*/100?/t[0-9].parquet' ); A useful feature when using globs is the filename option, which adds a column named filename that encodes the file that a particular row originated from: SELECT * FROM read... - https://man.mtool.work/duckdb/1.3/core_extensions/httpfs/s3api.html
- Reading and Writing Parquet Files – DuckDB 8720
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...that match the glob pattern: SELECT * FROM 'test/*.parquet' ; Read all files that match the glob pattern, and include the filename virtual column that specifies which file each row came from (this column is available by default without a configuration o...ptions since DuckDB v1.3.0): SELECT * , filename FROM read_parquet ( 'test/*.parquet' ); Use a list of globs to read all Parquet files from two specific folders: SELECT *...is to true to load binary columns as strings. BOOL false encryption_config Configuration for Parquet encryption . STRUCT - filename Whether or not an extra filename column should be included in the result. Since DuckDB v1.3.0, the filename column is adde... - https://man.mtool.work/duckdb/1.3/data/parquet/overview.html
- Files Created by DuckDB – DuckDB 8720
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...or in-memory connections) or relative to the database file (for persistent connections): Name Description Example database_filename Database file. Only created in on-disk mode. The file can have any extension with typical extensions being .duckdb , .db ,...and .ddb . weather.duckdb .tmp/ Temporary directory. Only created in in-memory mode. .tmp/ database_filename .tmp / Temporary directory. Only created in on-disk mode. weather.tmp/ database_filename .wal Write-ahead log file. If Duc...r DuckDB . 関連キーワード DuckDB files duckdb directory created database Files creates directories disk history extensions filename mode weather Directories following Description Shared between client commands used secrets working 関連するページ Connect... - https://man.mtool.work/duckdb/1.3/operations_manual/footprint_of_duckdb/files_cr...
- Command Line Arguments – DuckDB 8624
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...before reading stdin -c COMMAND Run COMMAND and exit -csv Set output mode to csv -echo Print commands before execution -f FILENAME Run the script in FILENAME and exit. Note that the ~/.duckdbrc is read and executed first (if it exists) -init FILENAME Ru...n the script in FILENAME upon startup (instead of ~/.duckdbrc ) -header Turn headers on -help Show this message -html Set output mode to HTML -inte... - https://man.mtool.work/duckdb/1.3/clients/cli/arguments.html
- Relational API – DuckDB 8417
- This page is for DuckDB 1.3, which is outdated. Switch to the current version . Search Shortcut cmd + k | ctrl + k Installation Documentation Getting Started Connect Overview Concurrency Data Import Overview Data Sources CSV Files Overview
...mal : Optional[str] Character to recognize as decimal point. allow_quoted_nulls : Optional[bool] Allow quoted NULL values. filename : Optional[bool], Optional[str] Add filename column or specify filename. hive_partitioning : Optional[bool] Enable Hive-st...b . duckdb . DuckDBPyConnection , file_glob : str , binary_as_string : bool = False , * , file_row_number : bool = False , filename : bool = False , hive_partitioning : bool = False , union_by_name : bool = False , compression : object = None ) -> duckdb...b . DuckDBPyConnection , file_globs : list [ str ], binary_as_string : bool = False , * , file_row_number : bool = False , filename : bool = False , hive_partitioning : bool = False , union_by_name : bool = False , compression : object = None ) -> duckdb... - https://man.mtool.work/duckdb/1.3/clients/python/relational_api.html
DuckDB 1.3 Documentation / man.mtool.work