Results of 1 - 3 of about 3 for datalake (0.001 sec.)
- Iceberg Functions 11905
- The iceberg extension provides the following functions: Function Description iceberg_scan(source) Reads an Iceberg table from a path. iceberg_metadata(source) Returns the manifest entries of an Iceberg table. iceberg_snapshots(source) Retur
...tition_source_columns , partition_field_transform , lower_bound and upper_bound . SELECT * FROM iceberg_partition_stats(my_datalake.default.t); iceberg_load_table_response The iceberg_load_table_response function is an advanced function that only works w..., metadata ( VARIANT ), config ( MAP ), storage_credentials and request_url . SELECT * FROM iceberg_load_table_response(my_datalake.default.t); Metadata Operations on Attached Catalogs The functions iceberg_metadata and iceberg_snapshots are also availab...le to use with an attached Iceberg catalog using a fully qualified path, e.g.: SELECT * FROM iceberg_metadata(my_datalake.default.t) -- Or SELECT * FROM iceberg_snapshots(my_datalake.default.t) This functionality enables the user to do time tra... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/iceberg_functions.html
- Writing to Iceberg 8259
- The DuckDB iceberg extension supports writing to Iceberg tables when an Iceberg catalog is attached. Writing to a table read directly from storage with iceberg_scan is not supported: the catalog is required to commit the new table metadata.
...R TABLE SELECT Since these operations are supported, the following will also work: COPY FROM DATABASE duckdb_db TO iceberg_datalake; -- Or COPY FROM DATABASE iceberg_datalake TO duckdb_db; This functionality enables deep copies between Iceberg and DuckDB... - https://man.mtool.work/duckdb/2.0/core_extensions/iceberg/writing_to_iceberg.htm...
- Azure Extension 7720
- The azure extension lets DuckDB read and write files in Azure Blob Storage and Azure Data Lake Storage (ADLS) Gen2. Installing and Loading The azure extension will be transparently autoloaded on first use from the official extension reposit
...ile⟩.⟨parquet_or_csv⟩'; SELECT * FROM 'az://⟨my_storage_account⟩.blob.core.windows.net/⟨my_container⟩/⟨path⟩/*.csv'; Azure Data Lake Storage (ADLS) Allowed URI schemes: abfss or abfs (both connect over HTTPS) SELECT count(*) FROM 'abfss://⟨my_filesystem⟩...P/data_0.csv root/l_receiptmonth=1997-12/l_shipmode=SHIP/data_0.csv Meanwhile, the same query can be performed through the datalake endpoint as follows: SELECT count(*) FROM 'abfss://root/l_receiptmonth=1997-*/l_shipmode=SHIP/*.csv'; This will perform th... - https://man.mtool.work/duckdb/2.0/core_extensions/azure.html
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work