Results of 1 - 9 of about 9 for services (0.002 sec.)
- Dutch Railway Datasets 13283
- Examples in this documentation often use datasets based on the Dutch Railway datasets . These high-quality datasets are maintained by the team behind the Rijden de Treinen (Are the trains running?) application . This page contains download
...post on the analysis of these datasets . Loading the Datasets You can load the datasets directly as follows: CREATE TABLE services AS FROM 'https://blobs.duckdb.org/nl-railway/services-2025-03.csv.gz'; DESCRIBE services; column_name column_type null key... - https://man.mtool.work/duckdb/2.0/guides/snippets/dutch_railway_datasets.html
- Share a DuckDB Database That Only Stores Views 10838
- A DuckDB database file does not have to contain any data: it can store only view definitions that point at remote data such as Parquet files on object storage. The resulting file is only a few hundred kilobytes, yet it behaves like a shared
...e views resolve regardless of the client's working directory: ATTACH 'catalog.duckdb' AS catalog; USE catalog; CREATE VIEW services AS SELECT * FROM read_parquet('s3://my-bucket/rail/services/*.parquet'); CREATE VIEW stations AS SELECT * FROM read_parque... - https://man.mtool.work/duckdb/2.0/guides/network_cloud_storage/duckdb_views_only...
- DBine SQL Editor 9023
- DBine is a free, open-source (Apache 2.0) desktop database manager for Windows, macOS, and Linux that works with 130+ databases and cloud services. Besides a SQL editor, it includes notebooks, charts built from query results, and schema com
... - https://man.mtool.work/duckdb/2.0/guides/sql_editors/dbine.html
- S3 and AWS Authentication 8412
- This page is the entry point for authenticating to S3 and other AWS services from DuckDB. Authentication is configured using secrets , and the detailed reference material lives on the S3 API Support and AWS Extension pages. The sections bel
... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/authentication.html
- Hive Partitioning 8412
- Examples Read data from a Hive partitioned dataset: SELECT * FROM read_parquet('orders/*/*/*.parquet', hive_partitioning = true); Write a table to a Hive partitioned dataset: COPY orders TO 'orders' (FORMAT parquet, PARTITION_BY (year, mont
...uce columns on the fly using the following syntax: COPY (SELECT *, year(timestamp) AS year, month(timestamp) AS month FROM services) TO 'test' (PARTITION_BY (year, month)); When reading, the partition columns are read from the directory structure and can... - https://man.mtool.work/duckdb/2.0/data/partitioning/hive_partitioning.html
- PostgreSQL Extension and the Secret Manager 7801
- User credentials and other PostgreSQL database connection details can be stored using the DuckDB Secrets Manager . The following syntax can be used to create a secret: CREATE SECRET ( TYPE postgres, HOST '127.0.0.1', PORT 5432, DATABASE pos
..._SECRET – the name of the secret of type rds AWS RDS IAM Authentication Managed PostgreSQL databases running on RDS/Aurora services allow to use IAM authentication . In that case the authentication token is generated using AWS SDK and must be refreshed e... - https://man.mtool.work/duckdb/2.0/core_extensions/postgres/secrets.html
- File Formats 7801
- Handling Parquet Files DuckDB has advanced support for Parquet files, which includes directly querying Parquet files . When deciding on whether to query these files directly or to first load them to the database, you need to consider severa
..., 'zstd'); CALL d.set_option('parquet_version', 2); CALL d.set_option('parquet_compression_level', 22); COPY FROM DATABASE services TO d; Using a heavyweight zstd compression level trades a longer write time for smaller files, so it is most beneficial fo... - https://man.mtool.work/duckdb/2.0/guides/performance/file_formats.html
- S3 API Support 7603
- The httpfs extension supports reading/writing/ globbing files on object storage servers using the S3 API. S3 offers a standard API to read and write to remote files (while regular http servers, predating S3, do not offer a common write API)
...ndustry storage providers. Platforms The httpfs filesystem is tested with AWS S3 , Minio , Google Cloud and lakeFS . Other services that implement the S3 API (such as Cloudflare R2 , SeaweedFS , and Tigris ) should also work, but not all features may be... - https://man.mtool.work/duckdb/2.0/core_extensions/httpfs/s3api.html
- Securing DuckDB 7603
- DuckDB is a powerful analytical database engine. It can read and write files, access the network, load extensions, and use system resources. Like any powerful tool, these capabilities require appropriate configuration when working with sens
...ll be changed, while all other settings are locked. Secrets Secrets are used to manage credentials to log into third party services like AWS or Azure. DuckDB can show a list of secrets using the duckdb_secrets() table function. This will redact any sensi... - https://man.mtool.work/duckdb/2.0/operations_manual/securing_duckdb/overview.htm...
PREV
1
NEXT
DuckDB 2.0 Documentation / man.mtool.work