Delta
Using Delta table format in object storage Depots
In DataOS, object storage Depots (ABFSS, Amazon S3, GCS) support two table formats: iceberg and delta. This section covers the Delta table format.
What does the Delta table format actually do?
Delta table format adds a transactional metadata layer to cloud object storage, providing ACID-compliant operations on Parquet files. In DataOS, setting format: delta on a Depot routes ingestion through Delta-compatible read and write Flare jobs.
In DataOS:
Set
format: deltaon a Depot for Delta table format (best with Spark).Set
format: icebergon a Depot for Iceberg table format (works with Spark, Trino, and more).
Supported object storage sources in DataOS for Delta table format
DataOS supports the Delta table format on the following object storage Depots:
For each of these storage types, create a Depot with format: delta to use Delta table management in DataOS.
Last updated
Was this helpful?