For the complete documentation index, see llms.txt. This page is also available as Markdown.

Delta

Using Delta table format in object storage Depots

In DataOS, object storage Depots (ABFSS, Amazon S3, GCS) support two table formats: iceberg and delta. This section covers the Delta table format.

What does the Delta table format actually do?

Delta table format adds a transactional metadata layer to cloud object storage, providing ACID-compliant operations on Parquet files. In DataOS, setting format: delta on a Depot routes ingestion through Delta-compatible read and write Flare jobs.

In DataOS:

  • Set format: delta on a Depot for Delta table format (best with Spark).

  • Set format: iceberg on a Depot for Iceberg table format (works with Spark, Trino, and more).

Supported object storage sources in DataOS for Delta table format

DataOS supports the Delta table format on the following object storage Depots:

For each of these storage types, create a Depot with format: delta to use Delta table management in DataOS.

Last updated

Was this helpful?