Skip to content

Databases and warehouses

Find and export
your Databricks data.

Databricks Delta metadata reports the files used by the latest table snapshot. Older retained files and other cloud storage can make the underlying folder larger.

Report in
GB
Category
Databases and warehouses
Last checked

Find your Databricks data size

  1. List the tables in the catalogs and schemas in scope with the required access.
  2. Run DESCRIBE DETAIL catalog.schema.table for each relevant Delta table.
  3. Record sizeInBytes, numFiles and the table identity, then convert the non-overlapping sizes to GB.
  4. Inspect business timestamps for the history represented by the rows.
sizeInBytes describes the latest snapshot. It is different from all files retained in the table's storage location.

What to include in your data inventory

Report in GB, naming catalogs, schemas and the current-snapshot basis. Add table and row quantities where available.

Describe retained historical states and external files separately, with the earliest business dates and application scope.

Add the dates covered and the people who use this software. Label estimates and describe how you calculated them.

Export your Databricks history

  1. Have an administrator confirm the table types, privileges and approved destination.
  2. For supported Delta tables, review DEEP CLONE to create an independent copy of the required data and metadata.
  3. Use a supported query export or data-writing route where another format or table type is required.
  4. Collect the output with schemas and table identifiers, checking historical-state requirements separately.

A clone of a selected state does not preserve every earlier table version or all catalog metadata.

Managed-table storage should be accessed through authorized Databricks operations. Use a supported export destination rather than bypassing table permissions.

Why Databricks data has value for AI training

Lakehouse tables can link raw events with the structured records derived from them.

Schema and pipeline context can explain how business activity becomes a usable dataset.

What stays private

Choose catalogs, tables and fields in scope, reviewing sensitive data and any externally shared material.

Telegraph Lab reviews the proposed material with you and agrees how sensitive information will be handled. Preparation can include excluding material, redacting details and replacing personal identifiers. Your company keeps ownership; the licensing agreement defines the material, permitted uses and authorized recipients.

Common questions about Databricks data

What does sizeInBytes measure?

Databricks defines it as the size of the latest table snapshot in bytes.

Why is the cloud folder larger?

It can retain files outside the latest snapshot, including older versions.

Does DEEP CLONE preserve all history?

A clone represents a selected state. Review historical-version and catalog metadata needs separately.

Can we copy managed-table paths directly?

Use an authorized export or cloning route supported for that managed table.

Your data inventory

Add your numbers to the picture.

Enter the quantities and years covered in your data inventory, then share it with your Telegraph Lab contact. We’ll review the material and discuss the next step with you.

Discuss your data