Benefits
- Zero-copy sharing: BlockDB exposes tables through Delta Sharing so you query them from any Databricks workspace (or other compatible client).
- Unity Catalog integration: Access is enforced via share-level permissions, keeping audits centralized.
- Supports both archive snapshots and incremental change data (
table_changes()), ideal for lakehouse pipelines.
Getting Connected
- Provide your Unity Catalog metastore ID and share invite email to [email protected].
- BlockDB sends a Delta Share invitation (e.g.,
blockdb_archive). - Accept the share in Databricks:
- Create a catalog in your workspace to expose the shared tables.
Table Layout
- Each dataset (blocks, transactions, pricing, etc.) appears as a Delta table with the same schema as
/BlockDb.Postgres.Tables.Public. -,_tracing_id,_created_at,_updated_at, and verification columns are preserved. - Change data can be accessed via:
Operational Guidance
- Use Auto Loader or streaming jobs to merge the shared tables into your production catalogs if you need custom partitioning.
- Monitor
_updated_atand compare against Data Freshness commitments. - Keep an eye on Unity Catalog grants to ensure only intended principals can read the shared datasets.
If you also rely on cloud buckets (S3/Azure/GCS), Delta Share can coexist—use it for analytics while buckets feed downstream archival storage.