Release notes — MDMongoose 0.1
· 2 min read
The first public release of MDMongoose. Deploy it with the bundle and run mdm_init once.
Highlights
- One hierarchy in one Delta table (
MDMNodes), clustered by the tree path so every branch is a contiguous range of files. - Databricks App with a three-level hierarchy, grouped properties, action boxes and dialogs.
- Edit Children grid: explode up to three levels, copy and paste with Excel, server-side sort and filters, undo and redo, one-transaction saves.
- Incremental loading from Delta tables with change data feed: AUTO CDC with expectations in the
mdm_loadpipeline, then a set-based SparkMERGEof only the new changes. - Golden records with match keys, fuzzy name matching and per-property survivorship (source priority, most recent, custom Python functions), with a dry run.
- Exports to CSV and Excel from the app; materialized views, a lookup index and SCD2 history from the
mdm_exportpipeline. - Permissions with Unity Catalog groups and Steward lists, edited in one table with a live preview.
Performance
- Every list loads 40 rows at a time with Load next 40.
- Visited levels and the properties of the rows on screen are cached and preloaded in batches, so navigation is instant; the app refreshes in the background.
Demo data
With demo = "true", mdm_init creates 1 000 customers from three sources, 200 suppliers from two, 300
employees from Workday and Active Directory, and a six-level product hierarchy with 50 products.
Upgrading
This is the first release — deploy the bundle and run mdm_init. See Deployment.