Skip to main content

Release notes — MDMongoose 0.1

· 2 min read
MDMongoose team
MDMongoose team
Builders of MDMongoose

The first public release of MDMongoose. Deploy it with the bundle and run mdm_init once.

Highlights​

  • One hierarchy in one Delta table (MDMNodes), clustered by the tree path so every branch is a contiguous range of files.
  • Databricks App with a three-level hierarchy, grouped properties, action boxes and dialogs.
  • Edit Children grid: explode up to three levels, copy and paste with Excel, server-side sort and filters, undo and redo, one-transaction saves.
  • Incremental loading from Delta tables with change data feed: AUTO CDC with expectations in the mdm_load pipeline, then a set-based Spark MERGE of only the new changes.
  • Golden records with match keys, fuzzy name matching and per-property survivorship (source priority, most recent, custom Python functions), with a dry run.
  • Exports to CSV and Excel from the app; materialized views, a lookup index and SCD2 history from the mdm_export pipeline.
  • Permissions with Unity Catalog groups and Steward lists, edited in one table with a live preview.

Performance​

  • Every list loads 40 rows at a time with Load next 40.
  • Visited levels and the properties of the rows on screen are cached and preloaded in batches, so navigation is instant; the app refreshes in the background.

Demo data​

With demo = "true", mdm_init creates 1 000 customers from three sources, 200 suppliers from two, 300 employees from Workday and Active Directory, and a six-level product hierarchy with 50 products.

Upgrading​

This is the first release — deploy the bundle and run mdm_init. See Deployment.