Accelerate time to insights with data in Delta Lake format
Important
Some of the functionality described in this release plan has not been released. Delivery timelines may change and projected functionality may not be released (see Microsoft policy). Learn more: What's new and planned
| Enabled for | Public preview | General availability |
|---|---|---|
| Admins, makers, marketers, or analysts, automatically | Nov 2024 | Feb 2025 |
Business value
Your customer data grows constantly with rapidly changing signals like online activities and mobile interactions. As the data set grows, reprocessing of the data takes longer, slowing your ability to respond to changes, and providing increasingly stale insights. With native support for the Delta Lake data format in Customer Insights - Data, you can now accelerate the time to unify customer data by processing just the incremental changes to your data, allowing you to get results quicker and engage customers with the most up-to-date and timely insights.
Feature details
One of the key values of the Delta Lake format is the ability to track changes over time to the data. With native support for the Delta Lake table format in Customer Insights, you can now take advantage of Delta Lake incremental data updates to accelerate processing in Customer Insights - Data.
It's typical for customer profile data to change only by a few percentages each day. Instead of reprocessing the entire data set every day, Customer Insights - Data can process just the changed source data for unification in the Delta format, saving time and getting you results faster. This improvement happens automatically when all the tables are in the Delta format. No configuration or change is required.
Incremental processing of segments, measures, activities, and predictions is planned to be added in the coming months.
Note
In this release, incremental unification requires that all source tables included in the unification process use the Delta format. Tables ingested to Customer Insights - Data using the Delta Lake connector and the Dataverse connector will be in the Delta format.