Looking for equivalent functionality between dmt and dtui - importing data with id field from JSON into Azure Cosmos

Matthew Hooper 0 Reputation points
2024-06-12T09:06:31.73+00:00

We've started to use the Azure data migration tool since TLS 1.2 support is no longer available in the old Azure documentdb migration tool (DTUI last version 1.83).

What we're having issues with, and can't find clarifying documentation on, is when dealing with the id field in JSON data that we're attempting to import.

Does anyone know what the equivalent configuration is for the Azure data migration tool? (Source is JSON, destination is Azure Cosmos DB).

Example: old DTUI configuration that works:

User's image

DMT:

And in Cosmos Explorer for working record (imported after removing id field):

User's image

The dmt utility doesn't like the existing id field in the JSON data from the source system and trying different settings in the sinksettings JSON like changing PreserveMixedCaseIds doesn't appear to make a difference. The Cosmos Explorer screenshot is how we would expect the data to look when importing using the old DTUI tool as the partition information is correct and the id field has been auto-populated.

The old DTUI tool handles the JSON fine, but without removing the id field from the records, the dmt runs as follows against the Azure Cosmos DB emulator.

User's image

Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,520 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Mark Brown - MSFT 2,766 Reputation points Microsoft Employee
    2024-06-17T17:23:28.5466667+00:00

    I'm assuming you are using the community supported Data migration tool here, https://github.com/azurecosmosdb/data-migration-desktop-tool

    For configuration values to use Cosmos DB NoSQL API as a sink see here, https://github.com/AzureCosmosDB/data-migration-desktop-tool/blob/main/Extensions/Cosmos/README.md#sink

    This tool is community supported, please direct any questions about this tool to the GitHub issues on that repo.

    Thanks.