Loading Dynamics CDM with Azure Data Factory (@entityReference)

VENGALA Sreedhar 101 Reputation points
2020-11-16T00:25:44.6+00:00

Using Azure Data Factory to Sink to Dynamics Common Data Model.

Source: Reading from MySQL 

Col1: dpp_authorityid  
Col2: dpp_acitivitygroup

Destination - CDM - dpp_authority 

Col1: dpp_authorityid  
Col2: dpp_acitivitygroup (this is Lookup Column in Dynamics to dpp_authoritygroup )

40227-image.png

40188-image.png 40000-image.png

Fails when mapping in ADF is: 

Src.dpp_authorityid-----------> Dst.dpp_authorityid  
Src.dpp_acitivitygroup ----------> Dst.dpp_acitivitygroup

Error: 

Failure happened on 'Sink' side. ErrorCode=DynamicsOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Dynamics operation failed with error code: -2147220989, error message: Incorrect attribute value type System.String.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,''Type=System.ServiceModel.FaultException`1[[Microsoft.Xrm.Sdk.OrganizationServiceFault, Microsoft.Xrm.Sdk, Version=9.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35]],Message=The creator of this fault did not specify a Reason.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,'

followed the docs @ https://video2.skills-academy.com/en-gb/azure/data-factory/connector-dynamics-crm-office-365#writing-data-to-a-lookup-field and updated the mappings as below: 

Src.dpp_authorityid -----------> Dst.dpp_authorityid  
Src.dpp_acitivitygroup ----------> Dst.dpp_acitivitygroup@EntityReference

This works and inserts a record into destination table, but didn't populate the column Dst.dpp_acitivitygroup with the value

Any Clues..

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,568 questions
Accepted answer
  1. VENGALA Sreedhar 101 Reputation points
    2020-11-18T22:40:03.127+00:00

    Raised support Ticket with Microsoft and the reply is as below.

    Product group said this is known type conversion issue.
    Product group are actively deploying the fix. Current ETA is Nov 22 but may change.

    Workaround is:

    In Copy sink's json property add "EnableFullSchemaForEntity": true

    "sink": {
    "type": "DynamicsSink",
    "writeBatchSize": 10,
    "writeBehavior": "upsert",
    "ignoreNullValues": false,
    "EnableFullSchemaForEntity": true
    }

    It works now!!!

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.