Azure synapse link creates model.json with no partitions

Dipo Onibile 0 Reputation points
2024-06-25T19:12:57.98+00:00

Hi,

 

I am following this link below to copy dataverse data to Azure SQL DB using azure data factory pipelines. The model.json file created by my synapse link for dataverse is correctly creating the schema and attribute names for all the tables/entities. However, no data is coming across in the pipeline because the model.json file is not updated with partition location for any of the entities.

 

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,613 questions
Dynamics 365 Training
Dynamics 365 Training
Dynamics 365: A Microsoft cloud-based business platform that provides customer relationship management and enterprise resource planning solutions.Training: Instruction to develop new skills.
67 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. phemanth 7,835 Reputation points Microsoft Vendor
    2024-06-26T04:37:58.38+00:00

    @Dipo Onibile

    Welcome to Microsoft Q&A platform and thanks for posting your question.

    It seems like you’re facing an issue with the model.json file not being updated with the partition location for the entities. This could be due to formatting issues of the partition location path in the model.json file. Here are the steps you can follow to fix this issue:

    1. Open the model.json file in a text editor.
    2. Find the partitions.Location property.
    3. Change "blob.core.windows.net" to "dfs.core.windows.net".
    4. Fix any "%2F" encoding in the URL to "/".

    Please note that the model.json file in a Common Data Model folder describes the data in the folder, metadata and location, as well as how the file was generated and by which data producer. The partitions.Location property in the model.json file is crucial as it provides the location of the data files.

    If you continue to face issues, I recommend checking out these resources:

    These resources provide detailed steps on how to copy data from Dataverse to Azure SQL using Azure Data Factory and might help you troubleshoot

    Hope this helps. Do let us know if you any further queries.

    0 comments