Synapse Link Question

Kieran Patrick Wood 0 Reputation points
2024-07-08T10:32:23.4033333+00:00

Hi,

Reference ... https://video2.skills-academy.com/en-us/power-apps/maker/data-platform/azure-synapse-link-pipelines?tabs=synapse-analytics

The population of the Data Lake from Dataverse appears successful overall. However, I have increased the incremental refresh interval to 24 hours since the load took several hours.

 

The ADF trigger did not execute as expected so I attempted to execute the trigger manually. However I received the following error …

 

Operation on target SetupProcessingLog failed: Operand data type varchar is invalid for divide operator.

Operand data type varchar is invalid for divide operator.

 

User's image

Any thoughts?

 

 

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,681 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Amira Bedhiafi 24,531 Reputation points
    2024-07-08T13:27:35.77+00:00

    When you read the message you can have the answer since it seems like a column of type varchar (string) is being used where a numeric data type is expected for division.

    You might cast a varchar column to a numeric type in SQL:

    
    SELECT 
    
        column1,
    
        column2,
    
        CAST(varchar_column AS float) AS numeric_column
    
    FROM 
    
        your_table
    
    

    If the division operation is part of a SQL query, ensure all operands are numeric:

    
    SELECT 
    
        column1 / CAST(varchar_column AS float) AS result
    
    FROM 
    
        your_table
    

    If you're using ADF Data Flow, you can add a Derived Column transformation to cast the varchar column to a numeric type:

    1. Derived Column Transformation:
      • Add a Derived Column transformation to your data flow.
      • Create a new column or replace the existing one with the cast expression, e.g., toFloat(varchar_column).
    2. Perform the Division Operation:
      • Use the newly cast column in your arithmetic operations.

  2. Kieran Patrick Wood 0 Reputation points
    2024-07-11T09:21:58.3833333+00:00

    Thank you @Amira Bedhiafi ,
    My question is about getting the Synapse Line pipeline template to work as reference ... https://video2.skills-academy.com/en-us/power-apps/maker/data-platform/azure-synapse-link-pipelines?tabs=synapse-analytics

    I have not changed the original design of this template. I need help from someone who has used this template recently, successfully ...
    User's image

    I should not have to change the design of the template package to get it working, only change how it is configured.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.