Spark Connector in ADF

Mounica 1 Reputation point
2020-06-19T16:53:27.433+00:00

Hi, I have created a spark connector to connect to azure data bricks. In copy activity source is spark connector and sink is Azure SQL DB. In spark Connector query, CreatedDate is being converted to String and throwing error where as it is timestamp column.

How to copy timestamp columns from spark to azure sql.

10310-issue.png

{
"errorCode": "2200",
"message": "Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][Support] (50130) Conversion from number to string failed due to undersized character buffer.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][Support] (50130) Conversion from number to string failed due to undersized character buffer.,Source=Microsoft Spark ODBC Driver,'",
"failureType": "UserError",
"target": "CopyData",
"details": []
}

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,045 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
{count} votes