Unexpected error occurred when transferring data into blob: Unable to create Azure Blob container.

Noveen Haseeb 0 Reputation points
2024-06-12T06:10:40.9566667+00:00

One of our SSIS ML jobs loads data from on-prem database tables to Azure Blob container as csv files (these csv files are fed into Machine Learning scoring models as part of the same job).

We get the following error when the job tries to load the csv file to the Azure Blob container. We have 4 csv files that get uploaded into Blob one by one. The first file gets created but the job fails when trying to load the 2nd csv file into Azure. This issue has been happening in UAT/PROD since May 21. We have got this issue occasionally in Dev and SYST but job runs later during day/night the job successfully in Dev/Syst (still fails at a different time in UAT/PROD).

 

|df_ML2TrainandScore:Error: ab_dst_ML2TrainandScore failed
the post-execute phase and returned error code 0x80131500.| | -------- | |df_ML2TrainandScore:Error: ab_dst_ML2TrainandScore failed the post-execute phase and returned error code 0x80131500.| |df_ML2TrainandScore:Error: System.Exception: One or more errors occurred. Please check the previous logs and retry.    at Microsoft.SqlServer.IntegrationService.CloudComponents.Destination.AzBlobDest.PostExecute()    at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPostExecute(IDTSManagedComponentWrapper100 wrapper)| |df_ML2TrainandScore:Error: Unexpected error occurred when transferring data into blob: Unable to create Azure Blob container. Endpoint: https://testworkspacestorage.blob.core.windows.net/, Container Name: test-ml-in.|

 

** df_ML2TrainandScore – this is the SSIS data flow task that is showing error when transferring data into Azure Blob.

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,614 questions

4 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Nehruji R 4,451 Reputation points Microsoft Vendor
    2024-06-13T06:11:33.4166667+00:00

    Hello Noveen Haseeb,

    Greetings! Welcome to Microsoft Q&A Platform.

    I understand that when you upload the csv files to Blob storage via SSIS ML jobs which loads data from on-prem database tables to Azure Blob container you are getting the error message "Unexpected error occurred when transferring data into blob: Unable to create Azure Blob container. Endpoint" Below are some considerations to check and resolve the issue,

    Ensure that your SSIS environment is configured to use correct TLS version and you have added the registry keys to enable TLS version accordingly and restart your SSIS service after making these changes. Refer - https://video2.skills-academy.com/en-us/sql/integration-services/azure-feature-pack-for-integration-services-ssis?view=sql-server-ver15#use-tls-12

    Make sure you have the necessary permissions to upload content to the BLOB. Check the access control settings for your BLOB storage account.

    Verify the firewall settings on the storage account are blocking access to the container. You can check the firewall settings on the storage account and ensure that your IP address is whitelisted.

    Check if the SAS token you are using to authenticate has expired. You can generate a new SAS token and update the connection manager in SSIS to use the new token.

    refer - https://video2.skills-academy.com/en-us/azure/architecture/data-science-process/move-data-to-azure-blob-using-ssis for configurations.

    Similar thread for reference - https://stackoverflow.com/questions/65713694/cant-upload-files-to-azure-storage-using-ssis, https://stackoverflow.com/questions/10905044/ssis-transfer-database-task-cryptic-error-message-0x80131500

    Hope this answer helps! Please let us know if you have any further queries. I’m happy to assist you further.

    Please "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    0 comments
  2. Noveen Haseeb 0 Reputation points
    2024-06-13T15:20:47.9+00:00

    Thanks so much for the reply. This issue is really critical on our side as this job has been running without any issues for the last 4-5 years and started failing all of a sudden. For TLS, its version 1.0. Does it need to be updated to TLS 1.2?

  3. Noveen Haseeb 0 Reputation points
    2024-07-03T21:36:47.67+00:00

    We have the MS SQL SERVER 2016 feature pack for Azure already installed on the SSIS server v13.1.8.

    Performed following changes:

    Update TLS version of Azure storage to TLS1.2. The TLS version used by Azure Feature Pack follows system .NET Framework settings. To use TLS 1.2, add a REG_DWORD value named SchUseStrongCrypto with data 1 under the following two registry keys.

    1. HKEY_LOCAL_MACHINE\SOFTWARE\WOW6432Node\Microsoft\.NETFramework\v4.0.30319
    2. HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\.NETFramework\v4.0.30319

    The whole process runs without any issues on local Visual Studio but still fails to load data to Azure Blob when running the job on SSIS server. It has been running fine for the last 6 years and failed all of a sudden.

  4. Noveen Haseeb 0 Reputation points
    2024-07-17T16:31:12.24+00:00

    Worked fine after installing following on the SSIS Server:

    Install Microsoft .NET Framework 4.7.2 (which is a pre-requisite of MS SQL Server 2016 Feature Pack v13.1.21).

    Install MS SQL Server 2016 Feature Pack v13.1.21 (upgrade from v13.1.8 to v13.1.21)

    0 comments