Issue with resourceFiles Property in Azure Data Factory Pipeline: "Total size of resourceFiles is using 141% of available space after processing"

Sandeep Kumar Valluri 0 Reputation points
2024-08-27T12:51:25.7833333+00:00

Hello,

I'm encountering an issue with Azure Batch related to the resourceFiles property in one of my pipelines. Despite verifying that the File Storage Size in the associated App Service Plan is only 7% of the available 10 GB, I'm receiving an error indicating that the total size of resourceFiles is using 141% of the available space after processing.

Here are the details of the error:

  • Error Code: InvalidPropertyValue
  • Error Message: "The value provided for one of the properties in the request body is invalid."
  • Batch Error Code: InvalidPropertyValue
  • Batch Error Message: "Total size of resourceFiles is using 141% of available space after processing."
  • Effective Integration Runtime: AutoResolveIntegrationRuntime

Could someone help me understand why this error is occurring despite the low storage usage and how I can resolve this issue?

Thank you!

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,890 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
329 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Pinaki Ghatak 3,905 Reputation points Microsoft Employee
    2024-08-28T16:18:18.6433333+00:00

    Hello @Sandeep Kumar Valluri

    The error message you received indicates that the total size of resourceFiles is using 141% of the available space after processing, even though you have verified that the File Storage Size in the associated App Service Plan is only 7% of the available 10 GB.

    This error can occur if the total size of the resourceFiles property exceeds the available space in the storage account. Even though the storage account may have enough space, the resourceFiles property may be using more space than expected due to the way it is processed.

    To resolve this issue, you can try reducing the size of the resourceFiles property by removing unnecessary files or compressing them. You can also try increasing the available space in the storage account by upgrading the App Service Plan or creating a new storage account with more space.

    This should help you.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.