Azure Digital Twin bulk import job can't handle file with size over 10MB.

Hukivskyi, Bohdan 0 Reputation points
2024-06-14T08:40:23.8333333+00:00

I can upload files up to 10MB in size to ADT via Import Job API without any problems, but if the file is larger than 10MB I get a strange error: "Each row must be a valid JSON string. Invalid line: }\r.". The file format is correct, just if its size exceeds 10 MB - the problem arises, if I delete a couple of random lines to make the size smaller 10MB - everything works correctly.

Azure Digital Twins
Azure Digital Twins
An Azure platform that is used to create digital representations of real-world things, places, business processes, and people.
224 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Sander van de Velde | MVP 31,106 Reputation points MVP
    2024-06-14T09:33:12.89+00:00

    Hello @Hukivskyi, Bohdan,

    welcome to this moderated Azure community forum.

    It seems you hit some limit in the service.

    This can either be a hard (technical) limit or a soft limit (Microsoft made some decision for customers).

    Soft limits are normally not a problem for most customers but Microsoft is very interested in edge cases and special usecases.

    I suggest creating a support ticket where you explain why you need this limitation to be lifted (if possible).

    If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. All community members with similar issues will benefit by doing so. Your contribution is highly appreciated.