Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
We are not getting data in azure data lake Service v2 storage's container.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 90%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
DNT
0
Reputation points
Hello,
We are getting data in the Azure event hub sink through the POSTGRES SQL database but we are not getting files in the container which we have configured in an ADLS GEN 2 and while configuring we have an encounter that we are using a free subscription of VISUAL STUDIO not the enterprise edition.
Thank you.
{count} votes
-
PRADEEPCHEEKATLA-MSFT 83,966 Reputation points Microsoft Employee2024-05-30T10:34:28.9233333+00:00 @DNT - Thanks for the question and using MS Q&A platform.
Can you please provide more information about the configuration you have done for the ADLS Gen2 and the Event Hub sink? Also, can you confirm if you have followed the steps mentioned in the documentation for configuring the job to capture data?
Meanwhile, checkout Capture events through Azure Event Hubs in Azure Blob Storage or Azure Data Lake Storage.
Looking forward for your response.
-
DNT 0 Reputation points
2024-05-30T13:51:54.5266667+00:00 Actually, we trying from this blog https://video2.skills-academy.com/en-us/azure/stream-analytics/event-hubs-parquet-capture-tutorial and we have provide same step whatever this blog has said.
Thank you
-
DNT 0 Reputation points
2024-05-30T13:56:42.6133333+00:00 Good Morning @PRADEEPCHEEKATLA-MSFT
-
DNT 0 Reputation points
2024-05-31T12:10:15.4466667+00:00 @PRADEEPCHEEKATLA-MSFT , now i'm able to store than if i'm providing all thing in json but i want in parquet manner in container but for that i'm having error in that.
so can you help with this?
-
PRADEEPCHEEKATLA-MSFT 83,966 Reputation points Microsoft Employee
2024-06-03T06:19:25.91+00:00 @DNT - I agree that this issue looks strange and I wasn't able to reproduce this issue. If you have a support plan could you please file a support ticket for deeper investigation and do share the SR# with us?
-
DNT 0 Reputation points
2024-06-03T07:43:29.23+00:00 , I don't think that we required a deeper investigation for this single error. you can suggest us simply like what is this error is about and what to do when it's occuring?
-
PRADEEPCHEEKATLA-MSFT 83,966 Reputation points Microsoft Employee
2024-06-03T08:59:14.3633333+00:00 @DNT - The error message you are seeing indicates that there is a null reference found during serialization due to variable schema. This error can occur when the schema of the data being serialized is not properly defined or is not being passed correctly.
To resolve this issue, you can try the following steps:
Check the schema of the data being serialized and ensure that it is properly defined. You can refer to the documentation for more information on defining schemas for data in Azure Event Hubs.
Ensure that the schema is being passed correctly to the serialization process. You can check the code for any issues related to passing the schema.
If the issue persists, you can try using a different serialization format such as JSON or CSV to see if the issue is specific to the Parquet format.
If none of these steps resolve the issue, please provide more information about the code and configuration you are using so that I can assist you better.
-
PRADEEPCHEEKATLA-MSFT 83,966 Reputation points Microsoft Employee
2024-06-06T07:08:00.7066667+00:00 @DNT - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Sign in to comment