Azure Event Hubs
An Azure real-time data ingestion service.
591 questions
0 answers
Inconsistencies with Azure Event Hubs and Checkpoints
We are observing inconsistencies in the process of sending events to an event hub, reading events from a Databricks notebook using spark.readStream, and making use of checkpoint to read only the latest records coming to EventHub. While in normal cases,…
asked 2024-01-24T16:54:36.8733333+00:00
Paul Hernandez
631
Reputation points Microsoft Employee
commented 2024-02-01T01:41:40.54+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
28,606
Reputation points Microsoft Employee
1 answer
Azure Eventhub event missing fields in Golang SDK
I am publishing admin activity logs from my subscription to my event hub and then consuming via the golang SDK but the payload is missing key fields including eventDataID - why would this be the case?
asked 2024-01-30T18:31:46.81+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 55.00000000000001%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Sravan
20
Reputation points
answered 2024-01-31T01:17:44.9766667+00:00
PRADEEPCHEEKATLA-MSFT
84,376
Reputation points Microsoft Employee
0 answers
Unable to consume more than the limit
Hi Please find the the EventHub Details below: PricingTier: Standard ThroughputUnit: 40 RetentionPeriod: 7Days EventHub Location: USEast region Consumer Location: Europe region PartitionCount: 32 We are trying to consume as fast as possible from EventHub…
asked 2024-01-23T11:02:19.0266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 54%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Mahendra Sawarkar
40
Reputation points
commented 2024-01-30T11:27:53.35+00:00
Mahendra Sawarkar
40
Reputation points
1 answer
1 MB message limit for Event hub
Hi All, Does anyone has information about the lifting up the restriction for <=1MB message size for the Azure event hub ? My customer has asked me that if Microsoft has plan to remove this limitation.
asked 2024-01-28T13:26:37.8266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 88%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Sharma, Rahul
80
Reputation points
commented 2024-01-30T09:22:15.3866667+00:00
ShaikMaheer-MSFT
38,321
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Recommended library to connect to Azure Event Hubs from a Databricks Notebook
Hi everyone, A customer is using Databricks notebooks to send and receive messages from an Azure Event Hubs. They use batch Spark jobs and not Spark Streaming. They are using the Azure Event Hubs library and asked, if this is the most appropriate…
asked 2024-01-24T15:14:52.7133333+00:00
Paul Hernandez
631
Reputation points Microsoft Employee
accepted 2024-01-25T08:19:28.5433333+00:00
Paul Hernandez
631
Reputation points Microsoft Employee
0 answers
Difference between schema.history and database.history in mysql connector
I set up kafka, mysql and debezium in my computer successfully. However, i have still not understood about the difference between database.history.kafka.topic and schema.history.internal.kafka.topic. Below is my connector: Please help me explaining the…
asked 2024-01-16T13:56:59.92+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 93%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EET%3C/text%3E%3C/svg%3E)
Eddy Tran
40
Reputation points
edited the question 2024-01-25T04:43:02.8633333+00:00
PRADEEPCHEEKATLA-MSFT
84,376
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Does event hub auto create topics if using kafka producer api client
We are currently using spring kafka with Azure HDInsight. We have plans to migrate to Azure event hub and still use kafka api to connect with event hub. Will azure event hubs honor kafka producer's 'auto.create.topics.enable' configuration and topics…
asked 2021-08-11T15:57:51.107+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 44%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERC%3C/text%3E%3C/svg%3E)
Ravi Chandika
21
Reputation points
commented 2024-01-19T16:02:30.0533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 88%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EI%3C/text%3E%3C/svg%3E)
israrsahil
0
Reputation points
0 answers
Unable to connect to event hub using TokenCredential
When attempting to connect to event hub using token credentials I get a timeout from the cancelation token and no response from the event hub service. Sample bellow shows trying to get the event hub properties, I saw the same behavior when trying to send…
asked 2022-07-07T18:55:48.767+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 24%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Madeline Stager
31
Reputation points
commented 2024-01-19T10:43:11.1733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 34%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
Vinay Raj
0
Reputation points
0 answers
Replication of eventhub
how we can replicate eventhub data to another eventhub for high availability using function app(code sample)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 60%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E8%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Information on role of consumer-group in EventHub
Hi I am using standard Azure Library to consume the EventHub. In our case, a single Java application will be consuming the multiple EventHubs at the same time. That means all instances of this application will be consuming all EventHubs mentioned.…
asked 2024-01-05T07:04:17.7066667+00:00
Mahendra Sawarkar
40
Reputation points
commented 2024-01-19T00:35:11.4366667+00:00
PRADEEPCHEEKATLA-MSFT
84,376
Reputation points Microsoft Employee
0 answers
Where can I find list of Login_Failure_Events_Logs (Process ID, SubjectLogonID, TargetUserSid)?
Hi Do you have comprehensive list which can provide me the definition such as below-mentioned? Thanks LogonType ProcessId SubjectLogonId SubjectUserSid SubStatus TargetUserSid
asked 2023-12-18T06:22:50.5533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 63%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYW%3C/text%3E%3C/svg%3E)
Yesleen WONG
0
Reputation points
commented 2024-01-17T03:38:04.2033333+00:00
Yesleen WONG
0
Reputation points
1 answer
Monitor MDM events processing delay(lag) with Azure Event Hubs
We use and rely on Master Data Management (MDM) . At the moment , there are 2 'queues' involved in the MDM landscape at the moment. For these queues, an azure event hub is used. As MDM is an internal system and not mission critical in terms of…
asked 2024-01-11T14:02:38.5766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 9%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVG%3C/text%3E%3C/svg%3E)
Vijayakumar Ganji
101
Reputation points
commented 2024-01-16T18:09:46.3533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,437
Reputation points Microsoft Employee
0 answers
Custom Scale Rule with type azure-eventhub in Azure Container Apps scales up replicas, but never scales down.
Hello Team, Our microservices architecture implemented in Azure Container Apps utilizes Dapr pub/sub for publishing/subscribing to position data events to Azure Event Hubs. A key component is the positions-processing microservice, which scales…
asked 2024-01-10T09:31:40.4966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 43%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Alvin
25
Reputation points
commented 2024-01-15T23:00:12.58+00:00
PRADEEPCHEEKATLA-MSFT
84,376
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to Set up Debezium connector for MySQL
I have a mysql database "testdb" and I want to stream data from "testdb" to Azure Event Hub, I set up everthing following this link https://video2.skills-academy.com/en-us/azure/event-hubs/event-hubs-kafka-connect-debezium and it's worked.…
2 answers
One of the answers was accepted by the question author.
Can't connect TelcoGenerator APP with event hub
I can not connect TelcoGenerator app with event hub.It will shows error like this; ErError on send: One or more errors occurred. …
asked 2022-06-25T05:30:54.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 50%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
kelum senaka
26
Reputation points
edited the question 2024-01-08T06:53:15.3633333+00:00
PRADEEPCHEEKATLA-MSFT
84,376
Reputation points Microsoft Employee
1 answer
Add Event Hub Role to App Registration
Hello, i try to assign my event hub a newly created app registration (for authentiation). I go to the event hub and click on "role assignment", but there i can only assign the "azure event hubs owner" role to some user, NOT to the app…
asked 2023-12-14T12:25:20.9966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 70%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWJ%3C/text%3E%3C/svg%3E)
Walenwein. Jakob
0
Reputation points
commented 2024-01-08T06:39:46.1766667+00:00
PRADEEPCHEEKATLA-MSFT
84,376
Reputation points Microsoft Employee
1 answer
I am unable to provision A azure event hub namespace with identity type set to system assigned.
I am provisioning azure resources including an azure event hub using bicep, but all of a sudden, the pipeline started failing as the event hub provisioning was failing with a timeout error as it takes more than 10 mins to get provisioned, the bicep…
asked 2024-01-03T06:20:36.08+00:00
Tarun Jain
0
Reputation points
accepted 2024-01-08T06:10:19.93+00:00
Tarun Jain
0
Reputation points
2 answers
One of the answers was accepted by the question author.
How to interpret the maximum message size of Azure Event Hubs
The Event Hubs FAQ section states that the maximum message size of the standard tier Event Hubs is 1MB. I'd like to know if this is actually in MiB, so 1,048,576 bytes or if it's using factor 1000, so 1,000,000 bytes. And I'd like to know if all meta…
asked 2021-05-11T07:48:14.57+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 79%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVP%3C/text%3E%3C/svg%3E)
Vorbach, Paul
26
Reputation points
commented 2024-01-05T08:52:03.3466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 83%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Anita A
105
Reputation points
2 answers
Need to pull azure event hub data into local API through event grid
Hi, I am looking for a solution to retrieve data from event hub to local app through event grid. Basic flow : 1)Push dummy data to event hub and capture data 2)Read those captured data through event grid 3)retrieve the captured data from event grid…
asked 2023-12-21T12:05:35.1+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 49%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rajesh Kumar Sinha
0
Reputation points
commented 2024-01-04T07:27:30.2+00:00
AnnuKumari-MSFT
31,816
Reputation points Microsoft Employee
1 answer
what's the calculation logic of "Number of non-epoch receivers per consumer group"
as we all know that the quota limit of "Number of non-epoch receivers per consumer group" is 5 (https://video2.skills-academy.com/en-us/azure/event-hubs/event-hubs-quotas#common-limits-for-all-tiers ), so how can we know how many receivers we've used…
asked 2023-12-29T11:07:31.71+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 7.000000000000001%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EG2%3C/text%3E%3C/svg%3E)
Gallatin 21V
186
Reputation points
commented 2024-01-04T07:26:40.67+00:00
AnnuKumari-MSFT
31,816
Reputation points Microsoft Employee