585 questions with Azure Event Hubs tags

Sort by: Updated
Updated Created Answers
0 answers

How to fix TopicAuthorizationException while connecting eventhub with kafka streams

We are trying to use apache kafka streams to process messages from azure event hub .While using aggregations , kafka internally creating internal topics and we are getting TopicAuthorizationException and it says could not create topic . Is it something…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-02-22T13:55:08.16+00:00
A S, Ajay (893) 5 Reputation points
commented 2024-02-28T23:00:48.2933333+00:00
QuantumCache 20,186 Reputation points
0 answers

Copy data from EventHub to CosmosDB with 408 error

Hi, I need a clarification about this discussion. I have a function with these features (Event Hubs trigger and Cosmos DB output binding). Randomly, I obtain 408 error with the following diagnostic info { "Summary": { …

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,514 questions
asked 2024-02-16T15:27:48.96+00:00
Francesco Cesareo 56 Reputation points
edited the question 2024-02-28T14:24:24.5033333+00:00
MayankBargali-MSFT 69,941 Reputation points
1 answer

About Event Hub Ingress Bytes metric

Hi everyone, I just ran an experiment using ADLS, Event Hubs and Functions. Basically, a shell script uploads file to ADLS (CSV), then a Functions executes transforming it to JSON,to finally push it to Event Hubs. Everything is right so far. I build a…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-02-23T16:36:12.03+00:00
Jona 455 Reputation points
edited the question 2024-02-28T14:20:40.1333333+00:00
MayankBargali-MSFT 69,941 Reputation points
3 answers One of the answers was accepted by the question author.

Azure Function EventHub Trigger and CosmosDB Output in Python

Hi, I'm trying to write a Azure Function in Python which accepts messages from an EventHub and puts them into a CosmosDB. I've tried with the following basic example code but it doesnt work. As soon as I add the binding for the cosmos db, the function is…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,552 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,514 questions
asked 2024-02-26T10:45:30.5133333+00:00
Lukas Reber 20 Reputation points
accepted 2024-02-27T11:51:43.8633333+00:00
Lukas Reber 20 Reputation points
0 answers

Validate using an Json schema when streaming events using Event Hubs .NET SDKs

Hello Team, Do you have Validate using an Json schema when streaming events using Event Hubs .NET SDKs with FIFO method? Url :- https://video2.skills-academy.com/en-us/azure/event-hubs/schema-registry-dotnet-send-receive-quickstart Thank you Vikas

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-02-22T09:43:24.3633333+00:00
Vikas Salve (MBS MT) 0 Reputation points
commented 2024-02-26T22:38:21.5733333+00:00
BhargavaGunnam-MSFT 28,526 Reputation points Microsoft Employee
1 answer

Can't connect to event hub from external machine. Connection setup timeout

Hi, I have a Apachel Camel application with a route to produce and another route to consume from Event Hub. I'm using kafka connector and it was working fine. Recently new servers were created but I can't make it work on new servers. We get the following…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-02-23T21:29:01.1+00:00
BERENGER, RENAN 0 Reputation points
answered 2024-02-24T03:35:49.3333333+00:00
QuantumCache 20,186 Reputation points
1 answer One of the answers was accepted by the question author.

best approach to get telemetry data for 'in real time' analysis in Power BI and create historical data at the same time

Hi, my plan is to collect telemetry data from a KQL DB stored in ADX, currently the service is retaining the data for only 30 days and my plan is to create a long retention for at least 2 years and at the same time have dashboards of the current…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,612 questions
asked 2024-02-14T07:08:15.71+00:00
Gustavo Adolfo Alemán Sánchez 40 Reputation points
accepted 2024-02-20T18:50:27.8766667+00:00
Gustavo Adolfo Alemán Sánchez 40 Reputation points
1 answer

How to fix InternalServerError when creating Private Endpoint using Terraform.

Hi, we are using terraform to create our infrastructure in Azure. Unfortunately sometimes we are facing problems when creating Private Endpoint for EvenhHub namespace: API…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Private Link
Azure Private Link
An Azure service that provides private connectivity from a virtual network to Azure platform as a service, customer-owned, or Microsoft partner services.
483 questions
asked 2023-12-19T09:57:49.0366667+00:00
Kosewski, Krzysztof (Nokia - PL/Wroclaw) 10 Reputation points
answered 2024-02-14T08:57:24.58+00:00
Kosewski, Krzysztof (Nokia - PL/Wroclaw) 10 Reputation points
0 answers

Unable to poll more than 5 consumer records at once from Azure EventHub using KafkaConsumer

Below are my Kafka Consumer properties I am using while consuming the EventHub: kafkaProps.put(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class.getName()); kafkaProps.put(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG,…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-01-30T13:53:03.09+00:00
Mahendra Sawarkar 40 Reputation points
commented 2024-02-09T07:45:34.4966667+00:00
QuantumCache 20,186 Reputation points
1 answer

How can i capture events in avro from eventhub as per the my specific schema i.e .avsc and not in a manner where i get body as bytes.

as i capture events from event hub as acro files i get the data as per below schema { "type" : "record", "name" : "EventData", "namespace" : "Microsoft.ServiceBus.Messaging", …

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,862 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-02-07T07:08:52.3666667+00:00
Junaid Nazir 5 Reputation points
answered 2024-02-07T21:16:18.6366667+00:00
BhargavaGunnam-MSFT 28,526 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

App Functions & Event Hub: Quotas & Limits

Hi everyone do you know what the quotas and limits are on functions? I need to provision about 120 Functions on a Isolated V2 App Service environment. I've been reading this, but I've not been able to understand very well, specially when unbouded is…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,552 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-01-22T21:12:28.66+00:00
Jona 455 Reputation points
accepted 2024-02-07T14:46:03.73+00:00
Jona 455 Reputation points
2 answers One of the answers was accepted by the question author.

How to move data from event hub to cosmos db

How to move data from event hub to cosmos db? Which services we need to use for doing this?

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,552 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,514 questions
asked 2023-03-20T05:25:50.02+00:00
Chandrakant Pawle 81 Reputation points
answered 2024-02-07T11:22:20.55+00:00
Francesco Cesareo 56 Reputation points
1 answer One of the answers was accepted by the question author.

Clarifying High Availability: Event Hub and Function App Integration Strategies

We have some confusion between the documentation for Event Hubs and Function Apps regarding High Availability (HA). Let me clarify. In the Event Hubs documentation, it suggests that in case of failover, the secondary (backup) region's Event Hub will…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,552 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-01-19T14:20:15.38+00:00
87592231 65 Reputation points
edited a comment 2024-02-02T10:17:15.76+00:00
MayankBargali-MSFT 69,941 Reputation points
1 answer

Why are booleans in Stream Analytics sample outputs getting converted into 0's and 1's?

When using the data sampler available from Event Hubs -> namespace -> Process Data, and running the default sample query, we've recently noticed that values that would previously show as booleans are now converting into 0 or 1 in the…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
342 questions
asked 2024-01-30T21:04:59.7766667+00:00
John Barhorst 0 Reputation points
commented 2024-02-01T01:59:26.0166667+00:00
PRADEEPCHEEKATLA-MSFT 83,966 Reputation points Microsoft Employee
0 answers

Inconsistencies with Azure Event Hubs and Checkpoints

We are observing inconsistencies in the process of sending events to an event hub, reading events from a Databricks notebook using spark.readStream, and making use of checkpoint to read only the latest records coming to EventHub. While in normal cases,…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
asked 2024-01-24T16:54:36.8733333+00:00
Paul Hernandez 631 Reputation points Microsoft Employee
commented 2024-02-01T01:41:40.54+00:00
BhargavaGunnam-MSFT 28,526 Reputation points Microsoft Employee
1 answer

Azure Eventhub event missing fields in Golang SDK

I am publishing admin activity logs from my subscription to my event hub and then consuming via the golang SDK but the payload is missing key fields including eventDataID - why would this be the case?

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-01-30T18:31:46.81+00:00
Sravan 20 Reputation points
answered 2024-01-31T01:17:44.9766667+00:00
PRADEEPCHEEKATLA-MSFT 83,966 Reputation points Microsoft Employee
0 answers

Unable to consume more than the limit

Hi Please find the the EventHub Details below: PricingTier: Standard ThroughputUnit: 40 RetentionPeriod: 7Days EventHub Location: USEast region Consumer Location: Europe region PartitionCount: 32 We are trying to consume as fast as possible from EventHub…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-01-23T11:02:19.0266667+00:00
Mahendra Sawarkar 40 Reputation points
commented 2024-01-30T11:27:53.35+00:00
Mahendra Sawarkar 40 Reputation points
1 answer

1 MB message limit for Event hub

Hi All, Does anyone has information about the lifting up the restriction for <=1MB message size for the Azure event hub ? My customer has asked me that if Microsoft has plan to remove this limitation.

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
asked 2024-01-28T13:26:37.8266667+00:00
Sharma, Rahul 80 Reputation points
commented 2024-01-30T09:22:15.3866667+00:00
ShaikMaheer-MSFT 38,321 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Recommended library to connect to Azure Event Hubs from a Databricks Notebook

Hi everyone, A customer is using Databricks notebooks to send and receive messages from an Azure Event Hubs. They use batch Spark jobs and not Spark Streaming. They are using the Azure Event Hubs library and asked, if this is the most appropriate…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
asked 2024-01-24T15:14:52.7133333+00:00
Paul Hernandez 631 Reputation points Microsoft Employee
accepted 2024-01-25T08:19:28.5433333+00:00
Paul Hernandez 631 Reputation points Microsoft Employee
0 answers

Difference between schema.history and database.history in mysql connector

I set up kafka, mysql and debezium in my computer successfully. However, i have still not understood about the difference between database.history.kafka.topic and schema.history.internal.kafka.topic. Below is my connector: Please help me explaining the…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
585 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
342 questions
asked 2024-01-16T13:56:59.92+00:00
Eddy Tran 40 Reputation points
edited the question 2024-01-25T04:43:02.8633333+00:00
PRADEEPCHEEKATLA-MSFT 83,966 Reputation points Microsoft Employee