Add Amazon Kinesis Data Streams as source in Real-Time hub (preview)

  • Article

This article describes how to add Amazon Kinesis Data Streams as an event source in Fabric Real-Time hub.

Note

Real-Time hub is currently in preview.

Prerequisites

  • Get access to the Fabric premium workspace with Contributor or above permissions.
  • An Amazon Web Services (AWS) account with the Kinesis Data Streams service enabled.

Launch Add source experience

  1. Sign in to Microsoft Fabric.

  2. Select Real-Time hub on the left navigation bar.

  3. On the Real-Time hub page, select + Add source in the top-right corner of the page.

    Screenshot that shows how to launch Real-Time hub In Microsoft Fabric.

Add Amazon Kinesis Data Streams as a source

  1. On the Select a data source screen, select Kinesis Data Streams.

    A screenshot of selecting Kinesis Data Streams.

  2. On the Connect screen, to create a connection, select New connection.

    Screenshot that shows the Connect page with the New connection highlighted.

  3. In the Connection settings section, for Data Stream name, enter the data stream name from Amazon Kinesis.

    A screenshot of the Amazon Kinesis data stream screen.

  4. In the Connection credentials section, do these steps.

    1. For Connection name, enter a name for this cloud connection.

    2. For Authentication kind, confirm that Kinesis key is selected.

    3. For API Key and API Secret, enter the credentials you use to access your Kinesis Data Stream. Go to the Amazon IAM console and select Security credentials. Copy an Access Key ID from the Access keys screen and paste it into API Key and API Secret.

      A screenshot of how to access the AWS Kinesis security credentials.

    4. Select Connect.

      A screenshot of the Connect screen.

  5. Now, on the Connect page, for Source name, enter a source name for this new eventstream source.

  6. Scroll down, and under Configure Amazon Kinesis data source, enter a Region for the data source. You can find the Amazon region code such as us-west-2 from the Kinesis Data stream summary.

    A screenshot of the Region field for Configure Amazon Kinesis data source.

  7. In the Stream details section of the right pane, do these steps:

    1. Select the workspace where you want to save the connection.
    2. Enter a name for the eventstream to be created for you.
    3. Name of the stream for Real-Time hub is automatically generated for you.

  8. Select Next.

  9. On the Review and create screen, review the summary, and then select Create source.

View data stream details

  1. On the Review and create page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected Confluent Cloud Kafka source. To close the wizard, select Close at the bottom of the page.
  2. In Real-Time hub, select All data streams. To see the new data stream, refresh the All data streams page. For detailed steps, see View details of data streams in Fabric Real-Time hub.

Related content

To learn about consuming data streams, see the following articles: