Add Amazon Kinesis Data Streams source to an eventstream (preview)

  • Article

This article shows you how to add Amazon Kinesis Data Streams source to an eventstream.

Amazon Kinesis Data Streams is a massively scalable, highly durable data ingestion and processing service optimized for streaming data. By integrating Amazon Kinesis Data Streams as a source within your eventstream, you can seamlessly process real-time data streams before routing them to multiple destinations within Fabric.

Important

Enhanced capabilities of Fabric event streams are currently in preview.

Note

This source is not supported in the following regions of your workspace capacity: West US3, Switzerland West.

Prerequisites

  • Access to the Fabric premium workspace with Contributor or higher permissions.
  • An Amazon Web Services (AWS) account with the Kinesis Data Streams service enabled.
  • Your Amazon Kinesis data stream must be publicly accessible and not be behind a firewall or secured in a virtual network.

Note

The maximum number of sources and destinations for one eventstream is 11.

Add Amazon Kinesis Data Streams as a source

  1. Select Eventstream to create a new eventstream. Make sure the Enhanced Capabilities (preview) option is enabled.

    A screenshot of creating a new eventstream.

  2. On the next screen, select Add external source.

    A screenshot of selecting Add external source.

Configure and connect to Amazon Kinesis Data Streams

  1. On the Select a data source screen, select Kinesis Data Streams.

    A screenshot of selecting Kinesis Data Streams.

  2. On the Connect screen, to create a connection, select New connection.

    Screenshot that shows the Connect page with the New connection highlighted.

  3. In the Connection settings section, for Data Stream name, enter the data stream name from Amazon Kinesis.

    A screenshot of the Amazon Kinesis data stream screen.

  4. In the Connection credentials section, do these steps.

    1. For Connection name, enter a name for this cloud connection.
    2. For Authentication kind, confirm that Kinesis key is selected.
    3. For API Key and API Secret, enter the credentials you use to access your Kinesis Data Stream. Go to the Amazon IAM console and select Security credentials. Copy an Access Key ID from the Access keys screen and paste it into API Key and API Secret.

    A screenshot of how to access the AWS Kinesis security credentials.

  5. Select Connect.

    A screenshot of the Connect screen.

  6. Now, on the Connect page, for Source name, enter a source name for this new eventstream source.

  7. Scroll down, and under Configure Amazon Kinesis data source, enter a Region for the data source. You can find the Amazon region code such as us-west-2 from the Kinesis Data stream summary.

    A screenshot of the Region field for Configure Amazon Kinesis data source.

  8. Select Next.

  9. On the Review and create screen, review the summary, and then select Add.

You can see the Amazon Kinesis Data Stream source added to your eventstream in Edit mode.

Screenshot that shows Amazon Kinesis Data Streams source in Edit view.

To implement this newly added Amazon Kinesis Data Stream source, select Publish. After you complete these steps, your Amazon Kinesis Data Stream source is available for visualization in the Live view.

Screenshot that shows Amazon Kinesis Data Streams source in Live view.

Related content

Other connectors: