This guide covers how to send DynamoDB data to Propel using Kinesis Data Streams and Data Firehose.

Amazon Kinesis Data Streams for DynamoDB captures item-level changes in your table and replicates them to a Kinesis data stream. You then send those changes to a Propel Webhook Data Pool via a Data Firehose. Below are the steps to set that up.

It covers how to:

1. Configure the DynamoDB Stream
2. Create a Propel Webhook Data Pool
3. Create the Data Firehose stream to deliver events to Propel
4. Transform DynamoDB events in Propel
5. Backfill historical data

Requirements

• You have access to your AWS account.
• You have a Propel account.

Step 1: Configure the DynamoDB Stream

In this first step, we will guide you through the process of setting up a DynamoDB Stream. This involves navigating to your DynamoDB dashboard, selecting the relevant table, and configuring the Amazon Kinesis stream details. Whether you're linking an existing Kinesis data stream or creating a new one, we'll provide step-by-step instructions.

1.1. Go to your DynamoDB dashboard in the AWS Console and click “Tables”.

When you are in the tables section, click on the table that you need to replicate to Propel.