How to Create AWS Kinesis Firehose Delivery Stream to S3 and Query with AWS Athena

This tutorial will show you a step-by-step tutorial on how to create a Firehose delivery stream in AWS, produce data from EC2 instance using AWS Kinesis agent which it will eventually sink data to a S3 bucket and query with AWS Athena.

Yes, the time has come for us to talk about Amazon Kinesis. Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information.

Kinesis Video Streams
Amazon Kinesis Video Streams makes it easy to securely stream video from connected devices to AWS for analytics, machine learning (ML), and other processing. When you read video steaming for analytics, think of KVS

Kinesis Data Streams
Amazon Kinesis Data Streams is a scalable and durable real-time data streaming service that can continuously capture gigabytes of data per second from hundreds of thousands of sources.

Kinesis Data Firehose
Amazon Kinesis Data Firehose is the easiest way to capture, transform, and load data streams into AWS data stores for near real-time analytics with existing business intelligence tools.

Kinesis Data Analytics
Amazon Kinesis Data Analytics is the easiest way to process data streams in real-time with SQL or Java without having to learn new programming languages or processing frameworks.

Amazon Athena is a service that enables a data analyst to perform interactive queries in the Amazon Web Services public cloud on data stored in Amazon Simple Storage Service (S3). … An Athena user can query encrypted data with keys managed by AWS Key Management Service, and can also encrypt query results.

Written by admin