ETL streaming pipeline using python. generating a constant stream of fake web server logs, analyzing it, and storing in a PostgreSQL DB

This project demonstrates a modern ETL (Extract, Transform, Load) streaming pipeline using various open-source technologies.

TweetPipe Apache Flink AWS Kinesis Consumer. A Flink-based consumer that reads from an AWS Kinesis source and maps the input stream elements to a domain model. Future iterations will output the transformed data to a sink.