Hover over tabs to view Projects!
AWS Food Delivery Stream
Problem:
-
Food delivery data needs to be processed in real-time to provide immediate insights into order trends, delivery times, and customer preferences.
Solution:
-
Data Ingestion - Ingested JSON order data streams into AWS Kinesis.
-
Data Processing - Processed the data using AWS EMR.
-
Data Storage - Inserted processed data into AWS Redshift.
System Architecture
Data:
-
Dimension - contains the info like Customer Name, Drivers, and Restaurants
-
Fact - generated fake JSON order data
-
Order_Id, Customer_Id, Order_Date, Order_Value, Order_Status ...
-
Video Walkthrough
This video walkthrough covers the real-time data pipeline for ingesting food delivery order data into AWS Kinesis, processing it with AWS EMR, and storing the results in AWS Redshift.
Conclusion
Working on this project enhanced my understanding of AWS services and their integration for real-time data processing. The practical experience of ingesting and processing food delivery data streams demonstrated the scalability and reliability of cloud-based solutions. This project is a testament to how real-time analytics can be leveraged to improve operational efficiency and customer satisfaction in the food delivery industry. It underlines the importance of real-time data processing in making informed, timely decisions in dynamic business environments.