This video comes with some practical project ideas to learn data engineering on aws so you can handle a variety of real-world challenges. This includes architecture diagrams of:
1. Event Driven data processing with AWS Lambda,SNS,SQS
2. Batch Processing Data with AWS Glue
3. Build a Dashboard with AWS Quicksights on a Data Lake powered by AWS Athena.
4. DMS To Migrate Data from a Database to S3
5. Process streaming data from Amazon Kinesis Stream
Diagrams and article link:
https://aws.plainenglish.io/most-common-data-architecture-patterns-for-data-engineers-to-know-in-aws-72bc6ea81ed
Buy me a coffee : https://www.buymeacoffee.com/dataengu
Timelines
00:00 Introduction
00:31 Event-driven Data Processing
02:59 Batch Processing with AWS Glue
04:40 Serverless Dashboard
05:23 Database Migration
06:29 Process Streaming Data
#aws #dataengineering
