Python ETL Data Pipeline Tutorial with AWS, Terraform and Spotify

How to use data engineering skills to create an ETL data pipeline for Spotify data. In this video, I go over how to create a Python script that requests data from the Spotify API, loads this data into a data lake (S3 on AWS) via a Lambda function (serverless computing on AWS) and the entire solution is deployed using Terraform (except for the S3 bucket, sorry). This database can be used for future analysis of listening habits and trends. My Website: https://www.liamhartley.co.uk My TikTok: https://www.tiktok.com/@datadrivendecisions My Blog: https://liamjhartley.medium.com My Instagram: https://www.instagram.com/liamhartley.co.uk/ GitHub: https://github.com/liamhartley/spotify_analysis Python: https://www.python.org/downloads/ Terraform: https://www.terraform.io/downloads.html Spotify Developers Guide: https://developer.spotify.com/documentation/general/guides/authorization-guide/ Spotify (Register App): https://developer.spotify.com/documentation/general/guides/app-settings/#register-your-app SpotiPY: http://spotipy.readthedocs.io/ Project Article: https://python.plainenglish.io/how-to-engineer-spotify-data-with-terraform-aws-fd80feb73b1b Buy me a coffee! https://www.buymeacoffee.com/liamhartley 00:00 - Intro 01:41 - Pre-Requisites 04:59 - Extract and Transform with Python 14:20 - Loading with Lambda & AWS 18:38 - Terraform Deployment 29:13 - Summary