DataPiepeline using Apache Beam and Google Cloud DataFlow as Runner and BigQuery as DataSink

This is a walkthrough video on how to create a DataFlow job from the command line from the local machine. Medium Article: https://shravan007-c.medium.com/datapiepeline-using-apache-beam-and-google-cloud-dataflow-as-runner-and-bigquery-as-datasink-a6dcfadc8428 LinkedIn: https://www.linkedin.com/in/shravan-chandrashekharaiah/ Github: https://github.com/shravanc/apache_beam_learning/tree/main/apache_beam/aws_log_analysis_through_dataflow