Complete Python Web Scraping Tutorial: Scrapy, Selenium, Requests, BeautifulSoup and lxml

**I have used both Windows and Macbook in this tutorial** Get 1000 free Proxies for web scraping: https://www.scraperapi.com?fpr=thescraperapi Learn web scraping with python from beginning to end, if you are looking for specific topic within this video follow the chapters. This tutorial starts with requests library example and parsing libraries BeautifulSoup4 and lxml libraries. After python requests library i have also included use case examples of Scrapy Framework and Selenium automation library. The reason i choose (requests, bs4, lxml, scrapy, selenium) libraries is because these libraries are the latest python 3 libraries that are used for web scraping. Tutorial by Assad Ali, follow the channel for more videos about web scraping https://www.youtube.com/channel/UCE-g3sZdGoe4-088NX-zamw ⭐️ Course Contents ⭐️  🐍 (00:00) introduction 🐍 (00:53) introduction to web scraping libraries 🐍 (05:20) Installing anaconda navigator 🐍 (06:10) Installing Jupyter Notebook 🐍 (10:04) How to open python shell and scrapy shell 🐍 (12:11) How to open anaconda navigator on windows 🐍 (12:41) Open Python shell in anaconda terminal 🐍 (13:00) Open jupyter Notebook on windows 🐍 (14:15) Best available IDE and code editor for python 🐍 (16:09) Open Spyder editor in windows 🐍 (17:49) Start web scraping 🐍 (18:01) Python Requests library Example 🐍 (18:13) Install requests library with pip2 and pip3 in Mac terminal 🐍 (18:50) Install requests library with pip in anaconda terminal 🐍 (21:23) print pythorequests response status code 🐍 (21:28) Types of different http responses and their meaning 🐍 (21:36) Install BeautifulSoup (BS4) in terminal 🐍 (27:03) Scrape website response using Python BeautifulSoup(bs4) library 🐍 (32:53) Scrape website response using python lxml library 🐍 (36:28) Introduction to Python Scrapy framework 🐍 (38:02) Install scrapy framework in Mac terminal 🐍 (38:25) Install scrapy framework in windows anaconda terminal 🐍 (39:00) Install Pycharm for free 🐍 (39:49) Open Project folder in Pycharm 🐍 (41:01) Create your first scrapy project 🐍 (44:41) Create spider inside scrapy project 🐍 (45:08) Overview of scrapy project 🐍 (48:09) Open scrapy shell to test code 🐍 (54:56) Run your first scrapy crawler and save output 🐍 (59:33) Using callback method in scrapy 🐍 (00:03:23) Understand scrapy settings 🐍 (00:07:38) Introduction to selenium 4 🐍 (01:08:32) Install selenium webdriver for windows and Mac 🐍 (01:11:08) Add Webdriver path in Selenium Webdriver windows and Mac 🐍 (01:13:50) Selenium web scraping example