Craigslist Scraper with Python and Selenium: Part 1

In this video series, we will be writing a script in Python using web scraping modules such as Selenium, Beautiful Soup, and urllib to extract information from the website Craigslist. Specifically, this script will be responsible for forming a query to search, i.e. a set of criteria such as items to look for in a given location, zip code, etc. Once we form this query, we use our script to automatically perform a search and extract two key pieces of information from this search. Namely, we will extract the titles of each of the postings along with the links for each post. This project is purposefully simple as it will optimistically serve as a springboard for you to build upon. For instance, perhaps you want to keep tabs on when a certain item is listed in your area. Perhaps you could modify the script to automatically email you if any items of interest pop up in your area. The possibilities are quite vast, and I hope you use this to build something useful and cool. If you do, please share it! Related Links: Part 1: https://www.youtube.com/watch?v=4o2Eas2WqAQ Part 2: https://www.youtube.com/watch?v=x5o0XFozYnE Part 3: https://www.youtube.com/watch?v=_y43iqSJgnc How to Send an Email in Python: https://www.youtube.com/watch?v=mP_Ln-Z9-XY This video is part of a larger series on "Web Scraping and Automation". You can watch the other videos in this series here: http://bit.ly/web_automation Further videos on Selenium: http://bit.ly/lp_selenium Software for this video on Github: https://github.com/vprusso/youtube_tutorials/blob/master/web_scraping_and_automation/selenium/craigstlist_scraper.py Do you like the development environment I'm using in this video? It's a customized version of vim that's enhanced for Python development. If you want to see how I set up my vim, I have a series on this here: http://bit.ly/lp_vim If you've found this video helpful and want to stay up-to-date with the latest videos posted on this channel, please subscribe: http://bit.ly/lp_subscribe