Web Scraping with ETL Plugin Architecture

The ETL Plugin Architecture (EPA) is a generalized framework for rapidly developing projects that require data scraping. There are many freelance projects posted that require web scraping plus some minimal user interface. They are usually internal tools used for generating leads or finding buy opportunities on some product (books, real estate, stocks, etc.). EPA can be used to develop this type of tool quickly allowing me to charge less for development costs and you to get a workable solution more quickly. A new project will only require a set of fixtures and plugins to be written. The fixtures will control the look, feel, and content of the data displayed on the frontend. Plugins define a single thread of ETL processing and can be used to perform web-scraping or reading from an API.