A web browser (Google Chrome or Mozilla Firefox) is required and we will be using the application and Python libraries listed here:

• Latest Python 3.7* or Python 3.0* (installed)
• The Python libraries required are the following:
  • lxml
  • requests, urllib
  • bs4 or beautifulsoup4 
  • scrapy

For setting up or installation refer to Chapter 2, Python and the Web – Using urllib and Requests, Setting things up section.

Code files are available online at GitHub: https://github.com/PacktPublishing/Hands-On-Web-Scraping-with-Python/tree/master/Chapter05.