In Chapter 3, Web Crawling with Scrapy – Mapping the Application, we saw how to write our own crawler using Python and the Scrapy library. In this chapter, we are going to learn:

• What is resource discovery?
• Building our first BruteForcer 
• Analyzing the results
• Adding more information
• Taking screenshots of the findings