In this chapter, you learned about different types of data that we encountered with web sources and tweaked some ideas. We came to know about the need for web scraping, the legal issues, and the goodies that it offers. Then, we jumped deep into web scraping tasks and their potential. You learned about a new library called BeautifulSoup, and its ins and outs, with examples.

We came to know the capabilities of BeautifulSoup in depth and worked on some examples to get a clear idea on it. At last, we created a practical scraping bot by applying the knowledge that we gained from the previous sections, which enlightened us with an experience to scrape a website in real time.

In the next chapter, you will learn about the Flask microframework and we will build an application using it by following the best practices.