Element identification, DOM-based navigation, using browser-based developer tools, deploying data-extraction techniques, and an overview on XPath and CSS selectors, plus the use of lxml in a Python library, were the main topics explored in this chapter.

We have also explored various examples using lxml, implementing different techniques plus library features to deal with the element and ElementTree. Finally, web Scraping techniques were explored through examples focusing on different situations that might arise in real cases.

In the next chapter, we will learn more about web scraping techniques and some new Python libraries deploying these techniques.