In this chapter, we will learn about big data cleaning and wrangling with Spark Notebooks. We will also look at how using Spark on a Notebook application allows us to use RDDs effectively. We will use Spark Notebooks for quick iteration of ideas and carry out sampling/filtering RDDs to pick out relevant data points. We will also learn how to split datasets and create new combinations with set operations.

In this chapter, we will discuss the following topics:

• Using Spark Notebooks for quick iteration of ideas
• Sampling/filtering RDDs to pick out relevant data points
• Splitting datasets and creating some new combinations