In this chapter, we will discuss two other popular APIs: PySpark and SparkR for writing Spark code in Python and R programming languages respectively. The first part of this chapter will cover some technical aspects while working with Spark using PySpark. Then we will move to SparkR and see how to use it with ease. The following topics will be discussed throughout this chapter:

• Introduction to PySpark
• Installation and getting started with PySpark
• Interacting with DataFrame APIs
• UDFs with PySpark
• Data analytics using PySpark
• Introduction to SparkR
• Why SparkR?
• Installation and getting started with SparkR
• Data processing and manipulation
• Working with RDD and DataFrame using SparkR
• Data visualization using SparkR