Let's now look at the following core concepts in Spark and PySpark:
- SparkContext
- SparkConf
- Spark shell
Core concepts in Spark and PySpark
by Bartlomiej Potaczek, Rudy Lai
Hands-On Big Data Analytics with PySpark
- Title Page
- Copyright and Credits
- About Packt
- Contributors
- Preface
- Installing Pyspark and Setting up Your Development Environment
- Getting Your Big Data into the Spark Environment Using RDDs
- Big Data Cleaning and Wrangling with Spark Notebooks
- Aggregating and Summarizing Data into Useful Reports
- Powerful Exploratory Data Analysis with MLlib
- Putting Structure on Your Big Data with SparkSQL
- Transformations and Actions
- Immutable Design
- Avoiding Shuffle and Reducing Operational Expenses
- Saving Data in the Correct Format
- Working with the Spark Key/Value API
- Testing Apache Spark Jobs
- Leveraging the Spark GraphX API
- Other Books You May Enjoy
Core concepts in Spark and PySpark
-
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click here login for view all page.