Once you have a SparkContext
created, it will serve as your main entry point. In the next chapter, you will learn how to use our SparkContext
instance to load and save data. You can also use the SparkContext
instance to launch more Spark jobs and add or remove dependencies. Some of the non-data-driven methods you can use on the SparkContext
instance are as follows:
Method |
Use |
---|---|
Adds the JAR file for all future jobs run through the | |
Downloads the file to all nodes on the cluster | |
Shuts down the | |
Removes the files so that new nodes will not download them | |
Removes the JAR files from being required for future jobs |
3.142.166.31