"I see the moon like a clipped piece of silver. Like gilded bees, the stars cluster around her"
- Oscar Wilde
In the previous chapters, we have seen how to develop practical applications using different Spark APIs. However, in this chapter, we will see how Spark works in a cluster mode with its underlying architecture. Finally, we will see how to deploy a full Spark application on a cluster. In a nutshell, the following topics will be cover throughout this chapter:
- Spark architecture in a cluster
- Spark ecosystem and cluster management
- Deploying Spark on a cluster
- Deploying Spark on a standalone cluster
- Deploying Spark on a Mesos cluster
- Deploying Spark on YARN cluster
- Cloud-based deployment
- Deploying Spark on AWS