Spark on YARN

In YARN mode, the client communicates with YARN resource manager and gets containers to run the Spark execution. You can regard it as something like a mini Spark-cluster deployed just for you.

Multiple clients interacting with the cluster create their own executors on the cluster nodes (node managers). Also, each client will have its own Driver component.

When running using YARN, Spark can run either in YARN-client mode or YARN-cluster mode.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
18.119.124.65