The MLlib library in Spark provides a formal implementation of various machine learning algorithms that can be used in a Spark platform. The availability of pySpark makes the process of using the functionality easier for those with Python programming knowledge. If the organization had an existing Spark platform, it would be worth exploring the machine learning capabilities in MLlib.

The following screenshot gives you a brief overview of MLlib: