Summary

In this chapter, we used Spark functionality via Python coding for Jupyter. First, we installed the Spark additions to Jupyter. We wrote an initial script that just read lines from a text file. We went further and determined the word counts in that file. We added sorting to the results. We wrote was a script to estimate pi. We evaluated web log files for anomalies. We determined a set of prime numbers, and we evaluated a text stream for certain characteristics.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.16.147.124