Stateful transformation

Stateful transformation maintains the state across a period of time, which is greater than the micro batch interval and can be as long as an entire session of Spark Streaming jobs. This is achieved by creating checkpoints on streaming applications, though strictly speaking, windowing (refer to the Windowing section) may not require checkpoints, but other operations on windowing may. Let's find out how we can checkpoint our streaming application.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
13.59.173.242