In the previous chapter, we learned about video surveillance, background modeling, and morphological image processing. We discussed how we can use different morphological operators to apply cool visual effects to input images. In this chapter, we are going to learn how to track an object in a live video. We will discuss the different characteristics of an object that can be used to track it. We will also learn about different methods and techniques for object tracking. Object tracking is used extensively in robotics, self-driving cars, vehicle tracking, player tracking in sports, and video compression.

By the end of this chapter, you will know the following:

• How to track objects of a specific color
• How to build an interactive object tracker
• What a corner detector is
• How to detect good features to track
• How to build an optical flow-based feature tracker