Just because we are in a shell on one of our nodes doesn't mean we can't have a UI. Csysdig is a customizable UI for exploring all the metrics and insight that Sysdig provides. Simply type csysdig in the prompt:

$ csysdig

After entering csysdig, we will see a real-time listing of all processes on the machine. At the bottom of the screen, you'll note a menu with various options. Click on Views or press F2 if you love to use your keyboard. In the left-hand menu, there are a variety of options, but we'll look at threads. Double-click on Threads.

We can see all the threads currently running on the system and some information about the resource usage. By default, we see a big list that is updated often. If we click on the Filter, F4 for the mouse-challenged, we can slim down the list.

Type kube-apiserver, if you are on the master, or kube-proxy, if you are on a node (minion), in the filter box and press Enter. The view now filters for only the threads in that command:

If we want to inspect this a little further, we can simply select one of the threads in the list and click on Dig or press F6. Now, we see a detailed listing of system calls from the command in real time. This can be a really useful tool to gain deep insight into the containers and processes running on our cluster.

Click on Back or press the Backspace key to go back to the previous screen. Then, go to Views once more. This time, we will look at the Containers view. Once again, we can filter and also use the Dig view to get more in-depth visibility into what is happening at the system call level.

Another menu item you might note here is Actions, which is available in the newest release. These features allow us to go from process monitoring to action and response. It gives us the ability to perform a variety of actions from the various process views in Csysdig. For example, the container view has actions to drop into a Bash shell, kill containers, inspect logs, and more. It's worth getting to know the various actions and hotkeys, and even add your own custom hotkeys for common operations.