In this chapter, we discussed the advantages of using GPUs in a machine learning workflow, especially in deep learning. Then, we showed the step-by-step installation of a Nvidia driver, the CUDA Toolkit, cuDNN, and TensorFlow with GPU support. We also introduced our recommended workflow for using multiple versions of TensorFlow and other libraries.