Let's look at the performance of the three regression algorithms that we used on the same data and exactly the same use case:

Looking at the performance of all the regression algorithms, it is obvious that the performance of gradient boost regression is the best as it has the lowest RMSE. This is followed by linear regression. The regression tree algorithm performed the worst for this problem.