Removing a GPO from existence is even faster. There is a simple Remove-GPO cmdlet that will completely delete whichever GPO name you specify. Keep in mind that if your GPO name consists of multiple words, you will need to encase the name of the GPO in quotes:
Remove-GPO MyNewGPO
Or, here is another example:
Remove-GPO "This is my other new GPO"