You can delete in the UI... Just below where you see Steps, you have the Add, Duplicate, and Delete options... For me personally I prefer one click over two, so right click and delete is one too many clicks. But do get your point, for others it is muscle memory and expected I suppose, then I am old and my poor old fingers prefer the least amount of clicks possible!