Right little hack around it closing the panel.
Open the Action and insert something benign within the Action like a Comment (for example), so the Action requires saving, but don’t save! Then click on the icon to close the panel.
Boyah!
It’s not a fix but a workaround I just discovered…