You can use this extension, You can remove a buttons's parent ('s parent) when a button is clicked.
Basic usage:
