If you'd like to leave, removing all of their art would most likely be the efficient way of "killing them off".
Before you go though, would you like isolated versions of the character icons I made for you? That way you can use them for whatever you would like to even if you aren't in the group anymore.