Rule One of Good Management. "Compliment publicly - reprimand privately." If you're going to ban anyone, then do it. If you're managing this site then take the responsibilty for it. Don't call upon a public vote to cover your butt. The Terms of Use are pretty simple, now enforce them, or don't.