That may be true, but the word is intended to be derogatory. It's like defending the use of the word "negro", because, according to the dictionary definition of that word, it fits a black person. But the black person may not thank you for using it.