I wouldn't bne surprized if he was disliked personally, he suffered of mental illness, especially in the latter days. 
Most of mental illness conditions are not very pleasing to be around.
here's some more interesting info on Van Gogh: http://www.vangoghgallery.com/misc/later.html

Hi, my namez: "NO, Bad Kitteh, NO!"  Whaz yurs?
BadKittehCo Store  BadKittehCo Freebies and product support