Some skin shaders have high specular values and/or sharp specular highlights. Maybe that's what is causing it. To determine this, you could try switching off the specular content of your lights.

"If I were a shadow, I know I wouldn't like to be half of what I should be."
Mr Otsuka, the old black tomcat in Kafka on the Shore (Haruki Murakami)