I have been learning about conservation of energy being balanced between diffuse and specular values. But I am confused as to how specular maps play a role in this.

Doesnt a specular map create areas where total light = less than 1?