^^ sounds very reasonable, I would have suggested the same - something to mask the areas where you want low specular values, although be aware if you use a clouds node it will be random; if you really want it "how you want it" then make a specular or reflection map.

My Freebies