You need to make sure that your ambience is set so that the yellow dots are ambient and the rest of the material isn't. Go into the deep texture editor and click on the A (for alpha) next to the part of the material that sets the yellow dots. Then go back to the regular material editor and click the dot next to the Ambience so that your material is used for this channel as well.