Are we talking icon like these:

Hover the icon with your mouse cursor and a path popup will appear in a text field. You can also right-click the icon and have it open explorer to reveal what's in the folder. Check to see if any png thumbnails exist. If you haven't tried yet, click the little refresh icon at the bottom right of your Library and see if that corrects the problem.