On the material browser (and object browser, atmosphere browser, function browser, etc) click on the little white page on the left lower corner and point to your folder. It will be added a new library, with previews.