I don't know if it's been tried as you envision it. I do know that a texture map has to be in a bitmapped form for it to be applied. In other words, sooner or late it would have to be converted out of vectors and into pixels. I often create things (shapes, patterns) in Illustrator, import 'em into Photoshop (further manipulation), and then save them in an appropriate bitmapped format.

Before they made me they broke the mold!
http://home.roadrunner.com/~kflach/