Trouble is, just using the normal texture as a bump map can do odd things. It's the greyscale value that decides how high a bump is -- now imagine what will happen if you use a texture map for a character who didn't take off their swinsuit to get an all-over tan.