I believe only the orientation (rotation) of the sun is important because it is a directional light. Moving it's (or any directional light's) position won't have an effect on the render because it's lighting everything in the scene from the same direction according to its rotation.

If you're just annoyed by the light following your camera around, hmmmm...I don't know how to stop it.