In "Gallery Options" you can select  "When browsing, open images in a new window" - it is only half as frustrating closing the new window, as clicking the back button.

Otherwise, with both the new version of IE (IE 7 beta 3) and Firefox, I take advantage of tabbed browsing - right click on image and choose 'Open window in new tab'.