Just reading the wikipedia page on eyes, the section on Rods and Cones is quite interesting. The more sensitive rods which are responsible for B&W work at lower lighting levels than the colour. Possibly the lighing levels we use for B&W images are better suited for these rods so we see more contrast based detail????