Reflection maps are just images. Its a programming shortcut. Instead of working out the actual ray traced reflections it uses the reflection map instead. For example a picture of a wall with a window would work well as a reflection map on a glass vase in a room.

Those of you that have the recent Swing Zone set may like to look closely at the shiny belt. You are now looking at a picture of my yard :)