The button seems to invert the way the mouse wheel zooms only.  You're right, though, the way the control-middle button works seems backwards.  It would probably drive me nuts if I didn't have the mouse wheel.  Maybe you should suggest to the developers that they make it work for that too, not just the mousewheel.