And the rendered result.
This shows that black is the base-line, any other values displace "outwards".
Displacement also takes negative values, but since grey-scale ranges between 0-255 (in 8-bit mode), grey-scale can't do -ve displacement without (eg) subtracting the grey-scale from 0.5, using a math node....