point at uses both the item center (green +) and the red +  from joint editor to align the prop with the point at target. You might check where those two are in relation to the camera. A prop parented to the camera may allow you to get the poit at target in a position to pivot the billboard. 

Another option might be to turn on limits and set limits to 0 max and min for the rotationss that tilt the prop.