I'm pretty sure in P7 that to avoid halos around transmapped items, that even though the background may have been black, you still had to choose 'Render over black' in the render settings.
Does that make a difference in P8? I'm not able to access my P8 box to try it right now.