Two stage process.

Render with the figure as you did above, but then render again with figure coloured roughly the same as the shirt.  Put both renders into the same Photoshop (or whatever) document.  Use the greenscreened render to make your selection, but do the actual cutting on the second.  Since the figure was more or less the same colour as the shirt, antialiasing discolouration should be minimal.