What character are you using? I did a test with V4 and can't seem to replicate it.

Also what does the joint editor say, are the axis (Green) lined up correctly in there?

Also can you maybe post an image where it looks correct and where it doesn't?