You can't just copy matrix the origin handle. When you copy matrix then paste the matrix to another object it inherits the original object origin handle as well (IOW if the original objects origin handle was offset by 10 units in the X direction, so will the object you paste it to (as well as position and size)).