Quicktime is more of a professional codec used by video editors. An MP4 is a delivery format that is heavily compressed. If you have to work with the file again (which it seems you do because you are editing it), then you are editing a copy of a copy. It is kind of like always saving your output in a JPEG after a few edits the original looks crappy.

MP4 edits will suffer the same fate.