Cool. From my experience, deleting edges is fine. As long as you leave the actual vertices untouched you can jigger about with edges and facets and retain morph compatibility.

Caveat: this may not apply to all modellers, and some actions could scramble your UV mapping...

And finally, there's no shame in being a perfectionist IMHO, although it may impact your workflow. ;)