I will clone out distractions when needed but rarely if ever add some object unless specificaly in photo manipulation..   I have no rule saying not to do this..not much different than changing lighting or mood through exposure, levels, etc.

Well, I will remove stuff...but not add..now I wonder why that is?  I have not really thought about it before.