Adding isn't the problem. Synchronizing is. Bit the same as a very bad playback for a singer. You see it is wrong and it disturbs. Or the synch is right or you shouldn't do it. Adding wind sound to a scene is no problem, but the break of a branch can't be 2 seconds after you see it happening.

For me this is too complicated now and working on other solutions without synchronizing.