In my opinion I think your image works just fine as it is.  Also, to effectively destruct the buildings would require the building alone to be imported into PS then a lot of eraser and overlay work being applied to that part of the image in order to get somewhere like. 
In the end I think the detail of the destruct would be kinda lost in the overall scheme of things.

Maybe, someone else has some ideas of how you can achieve your objective without to much hassle?