Tried that too but it is still visible.

I will have to render the windows separately and it is ok. Then I can add some animations to them too (not the windows but the landscape outside) which will be great for the game. So it turns out to be a good thing.

Thank you everybody for all the advice!  
/sends hugs to the guys/girls