Not easy to see whats wrong without a picture, but you can either model the whole structure (Floor, walls) in one mesh. Or you can let the different parts overlap a little and that way close the gaps. Depending on the complexity of the building, and how far you are in the modeling process, i find modeling the whole structure in one mesh to work best.