The problem is that the areas around the holes are n-gons (polygons with - many - more than four vertices). Not only that but they are concave - if you snap an elastic band around the polygon it will not follow the actual polygon but will leave a gap. The mesh will work, albeit with a higher ploygon count, if you triangulate those sections (or rework the mesh in some other way).