I was able to get the scene to render fine once BB posted actual numbers to use. This is with a focal length of 5mm and an IOR of 1,000,000.

Not a realistic scene, but there isn't a lot of room in the primitive cube I used.

I didn't make it obvious but the camera is rotated a bit in the horizontal plane, so any distortion of the tile pattern on the wall would be exaggerated.