Another thing to check would be if anything in your scene has a preview subdivision setting at 1 or above. Subdivision previews slow down the scene. So setting preview subdiv to 0 and leaving  Render subdiv set to whatever it's at should help your preview scene not be so sluggish