Like Shonner said, with vertex objects and displacement, a lot depends on the level of subdivision of the mesh and the level of smoothing you choose for the displacement shader. Sounds like you have one or both of the smoothing settings up too high, generating an extremely hi res mesh which your machine can't handle.