I think Rutra is right here, purge memory is only doing something when fragments stay in memory when they shoudn't, like deleted objects textures, so if these fragmenrts are properly deleted by your OS, then pushing this button won't do much.
This said, I find it useful when using displacements that eat up loads of memory. And this isn't right, because I have "flush voluminous data after render completes" on...