Maybe a (large) noise shader in the bump channel (with a low bump amplitude) could help to have glistening gold in hdri renders, withhout the mirror ball/chrome feel. I do not have time to try right now.