Well, what killed it was the transparency maps for hair and eyes - that additional shader evaluation cost lots of time. It'd a lot faster without opacity evaluation, but then you get black shadows from transparent hair and eyeballs.