Yes, for closer shots, but for longer shots, it is the whole combination and if the body and hands don't work with the facial expression, it suffers. Or so It seems to me.

But then again, all of us here having this conversation are not the normal audience. We tend to break these things down because we study the how and cause effect. Where the normal audience just watches it as is.

How many people notice how many times a character blinks. I do, but I guess I'm not normal.

I like the glove idea too.