Hmm, you are right. 

If I switch to item list view it seems a lot faster with a big runtime than with the tree view.

I'm still curious why the tree view sometimes can be stuck for so long on updating specific folders, even if they don't contain all that many items?