For me this is a bit of a Hobsons choice. The trouble with not upgrading is the further behind from the current version you get the more problems you will face in the future. It might be ok to stay on 10 now but what happens when IE12 comes out. IE11 is not just the browser but as already mentioned shared code that many apps use to access the Internet (so there is also falling behind on security patches to consider as well as the loss of support for newer apps).

If you're planning to upgrade the OS in the near future it might be better to wait until then and deal with any issues in one go.

If you do decide to upgrade don't forget to create a system restore point first.