So, I went and tested both lenses today at a local camera shop. The extra 100mm was great, but the L was amazing. I got to test out the f/2.8L(non-IS) and was sad because it's soooo pricy but really really nice.

I bought the f/4 L because it just seems overall better quality than the non-L one. I'm a happy camper now lol!