The only time you bypass the Recycle Bin when deleting a file is to hold shift + delete. You will get a warning box before proceeding. The standard delete mentioned above has been around forever, nothing new about the feature. It does what it's supposed to do.