The library pallete holds the keyboard focus once you've clicked on it and the delete key takes you up one level in the folder hierarchy.

I think the trick is to always click on the item your trying to delete before pressing the delete key or use the Figure or Object menu (as appropriate).