You can Permanently delete an item in Windows 8 by pressing the following key:
: press Shift + Delete key
This will Permanently delete an item in Windows 8.