Maybe try Shift + Delete to bypass the recycle bin.
Does it show as read only in properties?
Do you have something running that might be using it, for example is it mounted on a virtual drive?
Can you move it to another location and delete?
If none of those work, you may have to take ownership, OK back out then change the permissions.