There's a special process to get rid of it because files are locked and you have to remove it from being a service too.
This is the procedure you'll want to follow:
Link Removed
If you are using x64, then substitute Program Files (x86) instead of how it shows the Program Files folder. You'll see what I mean...