First make sure that the file name extension is showing:
Go to control panel, folder options, view tab. Make sure that he checkbox labelled "hide extensions for known file types" is not checked.
Then navigate to the file you want to change, highlight the name and change the extension from txt to html.
Don't know what you are trying to do but this change will not make it an html file of course.