You'll likely need a driver for that printer installed on the Windows machine that you are remoting into.
Check and see if there is a compatible driver from Dell for Server 2012 for that printer and only install the driver. You shouldn't need to install the whole software package.