Mine do not appear to do what you are describing. But I have mine set to "Always combine, hide labels" in the Taskbar properties.
If I open an application that is not already on the Task Bar, the icon does show up on the right side as last opened. I can move it around, but if it is not pinned, it will probably return to the last position the next time it is opened.