As long as the activity light is not blinking you can remove it. Typical scenario is when you write data to an external drive is Windows does what's called lazy writing. Which means even after the copy file dialog is gone Windows may not have completed writing. Supposedly quick removal makes Windows write data immediately.