web performance

So, everything's working fine as long as I don't download anything. As soon as I start a download, no matter at which speed, my whole internet starts to slow down terribad. For example latency in games increases like hell, almost to unplayability. Websites are loading incredibly slow and so...