Why do flash drives screw with my other USB devices?

With both my Patriot Xporter 8GB drive and a Kingston MicroSD reader/adapter, my USB wireless network adapter will frequently stop functioning and when I try swapping ports, nothing re-initializes, including my USB keyboard. Does anyone know why this is happening? It's intermittent and sometimes won't happen until I remove the drive from the USB port, but not always.