Just out of curiosity, what happens if you unplug the PSU from the internal components and plug it back into power?
Also which PSU is this?
And yeah, coil whine isn't too uncommon in other components. If I play an older game like HL2 with VSync off, frame rates are in the high hundreds and I get a high pitched whine from the GPU - wouldn't be surprised if that's what you're hearing.