It's clearly a ground loop, and as such, might be solvable by putting a ground lifter on one of the devices. Try each end. Try disconnecting every peripheral wire connected to that PC except the monitor. Etc.