That mostly means your powersupply is noisy and putting its noise into your soundcard

You should hear different noise when you use your graphics card