Not actually your mouse but the computer reacting to the cursor movement. Been there. My problem due to ground loops. With plugs for everything involved with the PC, Monitor, printer/scanner, external HD's, desk lamp etc it's easy to run out of available sockets. My Hi-Fi on a different wall socket and although I'm not recommending this, lifting the earth on my Luxman amp cured all of my noise and hum, so a ground loop via the audio cable from PC to amp.
I can make my newly finished Crack hum but it's running now from the Asus sound card in my PC and I can't get it to make even the slightest noise when on full volume. Having no noise at all seems rather odd, makes you think you might be losing something at the top end. S/N ratio of the Asus is well over 100db so far above the Crack specs (actually can't find those anywhere on the Bottlehead site. Are they there?) I have the PC output volume on 50% to allow the Crack volume control to work easily over it's full range but 9-10 o'clock is fine with my HD600's.
If you have a laptop or mp3 player try feeding the crack with that. I have a Kubic Rocca player and that has to be run flat out to get a reasonable sound out of the Crack but I have to run that out flat out too due to the low input signal. That makes for hum! Laptop is OK as you can adjust the volume on that the same way as on the PC. No earth problems with that of course when running on the battery.