Interestingly enough, I found out some new information. I moved everything into another room and used my laptop for the setup - no more buzzing. I moved it back to where it was, still plugged into my laptop - no buzzing. I swapped back to the USB cable to my desktop - buzzing. I then changed USB ports on my desktop and tried a different USB cable, but every feed from my desktop had the buzzing.
So basically, it's my desktop. I'm not sure what exactly could be causing this, though, or how to fix it. Any ideas?
Good news is that it's not my amp!!!