Yes, there's a little bit of noise when you turn the amp on and off.
Depending on your meter, it may not resolve low AC voltages all that well.
Another possibility for a buzzing transformer is DC pollution on the powerline. Do you have any big motors running in the house? Some dimmers can also pollute the line badly enough to disturb a power transformer.