Would it be that bad playing with the volume of your music source?
Put it on 6 and decrease the volume from a 100% to 95% or something on your music source.
About the attenuators, I was really sure that everybody replace the stock pot because of the imbalanced issue now I see its only for sonic benefits..