If the L-pad is right at the input of the amplifier, then the impedance isn't such a huge problem.
Since the amplifier has a 50K input impedance, you can pop the hot wire off each of the RCA jacks on the inside, then solder in a pair of 150K resistors between each wire and the center pin of the RCA jack. (They don't have to be exactly 150K, 125K-175K will be close enough)
This will give you 12dB of attenuation, which seems like a reasonable place to start.
-PB