If you look in the datasheet for the LM3886, there is some mentioning of the lowest possible gain that you can use with the chip itself. I would start by adjusting the resistor divider on each channel to achieve this gain.
Next would be a little padding at the input as well.
When you have very sensitive speakers (like your Fortes), and a very sensitive amplifier (high power and/or high gain), you will run into these issues.
-PB