Do solder the connections. The most common issue with an amp not working is a bad connection. Leaving the joints dry will greatly increase the possibility of this happening. The plastic insulators are necessary to isolate the RCA jack signal grounds from the chassis in order to avoid ground loops.
