No need to worry about it because your brain can not distinguish between compression of the ear drum from the outward excursion of a a speaker driver and the rarefaction or the loss of compression caused by the inward excursion of a speaker driver. The impotent thing to remember is mostly on loudspeaker connections to an amp. For example if one speaker is wired correctly, red to red and black to black, if you wire the other is wired red to black and black to red then you have an out of phase wiring of the 2 speakers causing cancellation of bass, midrange and treble.
Try this experiment on an amp with a balance control. Wire 1 speaker out of phase and the balance set to the center, listen and it will sound lousy, then turn the balance control either to the right or left and the bass will increase. Check it out.