There are a few reasons to follow the 10X rule.
The first, and most important, is that if you impose a very low load on the Quickie, it will change the actual operation of the 3S4 in a way that drives up distortion and mucks up the sound a bit. If you are 10X over the output impedance, the 3S4 in the Quickie will be gently loaded and perform very well.
Along with the first reason, the low loading will decrease the apparent gain of the circuit (it actually decreases the available voltage at the output), so you will have to push the preamp even harder to get the output voltage that you need.
Along with these two, there are coupling capacitors at the output of the Quickie that are sized for loads that are 40K or greater. As you dip below 40K, the lowest bass will begin to roll off slightly, and when you get to 10K, you may notice a few dB of bass loss at the lowest frequencies.