Yes. Almost all stereo potentiometers have channel imbalance at low volumes. True, some are better than others, but it is pretty much inherent in the way they are constructed. But at normal volume levels it should be fine. If you frequently find yourself listening at low volume levels, you can install resistors on the inputs or use signal attenuators, which will let you listen at a hire volume level.
Or...you can install a $25 stepped attenuator, since stepped attenuators don't have channel imbalance issues.