Greg,
I think you'll like the PEC pots that Desmond mentioned -- I've had a number of pieces with these in them and they are quite good. Yes, some of them can be a bit scratchy at the extreme low end, but you can pre-attenuate so that your usable range is further up the pot and then it won't be an issue at all. They are also sealed, military duty so they will last a good long time.
As far as type of resistors vs. quality of switches, well, both are very important. If you ever heard a stepped attenuator made with 25 or 50 PPM 1% or .1% resistors vs a 100 or 250 ppm resistor of 3% - 5%, assuming all other specs the same, the difference should be very easy to hear.
Take two identical switches, two sets of resistors -- one set your standard vishay rn-55 type and the other carbon comp and you'll see what I mean. I picked these two as they are roughly about the same price range (inexpensive) but vastly different in terms of specifications and ultimately, sonics.
I do recommend the PEC pots though -- they are good sounding, maybe not the ultimate, but certainly good, and I'll be using one in one of my s.e.x. amps and probably another in Crack. It's a good solid choice and an easy recommendation, if not top-tier.
-- Jim
Jim Rebman -- recovering audiophile
Equitech balanced power; uRendu, USB processor -> Musette DAC -> 5670 tube buffer -> Finale Audio F138 FFX -> Cain and Cain Abbys near-field).
s.e.x. 2.1 under construction. Want list: Stereomour II
All ICs homemade (speaker and power next)