You could definitely try a DC blocker.
For IEMs and Grados, these are headphones that are largely not designed to be used with a headphone amp, so putting them in front of a 2W speaker amp isn't always ideal. If these are the main headphones you use, there are ways to pad down the headphone jack to work better with these HPs.