In your attempts, have the leads ever come loose?
In such a case, I generally try to get the lead loose before attempting to remove the solder. In other words, get the part out first, then work on getting enough solder out of the way to install the replacement.
I know it may seem counter-intuitive, but you may have to actually re-solder the joint first to insure that all the solder in the joint liquifies, then when it does, pull out the lead with your needle-nose pliers. Repeat with the other lead. If you can get one lead out, the second one usually becomes easier to remove since the body of the part is half-loose. Then, once you've got the part out, go to work on removing solder from the joints so you can get the replacement part in.
I have been known to use a pointy metal object to just poke a hole in the heated solder in order to accomplish this, but if you try this you will want to keep it moving. Otherwise, you may end up soldering the tool in place!
BTW, good for you for catching your error before it became a head-scratcher when you tried to run the amp!