Absolutely ! ! ! Read post #2, Reply #1. If the contacts do not arc (due to current) or slide giving mechanical wear, silver contacts last, as I said above, forever.
You can't see gold tarnish, you can't see aluminum oxide either. But both are there and oxide and tarnish are not as conductive as the base metals themselves.
If you look through some catalogs you will find that more signal level contacts are silver than gold. I don't remember seeing gold signal level contacts. I may have never noticed them, but silver is the standard.
In addition, 24 carat gold is extremely soft, it would wear quickly.