Try a Shure M97XE. A great little cartridge. As Grainger often says, the cartridge is the most important part of the set-up, something I have come to believe. The Shure is a standard entry level cartridge into the world of good sound and has an upgrade stylus option from a 3rd party if you get interested. Next, when that really whets your appetite, buy a Seduction. Then, when you are really, ready, get a vacuum record cleaner. They make a massive, massive difference.
Away from the purely sound part of it, vinyl is fun. It is retro, it is a blast to peruse and buy. The record covers are neat to look at while you listen. You can't buy more music cheaper, especially if you like classical at all.