I Love Vinyl Records

Looking to get into collecting Vinyl records, I have always been drawn to the scratch of the needle and the pure sound from the grooved etches of an old record. Nostalgia and music in its purist form. I have a few records now, this could be an expensive hobby it seems? Any advice?