To those who speak a second language

My Spanish level is high intermediate. I'm embarrassed to say that even though I've studied off and on for years I cannot say that I'm fluent. I can read anything easily. I've tried so hard but I just cannot understand spoken words unless I concentrate so hard that my head hurts or only when its spoken rather slowly and deliberately.
When did the point come for you that you could totally understand your second language at normal pace without having to think about the words?
Is anymore progress possible at my age?