Taught French at school, though not necessarily "learning" it, the two biggest hurdles for me were the very large and complicated range of verb forms and irregular verbs; and trying to remember the gender weirdly given to all nouns, even abstract ones.
