Is it better to let go of past mistakes and move forward, or is it okay to continue dwelling on them even if it causes more pain?

How can someone with little prior knowledge get started in studying philosophy or related subjects such as history and psychology?