Should I care too much about subtitles in video games?

I almost always put them on.
Sometimes some dialogue is hard to hear, I do the same for movies.
Also some games are foreign language I play like Samurai Showdown.