How do you connect with someone who has a hard shell?

My manager is the type of person to get to work, get the day over with, and go home. He hardly says a word at all, all day. Even when I joke with him, it's mostly just, "Yeah... ha... okay."

I've mostly just been leaving him alone when I can but is there any way to connect with him?