Does it bother anyone else that "sleeping with someone" carries the connotation of sexual stuff?

I find myself wishing I could curl up with some people and sleep together. Sadly, "do you want to sleep with me" seems to be tied heavily to "we gon do it in the bootyhole."