Do most men find modestly dressed women attractive?

I'm 19, and i'm told I dress like a librarian--i've gotten "stylish grandma" from my coworkers too.

I think I dress very lovely, and I find my body very attractive w/ and w/o clothing. But suddenly, i'm wondering... what do men generally think of a woman who's always dressed in long skirts and cardigans?