Would I look silly if I wore a uniform when my job doesnt require it?

Okay bad question, I know.

This is pretty much the first job I've had where I didn't have to wear a uniform. So I don't have very many business casual clothes. I am shopping little buy little, weekly.

Or would I look silly if I just had a Monday outfit, Tuesday outfit, etc...I'm certainly gonna have a Friday outfit if nothing else.
(company shirt with khakis. Easy and comfortable).