Is it too soon to say I love you?

We have been going out for a week. But wait! There's more haha. We went out two years ago for a month and a half. But in that month in a half we never once kissed or held hands. Just flirted. Both too shy. Anyways, he went out with a girl after me for almost a year. Meanwhile I went out with 3 other guys but I never fell in love or lasted longer than 3 months with any of them. So when my boyfriend told me he loved me, I said aww. Because 1)i wasnt sure if I loved him 2) what if i say it and i find out im a rebound or being played? And 3) what if i really do love him but it all rots like every other relationship I've had?