How long do I have to wait before I can re-add a friend I accidentally removed?

I never intended to remove him, it was the result of a misclick, and now the site says I can't add him back at the moment. It happened a couple of weeks ago. Why won't it let me add him back after all this time? No, he hasn't blocked me.