@Punxi I made the mistake of going in at Santa Cruz. It took a few ms to understand why sunning was the main activity there--the water was about the temperature of Lake Superior in late August ("too f-ing cold").
I noticed surfers even S of LA using wet suits. So I'm guessing you were S of the base (Pendelton)...there are a lot of places between there and Torrey Pines...