So in the past before the castles where built, what did the royals then live in ?

Motte-and-bailey forts, hill forts, brochs, crannogs, oppidums.

In general, there were many & various fortifications designed for protection of individuals or as military strongpoints.