You can only feel betrayed by a person that you had some type of feelings for, agree?

No. You can feel betrayed on the basis of any relationship, regardless of "feelings for" the person.

For instance, we have been betrayed by fellow-citizens who sold or gave away our country's secrets, even if we didn't know them.