I am afraid many empires and kingdoms have fallen throughout History, so this is what may happen to Kingdom of Swadia as well
You may have noticed that lords leave their faction and join another if they are too dissatisfied with their liege and hold no fief. Count Delinard is therefore likely to join another faction in the coming months, but he won't disappear. Just hope he won't join an enemy faction of yours, otherwise he will have to fight you until your liege makes peace with them, or until you leave your current faction. If Kingdom of Swadia was to disappear entirely, only King Harlaus would go into exile outside of Calradia for he is the ruler of that faction