Wouldn't it be cool if your castle(s) got attacked while you were out questing? (if this already happens or has been suggested it doesn't matter, that's not the point of my suggestion)
Anyway if your castle was under siege when the player was far away, you could get a couple of options come up...