probably unlucky. by castles i hope you mean towns. they tend to stay in the same area for a few days so go through the list of towns 1 by 1 as fast as you can travel. if you cant find them even then, maybe its a bug. for starters maybe you could visit towns that you rarely go to (cos their out of the way), like wercheg, bariyye or yalen.