Post conquest settlement balancing: Why is it a problem?

[strawmann]

(unless the faction has no town, then they go sell it to the closest one I believe)

Nope - the villagers park themselves in the village and do nothing, and the game crashes if you try to buy from the village