If you don't progress the main quest, then you don't have this problem. The game basically plays as a Warband-like sandbox. Granted, you can't form an independent kingdom this way. With the absence of diplomacy & kingdom-management mechanics, however, I'm kinda mystified that TW even gave us the main-quest path to establish a kingdom at all in the first place.
In current state of the game, it seems to me the most logical route is to just ignore the main quest entirely. Avoids a lot of headaches.
Note: I'm not saying this situation is okay or suggesting that OP and others have somehow made a mistake and have only themselves to blame. Not at all. I'm just pointing out that TW explicitly released an unfinished game in EA and told us the parts that weren't yet implemented. So far so good, I'm cool with that....but then they included a broken quest that invites the player directly into the midst of those very same un-implemented gameplay aspects. Inexplicable.