Just an update, I have managed to find a fix for me, and it was mod related.
I have a bunch of mods installed manually, and through vortex, the manual ones are because they don't have a vortex download version.
I naturally assumed disabling all mods through the Bannerlord launcher would solve this, but I was wrong, you actually have to disable them via the Vortex launcher as well.
The mod that was causing me this problem was The "Recruiter 1.0.4" mod. After disabling this through vortex, my game worked like normal. If you don't have this installed I am not really sure what to suggest to be honest, but it might be worth checking all mods via vortex launcher if you have any.