I think that disconnect between scene and map has been an issue in warband and basically this format of the game. It's hard to find that balance. On on hand I'd love to have towns and scenes as detailed as an RPG game like say kingodom come deliverance. On the other hand in WB/BL it can be frustrating to walk through a bland town to locate a village elder or someone when you need to have a 1 second exchange with them.
I think in a way this game fights with itself. Are you the guy on the map view menuing your way to success, or are you a person in the world and the world is more than text descriptions? I think the thing is just the way gameplay systems are designed right now, you fly around to towns and treat them like skill hits as you would in another game.
For example the, "I want a bigger/ better armry", you are ping ponging around to the town and looking for recruits. Because you only get a few troops here or there per town, you are required to ride to multiple towns and interact for half a second. It's not an interesting interaction in itself, and loading into the map feels like a chore because you only have 5 seconds of non decision making interaction before leaving it. If you had to spend 5 minutes in town, and had meaningful gameplay there, it would not feel like a chore.
So many systems though lend to, stop by a town check/refill on 'stuff' and go look in the next town. They are clicking waystations and don't provide much other type of gameplay and hence, not really a drive to have elaborate scenes, despite having an engine that is capable of showing them.