I've upgraded my refuge to level 3, and I no longer have the option to walk around/tour my refuge.
It's simply disappeared, and it's NOT because it's still upgrading. Whoever said that is an imbecile. I've already hired and armourer and blacksmith.
(the answer before was COMPLETELY UNSATISFACTORY, whoever answered it deserves to be punished for not reading the question(this refers to https://forums.taleworlds.com/index.php/topic,339108.msg8344777.html#msg8344777 and karlahan)