I've run into this problem on other games too Mustafa, but it usually just goes away with alt tabbing unlike Bannerlord. I was using an xbox controller also but I think it's more of a general Windows issue.
I have this issue as well, it started in the middle of a game and now whenever I try to restart the game I can't even do anything in the menus. I tried turning off steam overlay as well as nvidia geforce overlay and nothing.