I think now part of my initial problem with the difficulty level was watching youtubers and streamers play this. It's obvious now they're playing Very Easy or Easy, seeing the speed they move on the map and the minimal damage they take. So after watching a few videos and streams over a few days I buy the game (was going to anyway. Warband is fantastic), play on Realistic and get my ass kicked by a looter that one shots me in the leg or arm while they're running around taking minimal damage in their playthroughs.