Well you dont have to make it the most realistic, I did notice that against heavy armor, altough i did damage with my sword it wasnt much... So it does have that realistic feel.
But you know the funny thing is, this games very strong point are the physics, all momentum is calculated, when you run towards the javelin deals more damage etc, the horses have momentum etc. But foot soldiers dont have any physics at all in their movement. they just move... Try to move around like the characters in the game swining a stick while running around like that haha.
Lord of the rings isnt realistic either, but sometimes the battles felt believeable.