Deithwen, you're exaggerating.
It's 3 hits for a regular joe, 1 - 2 to for a naked one. It's actually realistic, though it can get pretty annoying.
As for suggestions:
This armor for Cuirrasiers, possibly plate gloves for few others:
crouched walking, getting rid of all the clippings and whatnot...basically I have next to nothing to suggest, aside from that badass armor.
EDIT: Oh, one thing, improve gloves, they're the only thing that looks bad in this mod.