The problem I had (and still have to some degree) it that I am used to FPS games where my mouse controls my direction. So, when mounted, I tend to charge and then when nearly upon the enemy I do a small correction of direction, unfortunately, I do it with the mouse and switch the side that I am swinging my weapon on.
Eventually I'll get it.