MY suggestion?? Add some kinetics to horse movement -- horses have MASS and they don't just stop dead when they hit another horse or person. A horse should move THROUGH another object like that, or at least have it get bounced away from the horse.
Oh, and being unseated from a collision would be interesting -- so if your horse slams into a wall, maybe you get unseated and go flying.