Voted no for the armor idea, as I understand it its like having shields on the body.
Armor isnt shield, shields are used in a manner where they are held near the body, the shield arm functions like a shock absorber and thats why a shield can block much heavier hits (hits so strong that they damage the shield) than any armor could, a shield can get damaged and still function partially.
If an incoming hit is strong enough to break/destroy the shield the fighter would still live (with a broken arm)
Plate armor and helmets are worn on the body without the buffer and force-absorbtion of the flexible shield arm (thats why armor is less effective than shields), the armor will try to distribute the incoming force from the hit (plate part) and absorb it as much as possible (padding part) but heavier hits will still go through in the form of blunt force trauma, this alone could kill the wearer without damaging the armor.
If a hit is so powerful that it damages/destroys the armor than it damages/destroys the body under the armor too.
tl;dr
You cant wear down heavy armor, the wearer will die long before the armor breaks and falls down.