I don't know if this is the case for all cavalry units, I only know about the Imperial Equite.
When upgrading them to Heavy Cavalry they need a warhorse instead of a regular horse, so the upgrade consumes one, but it doesn't give back the old horse. There is some historical realism to this, but...