Exactly, you do have a drift mechanic which i really like, but its broken, idk if u have seen my posts but in castles the situation is even worse...sorry for the late answer.
the nature of food consumption and prosperity creates a drift. Adding another layer on top might just make the world more static. Instead at the moment we are looking at ways to stabilize prosperity increase and create a buffer before decrease.