Same for me long long times of peace and towns still broke. quickly running out of money as workshops and three caravans don't do much. only found two spice girls and had to send out one with low trade and he is doing very well.
I had a play threw where I went back to square one .. kicked out all my troops and companions and earned some money and slowly rebuild my army. then said . heck with this and restarted. and its heading back the same way. I smelt all the weapons and sell the ore. I have no idea how to make money to keep my head above water.