Them popping up fast must surely be a benefit - right? What if they didn't? There are nothing lost by not picking them up, right?
yes there is something lost you loose 0.5 Security for each Quest that is open in a village, so up to -6 depending on how many Nobles are there.
In addition you loose 1 Security per open quest in a City. This could result in like -10 security per day which would just plumet your loyalty resulting in an instant rebellion.
So there is a real disadvantage to let them open
I really like the import food toogle idea.