I just give up on any town that gives me a quest I don't want to finish, such as ones that require me to spend additional points in specific skills. It seems the game won't give you more than one quest of the same type at once through, so if you hate 'bring me 10 widgets' quests, just ignore them and move on to the next town until you stop getting quest types you don't like. There are definitely enough towns, so far I think I only have armor, horses, and weapons in my quest log which I never intend to complete.