It's not game breaking or annoying or anything and since it doesn't happen that often it's not something which must be corrected right away. When I tried to talk to Artimener, I got the dialogue one would get when he returned from a mission or something, with the answer being something like "I'm glad to have you back". The watchmen just said "surrender or die". Does that help in any way? I don't think so, but then again, I might be wrong ahah.
Edit: It happended again, in Sargoth, maybe I should try the quest in the other towns.