IIRC, if you have a high enough persuasion skill you are given the option to convince him to give it to you to save lives, with no reputation repercussions. Otherwise it's give it to me or I kill people (they hate you) or straight up pillaging.
One thing I noticed by accident is a random monastery I pillaged along the way gave me the quest item as loot.