I read that basically weapon master is not very useful past level 2. With level 2, before too long you'll reach 250 skill in your weapon, and past that, the bonuses are not very large. Of course if you have a bunch of points you don't know what to do with, you can go ahead and add them, but there are more important skills.
The main question that you should ask yourself is what you want to be.
Charisma is important if you want leadership, which lowers troop costs, increases your troop limit, and moral.
Intelligence is important if you don't want to rely on your companions. You also get a bonus if you and a companion has the same skill. I forgot the numbers, but it is not bad. Your character would have a lot of points since you'll level up fast.
However, as far as a pure fighter. You'll need both agility and strength either way. Bows are the best if you want to spend points. Crossbows are the unskilled warriors long range weapon. The best crossbows also cannot be used on horseback. Power draw is a must, and a strength skill.
You'll most likely want to start by getting 12 agility so you can get level 4 riding and get a war horse. Horse archery is something you'll want to get as high as possible most likely. However, if you are not moving on the horse you wouldn't need this skill at all. I wouldn't bother getting riding higher than 4 personally.
Then I'd get strength to 30 unless you want to put points into intelligence or charisma. Max out Power Draw. As melee, I think Power Strike is important. Some people say that Ironskin is not important. I think that it depends on your settings. You can die in one hit on the hardest. Granted, it could also save your life just as easy.
Personally, my setup is something like 30 str, 12 agi, 4 int, 24 charm currently. I am at the point thinking whether or not I'd want to put points into intelligence and increase the important skills and be able to read the books, or if I want to max agility for skills like looting (is it fixed now?) and weapon speed.
