I'd have no problem at all with the slow levelling/skill progression if characters started out at least moderately competent to begin with.
Instead, you get a background in which you may spend all your formative years focused on training towards one end, only to end up with skill roughly on par with looters -- who are supposed to be drunken, ragged, good-for-nothings. That's inane.
If you started out with your 'professional' skills floating somewhere around 80-90-ish, perhaps with a couple floating lower than that to flesh things out, that would make for a decent base. Then the slow skill progression makes a kind of sense, as you hone your way from being yet another person with some training in war/smithing/leadership/etc, to someone of singular ability and reputation. Or abandon your original career and try to build those lesser skills. But at least you'd have a base.
Part of the problem is that many tasks can't be accomplished with lower skill, and while players can win fights against the AI with lower skill, the game play just feels bad. Combat is clunky and unresponsive. It's not until you get to roughtly 90-100 in skill that it starts to feel smoother and responsive.