I entered Praven (swadien) and swore loyalty to the count there, but it made my join vaegirs (the count said "you are an enemy to us, sapi")!
Seems like a simple scripting error to me, but why the faction scripts were played around with is beyond me....