Would it be too difficult to just remove that mod by itself?
No. However, my mod is seriously outdated, so it might cause problems and it will lack all the new features and bugfixes.
I can't update it as several required mods like Diplomacy and Custom Commander are dead.
I've actually been playing using Native Mod Compilation Full 1.0 with Warband version 1.161
The only had to fix a couple things.
I set everything under update_agent_hp_bar -1 to 0 in scripts.txt.
The error messages it generated from opcode 707 errors disabled the chat messages. Of course that change disabled the hp bar function, but I never used that anyway and the chat log was significantly more important.
I also disabled shield bash because that overrides block cancelling which is a core combat mechanic...
Other than those changes and personal tweaks the mod works fine.