The teamwork requirements would be astronomical. If it was line battles with solid teamwork on each side, I could see it working for special occasions, but for just pub drop-in, it'd be a mess. People would get in kick-fights over the rudder.
Also, you'd have the problem of pertinence. So we've got one captain who steers, some guys manning the cannons, and some guys as marines, right? Except that when the gunners are doing something, the marines aren't, and vice-versa. If you just make it so that there's one class that can do both, then you either a) need enough cannons for everyone, and make it so that there's no reason to ever go corps-a-corps, or b) give people non-shooting non-fighting jobs to do, which nobody will ever do.
The idea of specialized, synchronized skill-sets has always fascinated me. If you had two good, disciplined groups, then this could be an absolute blast. But if any parts didn't fit, or anybody wasn't willing to fit, it'd collapse.