I suggest increasing the amount of players needed to kick someone to three if the party has four players or is full.. I think making sure the majority of the party wants the player to be booted would be more fair than the current system.
Guild Wars 2 Needs Hall of Heroes